2023-10-08T15:52:25.781 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T15:52:25.781 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289 --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} -- /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/orig.config.yaml 2023-10-08T15:52:25.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:52:25.907 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} email: null first_in_suite: false job_id: '7418289' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - responding to mclientcaps\(revoke\) - not advance its oldest_client_tid - failing to advance its oldest client/flush tid - Too many inodes in cache - failing to respond to cache pressure - slow requests are blocked - failing to respond to capability release - MDS cache is too large - \(MDS_CLIENT_OLDEST_TID\) - \(MDS_CACHE_OVERSIZED\) sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-07-1508-quincy sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-07-1508-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_limits teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-08_15:41:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T15:52:25.907 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa; will attempt to use it 2023-10-08T15:52:25.908 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks 2023-10-08T15:52:25.908 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T15:52:25.910 INFO:teuthology.task.internal:Checking packages... 2023-10-08T15:52:25.930 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T15:52:25.931 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T15:52:25.931 INFO:teuthology.packaging:ref: None 2023-10-08T15:52:25.931 INFO:teuthology.packaging:tag: None 2023-10-08T15:52:25.931 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:52:25.931 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:52:25.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:52:26.146 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320-g08cac018-1focal 2023-10-08T15:52:26.146 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T15:52:26.153 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T15:52:26.153 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T15:52:26.160 INFO:teuthology.task.internal:Saving configuration 2023-10-08T15:52:26.175 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T15:52:26.182 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:52:26.206 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:36.233793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:52:26.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:36.235069', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:52:26.230 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T15:52:26.387 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T15:52:26.387 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T15:52:26.387 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T15:52:26.455 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3afa456040>, signals=[15]) 2023-10-08T15:52:26.456 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T15:52:26.462 INFO:teuthology.task.internal:Opening connections... 2023-10-08T15:52:26.462 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:52:26.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:26.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T15:52:26.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:26.574 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T15:52:26.581 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-10-08T15:52:26.600 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-10-08T15:52:26.601 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-08T15:52:26.649 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-08T15:52:26.649 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:52:26.650 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-08T15:52:26.651 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:52:26.651 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-08T15:52:26.680 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-10-08T15:52:26.686 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-10-08T15:52:26.687 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-10-08T15:52:26.733 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="20.04" 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:52:26.734 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:52:26.735 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:52:26.735 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=focal 2023-10-08T15:52:26.735 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:52:26.735 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-10-08T15:52:26.772 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T15:52:26.781 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T15:52:26.790 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T15:52:26.790 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:52:26.793 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:52:26.798 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T15:52:26.805 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T15:52:26.805 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:52:26.841 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:52:26.860 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T15:52:26.913 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T15:52:26.927 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T15:52:26.927 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T15:52:26.927 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:52:26.928 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:52:26.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:52:26.933 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-10-08T15:52:26.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:52:26.934 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-10-08T15:52:26.940 INFO:teuthology.orchestra.run.smithi003.stdout:5.4.0-124-generic 2023-10-08T15:52:26.940 INFO:teuthology.task.kernel:Running kernel on smithi003: 5.4.0-124-generic 2023-10-08T15:52:26.941 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get clean 2023-10-08T15:52:26.942 INFO:teuthology.orchestra.run.smithi027.stdout:5.4.0-124-generic 2023-10-08T15:52:26.942 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.4.0-124-generic 2023-10-08T15:52:26.942 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2023-10-08T15:52:27.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-10-08T15:52:27.052 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2023-10-08T15:52:27.199 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:52:27.201 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:52:27.212 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:52:27.274 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:52:27.316 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:52:27.316 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:52:27.398 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:52:27.493 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:52:27.583 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:52:27.596 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:52:27.627 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:52:27.627 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:52:27.627 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:52:27.641 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:52:27.642 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:52:27.644 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:52:27.644 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:52:27.650 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:52:27.654 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:52:27.656 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:52:27.656 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:52:27.657 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:52:27.662 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:52:27.662 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:52:27.716 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:52:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:52:27.731 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:52:27.731 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:52:27.732 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:52:27.741 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:52:27.750 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:52:27.762 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:52:27.764 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:52:27.775 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:52:27.782 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:52:27.785 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:52:27.788 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:52:27.790 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:52:27.793 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:52:27.798 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:52:27.800 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:52:27.802 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:52:27.808 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:52:27.815 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:52:27.817 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:52:27.828 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:52:27.882 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:52:27.923 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:52:28.128 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:52:28.291 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:52:28.304 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:52:28.304 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:52:28.305 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:52:28.366 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:52:28.375 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:52:28.400 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:52:28.415 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:52:28.423 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:52:28.424 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:52:28.499 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:52:28.500 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:52:28.507 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:52:28.507 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:52:28.521 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:52:28.539 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:52:28.704 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:52:29.119 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:52:29.125 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:52:29.127 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:52:29.135 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:52:29.137 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:52:29.177 INFO:teuthology.orchestra.run.smithi003.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:52:29.215 INFO:teuthology.orchestra.run.smithi003.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:52:29.228 INFO:teuthology.orchestra.run.smithi003.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:52:29.229 INFO:teuthology.orchestra.run.smithi003.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:52:29.230 INFO:teuthology.orchestra.run.smithi003.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:52:29.232 INFO:teuthology.orchestra.run.smithi003.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:52:29.232 INFO:teuthology.orchestra.run.smithi003.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:52:29.232 INFO:teuthology.orchestra.run.smithi003.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:52:29.258 INFO:teuthology.orchestra.run.smithi003.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:52:29.259 INFO:teuthology.orchestra.run.smithi003.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:52:29.423 INFO:teuthology.orchestra.run.smithi003.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:52:29.586 INFO:teuthology.orchestra.run.smithi003.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:52:29.637 INFO:teuthology.orchestra.run.smithi003.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:52:31.601 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 17.6 MB in 3s (6,996 kB/s) 2023-10-08T15:52:31.749 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 17.6 MB in 3s (6,624 kB/s) 2023-10-08T15:52:33.075 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:52:33.099 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:52:33.170 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:52:33.277 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T15:52:33.304 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:52:33.376 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T15:52:33.377 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T15:52:33.445 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T15:52:33.579 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-10-08T15:52:33.579 INFO:teuthology.orchestra.run.smithi003.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:52:33.579 INFO:teuthology.orchestra.run.smithi003.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:52:33.580 INFO:teuthology.orchestra.run.smithi003.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:52:33.581 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-10-08T15:52:33.581 INFO:teuthology.orchestra.run.smithi003.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:52:33.581 INFO:teuthology.orchestra.run.smithi003.stdout:Recommended packages: 2023-10-08T15:52:33.581 INFO:teuthology.orchestra.run.smithi003.stdout: thermald 2023-10-08T15:52:33.640 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-10-08T15:52:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:52:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:52:33.640 INFO:teuthology.orchestra.run.smithi003.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:52:33.641 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-10-08T15:52:33.642 INFO:teuthology.orchestra.run.smithi003.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:52:33.653 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-08T15:52:33.654 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-08T15:52:33.825 INFO:teuthology.orchestra.run.smithi003.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:52:33.825 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:52:33.825 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:52:33.825 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:52:33.860 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2023-10-08T15:52:33.860 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:52:33.860 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:52:33.860 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:52:33.861 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2023-10-08T15:52:33.861 INFO:teuthology.orchestra.run.smithi027.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:52:33.861 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2023-10-08T15:52:33.861 INFO:teuthology.orchestra.run.smithi027.stdout: thermald 2023-10-08T15:52:33.917 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2023-10-08T15:52:33.917 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:52:33.918 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:52:33.918 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:52:33.919 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2023-10-08T15:52:33.919 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:52:33.977 INFO:teuthology.orchestra.run.smithi027.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:52:33.977 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:52:33.977 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:52:33.977 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:52:34.498 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:52:34.637 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:52:34.958 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:52:35.228 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:52:35.384 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:52:35.384 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:52:35.384 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:52:35.508 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:52:35.520 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:52:36.238 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 77.0 MB in 2s (48.3 MB/s) 2023-10-08T15:52:36.435 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:52:36.534 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:52:36.534 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:52:36.534 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:52:36.812 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:52:36.825 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:52:37.526 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 77.0 MB in 3s (24.2 MB/s) 2023-10-08T15:52:37.706 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:52:38.171 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:52:38.176 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:38.307 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:39.434 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:52:39.439 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:39.554 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:40.282 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:52:40.296 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:40.405 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:41.437 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:52:41.454 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:41.477 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:52:41.493 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:41.535 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:41.549 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:42.899 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:52:42.914 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:42.957 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:46.365 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:52:46.514 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:52:46.890 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:52:47.042 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:52:47.379 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:52:47.393 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:52:47.437 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:52:47.719 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:52:47.846 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:52:48.199 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:52:48.333 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:52:48.661 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:52:48.674 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:52:48.719 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:52:53.790 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:52:53.813 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:53.857 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:53.980 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:52:54.003 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:52:54.046 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:56.754 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:52:56.773 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:52:56.875 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:52:56.910 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:52:57.202 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:52:57.262 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:52:57.363 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:57.406 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:57.497 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:57.533 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:58.743 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:59.669 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:52:59.935 INFO:teuthology.orchestra.run.smithi003.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:52:59.935 INFO:teuthology.orchestra.run.smithi003.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:00.095 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:53:00.221 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:53:01.046 INFO:teuthology.orchestra.run.smithi027.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:53:01.046 INFO:teuthology.orchestra.run.smithi027.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:01.204 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:53:01.330 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:53:01.439 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:53:01.590 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:53:01.734 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:53:01.806 INFO:teuthology.orchestra.run.smithi003.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:53:01.807 INFO:teuthology.orchestra.run.smithi003.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:02.548 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:53:02.699 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:53:02.826 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:53:02.918 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:53:02.918 INFO:teuthology.orchestra.run.smithi027.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:24.606 INFO:teuthology.orchestra.run.smithi003.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:53:24.606 INFO:teuthology.orchestra.run.smithi003.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:53:24.619 INFO:teuthology.orchestra.run.smithi003.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:53:24.635 INFO:teuthology.orchestra.run.smithi003.stdout:Generating grub configuration file ... 2023-10-08T15:53:24.937 INFO:teuthology.orchestra.run.smithi003.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:53:24.958 INFO:teuthology.orchestra.run.smithi003.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:25.299 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:53:25.300 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:53:25.305 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:53:25.322 INFO:teuthology.orchestra.run.smithi027.stdout:Generating grub configuration file ... 2023-10-08T15:53:25.357 INFO:teuthology.orchestra.run.smithi003.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:53:25.369 INFO:teuthology.orchestra.run.smithi003.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:53:25.740 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:53:25.769 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:26.163 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:53:26.188 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:53:28.111 INFO:teuthology.orchestra.run.smithi003.stdout:done 2023-10-08T15:53:28.551 DEBUG:teuthology.orchestra.run.smithi003:> dpkg -s linux-image-generic 2023-10-08T15:53:28.641 INFO:teuthology.orchestra.run.smithi003.stdout:Package: linux-image-generic 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Status: install ok installed 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Priority: optional 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Section: kernel 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Installed-Size: 20 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: amd64 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Source: linux-meta 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Version: 5.4.0.164.161 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:53:28.642 INFO:teuthology.orchestra.run.smithi003.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:53:28.643 INFO:teuthology.orchestra.run.smithi003.stdout:Recommends: thermald 2023-10-08T15:53:28.643 INFO:teuthology.orchestra.run.smithi003.stdout:Description: Generic Linux kernel image 2023-10-08T15:53:28.643 INFO:teuthology.orchestra.run.smithi003.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:53:28.643 INFO:teuthology.orchestra.run.smithi003.stdout: available. 2023-10-08T15:53:28.643 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:53:28.643 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:53:28.643 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:53:28.643 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-08T15:53:28.643 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:53:28.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get clean 2023-10-08T15:53:28.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-10-08T15:53:28.874 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:53:28.969 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:53:29.045 INFO:teuthology.orchestra.run.smithi027.stdout:done 2023-10-08T15:53:29.051 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:53:29.133 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:53:29.475 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2023-10-08T15:53:29.529 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2023-10-08T15:53:29.529 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 20 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.4.0.164.161 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:53:29.530 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2023-10-08T15:53:29.531 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2023-10-08T15:53:29.531 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:53:29.531 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2023-10-08T15:53:29.531 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:53:29.531 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:53:29.531 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:53:29.531 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-08T15:53:29.531 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:53:29.531 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2023-10-08T15:53:29.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2023-10-08T15:53:29.892 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:53:29.893 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:53:29.962 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:53:30.044 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:53:30.674 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:53:30.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:53:30.769 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:53:30.954 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T15:53:30.955 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T15:53:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:53:31.173 INFO:teuthology.orchestra.run.smithi003.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:53:31.175 DEBUG:teuthology.orchestra.run.smithi003:> dpkg -s linux-image-generic 2023-10-08T15:53:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:Package: linux-image-generic 2023-10-08T15:53:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:Status: install ok installed 2023-10-08T15:53:31.199 INFO:teuthology.orchestra.run.smithi003.stdout:Priority: optional 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Section: kernel 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Installed-Size: 20 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: amd64 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Source: linux-meta 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Version: 5.4.0.164.161 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Recommends: thermald 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout:Description: Generic Linux kernel image 2023-10-08T15:53:31.200 INFO:teuthology.orchestra.run.smithi003.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:53:31.201 INFO:teuthology.orchestra.run.smithi003.stdout: available. 2023-10-08T15:53:31.201 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-10-08T15:53:31.246 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.IygiUs65Jl 2023-10-08T15:53:31.247 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IygiUs65Jl 2023-10-08T15:53:31.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.IygiUs65Jl 2023-10-08T15:53:31.299 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.IygiUs65Jl is 9KB 2023-10-08T15:53:31.313 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.IygiUs65Jl 2023-10-08T15:53:31.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:53:31.375 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:53:31.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:53:31.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:53:31.411 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:53:31.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo update-grub 2023-10-08T15:53:31.701 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T15:53:31.727 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:53:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T15:53:32.007 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-08T15:53:32.007 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-08T15:53:32.241 INFO:teuthology.orchestra.run.smithi027.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:53:32.241 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:53:32.243 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 20 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.4.0.164.161 2023-10-08T15:53:32.260 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:53:32.261 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:53:32.261 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2023-10-08T15:53:32.261 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2023-10-08T15:53:32.261 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:53:32.261 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2023-10-08T15:53:32.261 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-10-08T15:53:32.267 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.l18R4eL2oy 2023-10-08T15:53:32.267 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub/grub.cfg /tmp/tmp.l18R4eL2oy 2023-10-08T15:53:32.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.l18R4eL2oy 2023-10-08T15:53:32.360 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.l18R4eL2oy is 9KB 2023-10-08T15:53:32.373 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.l18R4eL2oy 2023-10-08T15:53:32.379 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:53:32.434 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T15:53:32.434 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:53:32.434 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:53:32.460 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:53:32.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo update-grub 2023-10-08T15:53:32.747 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:53:32.754 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:53:32.766 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2023-10-08T15:53:32.997 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:53:33.009 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:33.363 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:53:33.374 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:53:33.800 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:53:33.821 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:53:33.829 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2023-10-08T15:53:34.100 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:53:34.112 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:53:34.467 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:53:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:53:35.025 INFO:teuthology.orchestra.run.smithi003.stderr:done 2023-10-08T15:53:35.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2023-10-08T15:53:36.161 INFO:teuthology.orchestra.run.smithi027.stderr:done 2023-10-08T15:53:36.163 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2023-10-08T15:54:05.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-08T15:54:05.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:54:05.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:54:06.167 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-08T15:54:06.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:54:06.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:54:23.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-08T15:54:24.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-08T15:54:32.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:54:32.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:54:33.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:54:33.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:54:36.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-08T15:54:48.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:54:48.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:54:51.646 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-08T15:55:06.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:55:06.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:55:09.722 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-08T15:55:27.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:55:27.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:55:32.494 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T15:55:44.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:55:44.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:55:44.732 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-08T15:55:45.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:55:45.299 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-08T15:55:45.299 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-10-08T15:55:45.306 INFO:teuthology.orchestra.run.smithi003.stdout:5.4.0-164-generic 2023-10-08T15:55:45.306 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:55:45.307 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:55:45.307 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:55:46.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-08T15:55:46.308 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T15:55:46.309 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:55:46.406 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2023-10-08T15:55:46.425 DEBUG:teuthology.parallel:result is None 2023-10-08T15:56:07.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:56:07.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:56:07.539 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-08T15:56:08.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T15:56:08.077 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-08T15:56:08.077 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-10-08T15:56:08.083 INFO:teuthology.orchestra.run.smithi027.stdout:5.4.0-164-generic 2023-10-08T15:56:08.083 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:56:08.084 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:56:08.084 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:56:09.084 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-08T15:56:09.084 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:56:09.175 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2023-10-08T15:56:09.204 DEBUG:teuthology.parallel:result is None 2023-10-08T15:56:09.204 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T15:56:09.212 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T15:56:09.213 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:56:09.215 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:56:09.222 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T15:56:09.231 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T15:56:09.240 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T15:56:09.240 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:56:09.245 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:56:09.265 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T15:56:09.273 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T15:56:09.274 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:56:09.305 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:56:09.323 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:56:09.325 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:56:09.333 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:56:09.335 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:56:09.347 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T15:56:09.355 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T15:56:09.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:56:09.358 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:56:09.373 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T15:56:09.383 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T15:56:09.383 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:56:09.417 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:56:09.424 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:56:09.430 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:56:09.438 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:56:09.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:56:09.527 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:56:09.534 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:56:09.542 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T15:56:09.542 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:56:09.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2023-10-08T15:56:09.568 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2023-10-08T15:56:09.659 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T15:56:09.668 INFO:teuthology.task.internal:Starting timer... 2023-10-08T15:56:09.668 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T15:56:09.681 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T15:56:09.695 DEBUG:teuthology.task.selinux:Excluding smithi003: OS 'ubuntu' does not support SELinux 2023-10-08T15:56:09.695 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux 2023-10-08T15:56:09.695 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T15:56:09.696 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-08T15:56:09.696 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T15:56:09.696 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T15:56:09.711 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T15:56:09.718 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T15:56:09.850 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T15:56:09.866 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T15:56:09.868 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi027.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T16:02:07.337 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi027.front.sepia.ceph.com')] 2023-10-08T16:02:07.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T16:02:07.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:02:07.385 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-08T16:02:07.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T16:02:07.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T16:02:07.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:02:07.553 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-08T16:02:07.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-08T16:02:07.680 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T16:02:07.707 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T16:02:07.708 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:02:07.708 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:02:07.710 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:02:07.710 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:02:07.741 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T16:02:07.741 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Command line: ntpd -gq 2023-10-08T16:02:07.742 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: proto: precision = 0.103 usec (-23) 2023-10-08T16:02:07.742 INFO:teuthology.orchestra.run.smithi003.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:02:07.742 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:02:07.743 INFO:teuthology.orchestra.run.smithi003.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:02:07.743 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:02:07.743 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T16:02:07.744 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T16:02:07.744 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T16:02:07.744 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listen normally on 3 ens1f0 172.21.15.3:123 2023-10-08T16:02:07.744 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listen normally on 4 lo [::1]:123 2023-10-08T16:02:07.744 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15dc%4]:123 2023-10-08T16:02:07.744 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:07 ntpd[22869]: Listening on routing socket on fd #22 for interface updates 2023-10-08T16:02:07.747 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T16:02:07.747 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Command line: ntpd -gq 2023-10-08T16:02:07.748 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: proto: precision = 0.164 usec (-22) 2023-10-08T16:02:07.749 INFO:teuthology.orchestra.run.smithi027.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:02:07.749 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:02:07.749 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:02:07.750 INFO:teuthology.orchestra.run.smithi027.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:02:07.750 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T16:02:07.751 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T16:02:07.751 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T16:02:07.751 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listen normally on 3 ens1f0 172.21.15.27:123 2023-10-08T16:02:07.751 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listen normally on 4 lo [::1]:123 2023-10-08T16:02:07.751 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:395a%4]:123 2023-10-08T16:02:07.751 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:07 ntpd[22795]: Listening on routing socket on fd #22 for interface updates 2023-10-08T16:02:08.741 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:08 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:08.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:08 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:08.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:08.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:08.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:08.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:08.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:08.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:08.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:08.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:08 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:09.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:09 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:09.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:09 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:09.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:09 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:09.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:09 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:09.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:09 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:09.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:09 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:09.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:09 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:09.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:09 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:09.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:09 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:09.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:09 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:09.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:09 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:09.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:09 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:10.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:10 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:10.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:10 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:10.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:10 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:10.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:10 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:10.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:10 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:10.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:10 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:11.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:11.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:11 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:11.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:11.750 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:11.750 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:11 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:12.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:12 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:12.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:12 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:12.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:12 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:12.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:12 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:12.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:12 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:12.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:12 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:12.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:12 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:12.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:12 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:12.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:12 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:12.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:12 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:12.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:12 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:12.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:12 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:13.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:13.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:13 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:13.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:13.750 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:13 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:14.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:14 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:14.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:14 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:14.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:14 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:14.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:14 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:14.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:14 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:14.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:14 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:14.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:14.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:14.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:14.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:14.748 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:14.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:14.749 INFO:teuthology.orchestra.run.smithi027.stdout: 8 Oct 16:02:14 ntpd[22795]: ntpd: time slew -0.000425 s 2023-10-08T16:02:14.749 INFO:teuthology.orchestra.run.smithi027.stdout:ntpd: time slew -0.000425s 2023-10-08T16:02:14.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T16:02:14.749 INFO:teuthology.orchestra.run.smithi027.stderr: 8 Oct 16:02:14 ntpd[22795]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T16:02:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:02:14.816 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2023-10-08T16:02:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:15.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:15.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:15.742 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 16:02:15 ntpd[22869]: ntpd: time slew +0.001047 s 2023-10-08T16:02:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:ntpd: time slew +0.001047s 2023-10-08T16:02:15.744 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T16:02:15.744 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 16:02:15 ntpd[22869]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T16:02:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:02:15.815 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================== 2023-10-08T16:02:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:02:15.816 INFO:teuthology.run_tasks:Running task install... 2023-10-08T16:02:15.825 DEBUG:teuthology.task.install:project ceph 2023-10-08T16:02:15.825 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T16:02:15.825 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T16:02:15.825 INFO:teuthology.task.install:Using flavor: default 2023-10-08T16:02:15.831 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T16:02:15.831 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T16:02:15.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-key list | grep Ceph 2023-10-08T16:02:15.832 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-key list | grep Ceph 2023-10-08T16:02:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T16:02:15.935 INFO:teuthology.orchestra.run.smithi003.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T16:02:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T16:02:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T16:02:15.996 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T16:02:15.996 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T16:02:15.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:02:16.001 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T16:02:16.001 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T16:02:16.001 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T16:02:16.001 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T16:02:16.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:02:16.136 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T16:02:16.136 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:02:16.214 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T16:02:16.214 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:02:16.452 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:02:16.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T16:02:16.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-10-08T16:02:16.580 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:02:16.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T16:02:16.596 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2023-10-08T16:02:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T16:02:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T16:02:16.615 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T16:02:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T16:02:16.866 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T16:02:16.866 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T16:02:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T16:02:16.936 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T16:02:16.997 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T16:02:17.023 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T16:02:17.045 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T16:02:17.084 INFO:teuthology.orchestra.run.smithi003.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T16:02:17.129 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T16:02:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T16:02:17.216 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T16:02:17.281 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T16:02:17.303 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T16:02:17.378 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 28.4 kB in 1s (37.9 kB/s) 2023-10-08T16:02:17.404 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T16:02:17.533 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 28.4 kB in 1s (36.7 kB/s) 2023-10-08T16:02:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T16:02:18.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T16:02:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T16:02:18.608 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T16:02:18.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T16:02:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T16:02:18.757 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T16:02:18.757 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T16:02:18.917 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-08T16:02:18.918 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-08T16:02:18.940 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:02:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:02:18.941 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:02:18.941 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-10-08T16:02:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T16:02:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T16:02:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T16:02:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T16:02:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:02:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T16:02:18.944 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T16:02:18.945 INFO:teuthology.orchestra.run.smithi003.stdout:Recommended packages: 2023-10-08T16:02:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: btrfs-tools 2023-10-08T16:02:19.070 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-10-08T16:02:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T16:02:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T16:02:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T16:02:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T16:02:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T16:02:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T16:02:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:02:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T16:02:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-10-08T16:02:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 librbd1 2023-10-08T16:02:19.109 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T16:02:19.111 INFO:teuthology.orchestra.run.smithi027.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:02:19.112 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:02:19.113 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T16:02:19.114 INFO:teuthology.orchestra.run.smithi027.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T16:02:19.115 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2023-10-08T16:02:19.115 INFO:teuthology.orchestra.run.smithi027.stdout: btrfs-tools 2023-10-08T16:02:19.238 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2023-10-08T16:02:19.238 INFO:teuthology.orchestra.run.smithi027.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T16:02:19.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:02:19.240 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T16:02:19.241 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2023-10-08T16:02:19.241 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 librbd1 2023-10-08T16:02:19.265 INFO:teuthology.orchestra.run.smithi003.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T16:02:19.265 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 210 MB of archives. 2023-10-08T16:02:19.265 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T16:02:19.265 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T16:02:19.306 INFO:teuthology.orchestra.run.smithi027.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T16:02:19.306 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 210 MB of archives. 2023-10-08T16:02:19.306 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T16:02:19.306 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T16:02:19.327 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T16:02:19.335 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T16:02:19.348 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T16:02:19.364 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T16:02:19.382 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T16:02:19.397 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T16:02:19.399 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T16:02:19.410 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T16:02:19.413 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T16:02:19.433 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T16:02:19.434 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T16:02:19.440 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T16:02:19.472 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T16:02:19.473 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T16:02:19.480 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T16:02:19.482 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T16:02:19.483 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T16:02:19.485 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T16:02:19.486 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T16:02:19.486 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T16:02:19.487 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T16:02:19.499 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T16:02:19.499 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T16:02:19.506 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T16:02:19.518 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T16:02:19.519 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T16:02:19.520 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T16:02:19.521 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T16:02:19.521 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T16:02:19.523 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T16:02:19.523 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T16:02:19.525 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T16:02:19.538 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T16:02:19.539 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T16:02:19.558 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T16:02:19.558 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T16:02:19.559 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T16:02:19.560 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T16:02:19.562 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T16:02:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T16:02:19.566 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T16:02:19.568 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T16:02:19.568 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T16:02:19.578 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T16:02:19.579 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T16:02:19.597 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T16:02:19.598 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T16:02:19.599 INFO:teuthology.orchestra.run.smithi027.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T16:02:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T16:02:19.654 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T16:02:19.699 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T16:02:19.710 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T16:02:19.713 INFO:teuthology.orchestra.run.smithi027.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T16:02:19.737 INFO:teuthology.orchestra.run.smithi027.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T16:02:19.739 INFO:teuthology.orchestra.run.smithi027.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T16:02:19.760 INFO:teuthology.orchestra.run.smithi027.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T16:02:19.760 INFO:teuthology.orchestra.run.smithi027.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T16:02:19.760 INFO:teuthology.orchestra.run.smithi027.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T16:02:19.760 INFO:teuthology.orchestra.run.smithi027.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T16:02:19.761 INFO:teuthology.orchestra.run.smithi027.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T16:02:19.761 INFO:teuthology.orchestra.run.smithi027.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T16:02:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T16:02:19.798 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T16:02:19.803 INFO:teuthology.orchestra.run.smithi027.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T16:02:19.804 INFO:teuthology.orchestra.run.smithi027.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T16:02:19.806 INFO:teuthology.orchestra.run.smithi027.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T16:02:19.806 INFO:teuthology.orchestra.run.smithi027.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T16:02:19.807 INFO:teuthology.orchestra.run.smithi027.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T16:02:19.812 INFO:teuthology.orchestra.run.smithi027.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T16:02:19.814 INFO:teuthology.orchestra.run.smithi027.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T16:02:19.816 INFO:teuthology.orchestra.run.smithi027.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T16:02:19.821 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T16:02:19.823 INFO:teuthology.orchestra.run.smithi027.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T16:02:19.837 INFO:teuthology.orchestra.run.smithi027.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T16:02:19.840 INFO:teuthology.orchestra.run.smithi027.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T16:02:19.841 INFO:teuthology.orchestra.run.smithi027.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T16:02:19.861 INFO:teuthology.orchestra.run.smithi027.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T16:02:19.864 INFO:teuthology.orchestra.run.smithi027.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T16:02:19.926 INFO:teuthology.orchestra.run.smithi027.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T16:02:19.927 INFO:teuthology.orchestra.run.smithi027.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T16:02:19.927 INFO:teuthology.orchestra.run.smithi027.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T16:02:19.928 INFO:teuthology.orchestra.run.smithi027.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T16:02:19.928 INFO:teuthology.orchestra.run.smithi027.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T16:02:19.929 INFO:teuthology.orchestra.run.smithi027.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T16:02:19.943 INFO:teuthology.orchestra.run.smithi027.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T16:02:19.943 INFO:teuthology.orchestra.run.smithi027.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T16:02:19.943 INFO:teuthology.orchestra.run.smithi027.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T16:02:19.946 INFO:teuthology.orchestra.run.smithi027.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T16:02:19.966 INFO:teuthology.orchestra.run.smithi027.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T16:02:19.967 INFO:teuthology.orchestra.run.smithi027.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T16:02:19.968 INFO:teuthology.orchestra.run.smithi027.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T16:02:19.970 INFO:teuthology.orchestra.run.smithi027.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T16:02:19.970 INFO:teuthology.orchestra.run.smithi027.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T16:02:20.110 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T16:02:20.544 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T16:02:20.726 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T16:02:20.758 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T16:02:20.763 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T16:02:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T16:02:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T16:02:20.796 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T16:02:20.809 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T16:02:20.811 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T16:02:20.812 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T16:02:20.977 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T16:02:21.142 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T16:02:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T16:02:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T16:02:21.313 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T16:02:21.389 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T16:02:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T16:02:21.452 INFO:teuthology.orchestra.run.smithi003.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T16:02:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T16:02:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T16:02:21.580 INFO:teuthology.orchestra.run.smithi003.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T16:02:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T16:02:21.907 INFO:teuthology.orchestra.run.smithi027.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T16:02:21.929 INFO:teuthology.orchestra.run.smithi003.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T16:02:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T16:02:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T16:02:22.214 INFO:teuthology.orchestra.run.smithi003.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T16:02:22.244 INFO:teuthology.orchestra.run.smithi003.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T16:02:22.247 INFO:teuthology.orchestra.run.smithi003.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T16:02:22.271 INFO:teuthology.orchestra.run.smithi003.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T16:02:22.293 INFO:teuthology.orchestra.run.smithi003.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T16:02:22.310 INFO:teuthology.orchestra.run.smithi003.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T16:02:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T16:02:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T16:02:22.480 INFO:teuthology.orchestra.run.smithi003.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T16:02:22.810 INFO:teuthology.orchestra.run.smithi027.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T16:02:22.987 INFO:teuthology.orchestra.run.smithi027.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T16:02:23.074 INFO:teuthology.orchestra.run.smithi027.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T16:02:23.075 INFO:teuthology.orchestra.run.smithi027.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T16:02:23.083 INFO:teuthology.orchestra.run.smithi027.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T16:02:23.091 INFO:teuthology.orchestra.run.smithi027.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T16:02:23.279 INFO:teuthology.orchestra.run.smithi027.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T16:02:23.455 INFO:teuthology.orchestra.run.smithi003.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T16:02:23.479 INFO:teuthology.orchestra.run.smithi003.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T16:02:23.480 INFO:teuthology.orchestra.run.smithi003.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T16:02:23.552 INFO:teuthology.orchestra.run.smithi003.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T16:02:23.552 INFO:teuthology.orchestra.run.smithi003.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T16:02:23.553 INFO:teuthology.orchestra.run.smithi003.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T16:02:23.554 INFO:teuthology.orchestra.run.smithi003.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T16:02:23.554 INFO:teuthology.orchestra.run.smithi003.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T16:02:23.554 INFO:teuthology.orchestra.run.smithi003.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T16:02:23.555 INFO:teuthology.orchestra.run.smithi003.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T16:02:23.719 INFO:teuthology.orchestra.run.smithi003.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T16:02:23.886 INFO:teuthology.orchestra.run.smithi003.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T16:02:23.967 INFO:teuthology.orchestra.run.smithi003.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T16:02:23.975 INFO:teuthology.orchestra.run.smithi003.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T16:02:24.197 INFO:teuthology.orchestra.run.smithi003.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T16:02:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T16:02:24.271 INFO:teuthology.orchestra.run.smithi003.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T16:02:24.281 INFO:teuthology.orchestra.run.smithi003.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T16:02:24.291 INFO:teuthology.orchestra.run.smithi003.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T16:02:24.328 INFO:teuthology.orchestra.run.smithi003.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T16:02:24.357 INFO:teuthology.orchestra.run.smithi003.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T16:02:24.360 INFO:teuthology.orchestra.run.smithi003.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T16:02:24.406 INFO:teuthology.orchestra.run.smithi027.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T16:02:24.415 INFO:teuthology.orchestra.run.smithi027.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T16:02:24.471 INFO:teuthology.orchestra.run.smithi003.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T16:02:24.472 INFO:teuthology.orchestra.run.smithi003.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T16:02:24.479 INFO:teuthology.orchestra.run.smithi003.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T16:02:24.513 INFO:teuthology.orchestra.run.smithi027.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T16:02:24.564 INFO:teuthology.orchestra.run.smithi003.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T16:02:24.567 INFO:teuthology.orchestra.run.smithi003.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T16:02:24.651 INFO:teuthology.orchestra.run.smithi003.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T16:02:24.750 INFO:teuthology.orchestra.run.smithi003.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T16:02:25.479 INFO:teuthology.orchestra.run.smithi003.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T16:02:25.481 INFO:teuthology.orchestra.run.smithi003.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T16:02:25.482 INFO:teuthology.orchestra.run.smithi003.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T16:02:25.483 INFO:teuthology.orchestra.run.smithi003.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T16:02:25.484 INFO:teuthology.orchestra.run.smithi003.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T16:02:25.486 INFO:teuthology.orchestra.run.smithi003.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T16:02:25.502 INFO:teuthology.orchestra.run.smithi003.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T16:02:25.502 INFO:teuthology.orchestra.run.smithi003.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T16:02:25.502 INFO:teuthology.orchestra.run.smithi003.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T16:02:25.560 INFO:teuthology.orchestra.run.smithi003.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T16:02:25.727 INFO:teuthology.orchestra.run.smithi003.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T16:02:26.013 INFO:teuthology.orchestra.run.smithi003.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T16:02:26.035 INFO:teuthology.orchestra.run.smithi003.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T16:02:26.187 INFO:teuthology.orchestra.run.smithi003.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T16:02:26.205 INFO:teuthology.orchestra.run.smithi003.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T16:02:26.881 INFO:teuthology.orchestra.run.smithi003.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T16:02:26.925 INFO:teuthology.orchestra.run.smithi003.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T16:02:27.110 INFO:teuthology.orchestra.run.smithi003.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T16:02:33.895 INFO:teuthology.orchestra.run.smithi027.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T16:02:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T16:02:37.316 INFO:teuthology.orchestra.run.smithi027.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T16:02:37.447 INFO:teuthology.orchestra.run.smithi027.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T16:02:38.477 INFO:teuthology.orchestra.run.smithi027.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T16:02:41.106 INFO:teuthology.orchestra.run.smithi003.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T16:02:42.616 INFO:teuthology.orchestra.run.smithi027.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T16:02:45.295 INFO:teuthology.orchestra.run.smithi003.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T16:02:45.438 INFO:teuthology.orchestra.run.smithi003.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T16:02:45.533 INFO:teuthology.orchestra.run.smithi003.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T16:02:46.642 INFO:teuthology.orchestra.run.smithi003.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T16:02:51.754 INFO:teuthology.orchestra.run.smithi003.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T16:02:55.986 INFO:teuthology.orchestra.run.smithi027.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T16:02:56.056 INFO:teuthology.orchestra.run.smithi027.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T16:02:56.218 INFO:teuthology.orchestra.run.smithi027.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T16:02:56.898 INFO:teuthology.orchestra.run.smithi027.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T16:02:56.924 INFO:teuthology.orchestra.run.smithi027.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T16:02:56.951 INFO:teuthology.orchestra.run.smithi027.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T16:02:57.457 INFO:teuthology.orchestra.run.smithi027.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T16:03:00.205 INFO:teuthology.orchestra.run.smithi027.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T16:03:00.210 INFO:teuthology.orchestra.run.smithi027.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T16:03:03.858 INFO:teuthology.orchestra.run.smithi003.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T16:03:03.859 INFO:teuthology.orchestra.run.smithi003.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T16:03:04.057 INFO:teuthology.orchestra.run.smithi003.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T16:03:04.672 INFO:teuthology.orchestra.run.smithi003.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T16:03:04.707 INFO:teuthology.orchestra.run.smithi003.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T16:03:04.714 INFO:teuthology.orchestra.run.smithi003.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T16:03:05.150 INFO:teuthology.orchestra.run.smithi003.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T16:03:07.095 INFO:teuthology.orchestra.run.smithi003.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T16:03:07.095 INFO:teuthology.orchestra.run.smithi003.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T16:03:10.347 INFO:teuthology.orchestra.run.smithi027.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T16:03:10.352 INFO:teuthology.orchestra.run.smithi027.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T16:03:10.357 INFO:teuthology.orchestra.run.smithi027.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T16:03:10.358 INFO:teuthology.orchestra.run.smithi027.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T16:03:10.410 INFO:teuthology.orchestra.run.smithi027.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T16:03:10.411 INFO:teuthology.orchestra.run.smithi027.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T16:03:11.276 INFO:teuthology.orchestra.run.smithi027.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T16:03:11.918 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 210 MB in 52s (4,034 kB/s) 2023-10-08T16:03:12.060 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T16:03:12.116 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T16:03:12.120 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T16:03:12.166 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T16:03:12.469 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T16:03:12.485 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T16:03:12.527 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:03:12.830 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T16:03:12.846 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T16:03:12.888 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:03:13.241 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T16:03:13.259 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T16:03:13.341 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:03:13.714 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:13.820 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:03:14.515 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:14.633 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:03:14.637 INFO:teuthology.orchestra.run.smithi003.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T16:03:14.704 INFO:teuthology.orchestra.run.smithi003.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T16:03:14.708 INFO:teuthology.orchestra.run.smithi003.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T16:03:14.708 INFO:teuthology.orchestra.run.smithi003.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T16:03:14.709 INFO:teuthology.orchestra.run.smithi003.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T16:03:14.709 INFO:teuthology.orchestra.run.smithi003.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T16:03:15.303 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T16:03:15.323 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:15.361 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:15.681 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rados. 2023-10-08T16:03:15.698 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:15.738 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:16.062 INFO:teuthology.orchestra.run.smithi003.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T16:03:16.101 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T16:03:16.120 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:16.151 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:16.370 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T16:03:16.386 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:16.428 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:16.760 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 210 MB in 57s (3,680 kB/s) 2023-10-08T16:03:16.798 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T16:03:16.814 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:16.919 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T16:03:16.973 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:16.976 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T16:03:16.980 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T16:03:17.025 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T16:03:17.286 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T16:03:17.299 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T16:03:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T16:03:17.316 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T16:03:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:03:17.357 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T16:03:17.605 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T16:03:17.624 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T16:03:17.651 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T16:03:17.655 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:03:17.668 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:17.709 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:18.000 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T16:03:18.016 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T16:03:18.029 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T16:03:18.047 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T16:03:18.079 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:03:18.100 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:03:18.415 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T16:03:18.434 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T16:03:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:18.473 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:03:18.587 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:03:18.810 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T16:03:18.826 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T16:03:18.868 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:03:19.259 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:19.271 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T16:03:19.288 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T16:03:19.321 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:03:19.384 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:03:19.591 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T16:03:19.610 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T16:03:19.649 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:03:20.046 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T16:03:20.064 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:20.153 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T16:03:20.169 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:03:20.221 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:03:20.449 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rados. 2023-10-08T16:03:20.466 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:20.507 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:20.714 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T16:03:20.732 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:03:20.772 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:03:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T16:03:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:20.953 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:21.109 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T16:03:21.124 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:03:21.167 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:03:21.203 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T16:03:21.220 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:21.261 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:21.570 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T16:03:21.587 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T16:03:21.622 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T16:03:21.628 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:03:21.640 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:21.680 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:21.973 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librgw2. 2023-10-08T16:03:21.988 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:22.009 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T16:03:22.022 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T16:03:22.067 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T16:03:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T16:03:22.353 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:22.723 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T16:03:22.742 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T16:03:22.759 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T16:03:22.776 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:22.781 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:03:22.817 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:23.150 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T16:03:23.168 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T16:03:23.187 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liboath0. 2023-10-08T16:03:23.204 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T16:03:23.209 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:03:23.245 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T16:03:23.523 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T16:03:23.540 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:23.567 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T16:03:23.581 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:23.587 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T16:03:23.629 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:03:24.007 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T16:03:24.024 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T16:03:24.043 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-common. 2023-10-08T16:03:24.060 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:24.065 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:03:24.101 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:24.435 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T16:03:24.452 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T16:03:24.493 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:03:24.964 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T16:03:24.980 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:03:25.032 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:03:25.517 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T16:03:25.535 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:03:25.575 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:03:25.930 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T16:03:25.946 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:03:25.988 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:03:26.392 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T16:03:26.408 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T16:03:26.450 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:03:26.748 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-base. 2023-10-08T16:03:26.767 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:26.812 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librgw2. 2023-10-08T16:03:26.831 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:26.849 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:26.870 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:27.689 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T16:03:27.707 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:27.747 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:27.852 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T16:03:27.870 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T16:03:27.902 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:03:28.091 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liboath0. 2023-10-08T16:03:28.108 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T16:03:28.149 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T16:03:28.265 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T16:03:28.283 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T16:03:28.322 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T16:03:28.477 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T16:03:28.496 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:28.535 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:28.600 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T16:03:28.618 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:28.659 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:28.972 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-common. 2023-10-08T16:03:28.988 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:29.047 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T16:03:29.063 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T16:03:29.063 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:29.105 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:03:29.435 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T16:03:29.452 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T16:03:29.493 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:03:29.830 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T16:03:29.850 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T16:03:29.888 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T16:03:30.199 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T16:03:30.218 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T16:03:30.257 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:03:30.569 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T16:03:30.585 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T16:03:30.627 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T16:03:30.938 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T16:03:30.954 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T16:03:30.996 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:03:31.274 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-mako. 2023-10-08T16:03:31.294 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T16:03:31.332 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:03:31.661 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T16:03:31.677 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T16:03:31.719 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:03:31.777 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-base. 2023-10-08T16:03:31.793 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:31.846 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:32.022 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T16:03:32.038 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T16:03:32.080 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:03:32.408 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webob. 2023-10-08T16:03:32.424 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T16:03:32.466 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T16:03:32.803 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T16:03:32.820 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T16:03:32.840 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T16:03:32.852 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:03:32.857 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T16:03:32.898 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:03:33.180 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T16:03:33.196 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T16:03:33.238 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T16:03:33.260 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T16:03:33.279 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T16:03:33.310 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T16:03:33.542 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T16:03:33.558 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T16:03:33.588 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T16:03:33.594 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:03:33.604 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:33.646 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:33.903 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T16:03:33.920 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T16:03:33.953 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T16:03:34.009 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T16:03:34.027 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T16:03:34.067 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:03:34.223 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-paste. 2023-10-08T16:03:34.240 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T16:03:34.281 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:03:34.370 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T16:03:34.389 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T16:03:34.428 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:03:34.584 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T16:03:34.601 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T16:03:34.633 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:03:34.790 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T16:03:34.808 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T16:03:34.848 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T16:03:34.937 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T16:03:34.953 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T16:03:34.995 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:03:35.151 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T16:03:35.170 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T16:03:35.234 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:03:35.306 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T16:03:35.322 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T16:03:35.364 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T16:03:35.545 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T16:03:35.563 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T16:03:35.597 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T16:03:35.709 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T16:03:35.725 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T16:03:35.758 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:03:35.931 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T16:03:35.948 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T16:03:35.989 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:03:36.097 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T16:03:36.113 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T16:03:36.146 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:03:36.292 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-mako. 2023-10-08T16:03:36.309 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T16:03:36.350 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:03:36.517 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T16:03:36.533 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:36.575 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:36.712 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T16:03:36.729 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T16:03:36.770 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:03:36.920 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T16:03:36.936 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:37.011 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:37.073 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T16:03:37.089 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T16:03:37.131 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:03:37.459 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webob. 2023-10-08T16:03:37.476 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T16:03:37.506 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T16:03:37.517 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T16:03:37.526 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:37.564 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:38.245 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T16:03:38.261 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T16:03:38.303 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:03:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T16:03:38.664 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T16:03:38.705 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T16:03:38.743 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T16:03:38.760 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:38.800 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:39.026 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T16:03:39.043 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T16:03:39.078 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:03:39.395 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T16:03:39.415 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T16:03:39.445 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T16:03:39.706 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-paste. 2023-10-08T16:03:39.722 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T16:03:39.764 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:03:40.101 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T16:03:40.118 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T16:03:40.159 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:03:40.461 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T16:03:40.477 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T16:03:40.520 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:03:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T16:03:40.851 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T16:03:40.889 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T16:03:41.208 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T16:03:41.225 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T16:03:41.266 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:03:41.596 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph. 2023-10-08T16:03:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:41.646 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T16:03:41.666 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T16:03:41.687 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:41.704 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:03:42.006 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T16:03:42.022 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:42.064 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:42.083 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T16:03:42.099 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:42.141 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:42.493 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T16:03:42.493 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T16:03:42.510 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:42.511 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:42.551 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:42.551 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:43.072 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T16:03:43.089 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:43.129 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:43.379 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephadm. 2023-10-08T16:03:43.396 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:43.429 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:43.748 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T16:03:43.765 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T16:03:43.806 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T16:03:44.110 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T16:03:44.126 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:44.159 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:44.275 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T16:03:44.290 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:44.332 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:44.471 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T16:03:44.488 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T16:03:44.529 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T16:03:44.824 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T16:03:44.847 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T16:03:44.882 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:03:45.197 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T16:03:45.197 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T16:03:45.209 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:03:45.453 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-routes. 2023-10-08T16:03:45.471 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T16:03:45.528 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T16:03:45.823 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T16:03:45.840 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:45.873 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:46.393 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T16:03:46.409 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T16:03:46.451 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:03:46.754 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph. 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T16:03:47.178 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T16:03:47.189 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T16:03:47.446 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T16:03:47.723 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:47.723 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:47.924 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T16:03:47.941 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:47.982 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:48.432 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T16:03:48.451 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T16:03:48.490 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:03:48.552 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephadm. 2023-10-08T16:03:48.571 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:48.610 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:48.963 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T16:03:48.979 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T16:03:49.021 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T16:03:49.102 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T16:03:49.122 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T16:03:49.168 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T16:03:49.323 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T16:03:49.343 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:49.381 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:49.572 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T16:03:49.589 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T16:03:49.630 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:03:49.751 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T16:03:49.767 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T16:03:49.809 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T16:03:50.070 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T16:03:50.088 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T16:03:50.128 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:03:50.280 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T16:03:50.297 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:50.338 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:50.389 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T16:03:50.407 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T16:03:50.447 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:03:50.783 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-routes. 2023-10-08T16:03:50.800 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T16:03:50.841 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T16:03:51.194 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T16:03:51.210 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:51.252 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:51.466 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T16:03:51.486 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T16:03:51.524 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T16:03:51.748 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T16:03:51.764 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T16:03:51.805 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:03:51.868 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T16:03:51.885 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T16:03:51.926 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:03:52.091 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T16:03:52.108 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T16:03:52.150 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:03:52.247 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T16:03:52.264 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T16:03:52.305 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:03:52.494 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T16:03:52.510 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T16:03:52.554 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T16:03:52.649 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T16:03:52.666 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T16:03:52.707 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T16:03:53.010 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T16:03:53.030 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T16:03:53.068 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T16:03:53.405 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T16:03:53.421 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T16:03:53.482 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:03:53.783 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T16:03:53.800 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T16:03:53.841 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:03:53.860 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T16:03:53.878 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T16:03:53.918 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:03:54.211 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T16:03:54.231 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T16:03:54.269 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:03:54.414 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T16:03:54.432 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T16:03:54.463 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T16:03:54.666 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T16:03:54.684 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T16:03:54.724 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:03:54.809 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T16:03:54.826 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T16:03:54.867 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:03:55.053 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T16:03:55.069 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T16:03:55.111 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:03:55.558 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T16:03:55.574 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:55.616 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:55.650 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T16:03:55.670 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:03:55.733 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:56.036 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T16:03:56.055 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T16:03:56.094 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:03:56.489 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T16:03:56.505 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:03:56.539 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:03:56.752 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T16:03:56.769 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T16:03:56.789 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package jq. 2023-10-08T16:03:56.807 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:03:56.810 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T16:03:56.846 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:03:57.100 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package socat. 2023-10-08T16:03:57.118 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T16:03:57.138 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T16:03:57.156 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T16:03:57.158 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T16:03:57.196 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:03:57.499 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T16:03:57.503 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T16:03:57.519 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T16:03:57.520 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T16:03:57.557 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:03:57.561 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:03:57.852 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T16:03:57.868 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T16:03:57.901 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T16:03:57.907 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-test. 2023-10-08T16:03:57.927 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:03:57.965 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:03:58.171 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T16:03:58.191 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T16:03:58.229 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T16:03:58.591 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T16:03:58.609 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T16:03:58.649 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:03:58.935 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T16:03:58.955 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T16:03:58.993 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:03:59.355 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T16:03:59.372 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T16:03:59.413 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:03:59.801 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T16:03:59.820 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T16:03:59.859 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:04:00.163 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T16:04:00.183 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T16:04:00.221 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:04:00.776 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T16:04:00.794 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:00.834 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:01.204 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T16:04:01.221 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T16:04:01.262 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:04:01.637 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T16:04:01.654 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:04:01.695 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:04:02.014 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package jq. 2023-10-08T16:04:02.032 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:04:02.072 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:04:02.308 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package socat. 2023-10-08T16:04:02.325 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T16:04:02.358 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T16:04:02.686 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T16:04:02.704 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T16:04:02.744 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:04:03.020 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T16:04:03.039 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:03.077 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:03.092 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-test. 2023-10-08T16:04:03.109 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:03.150 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:03.491 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T16:04:03.511 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:03.574 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:03.911 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T16:04:03.931 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T16:04:03.969 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T16:04:04.234 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T16:04:04.252 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:04.292 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:04.553 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T16:04:04.571 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:04.611 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:04.864 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T16:04:04.881 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:04:04.921 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:05.458 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T16:04:05.478 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:05.515 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:05.894 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T16:04:05.914 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T16:04:05.994 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:04:06.308 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T16:04:06.324 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:04:06.365 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:08.063 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T16:04:08.082 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T16:04:08.121 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T16:04:08.129 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T16:04:08.146 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:08.187 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:08.457 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T16:04:08.474 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T16:04:08.515 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:04:08.588 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T16:04:08.607 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:08.671 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:08.827 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-attr. 2023-10-08T16:04:08.845 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T16:04:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T16:04:09.222 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T16:04:09.240 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T16:04:09.249 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T16:04:09.266 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T16:04:09.280 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:04:09.307 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T16:04:09.558 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T16:04:09.575 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T16:04:09.585 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T16:04:09.604 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:09.615 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T16:04:09.643 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:09.861 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T16:04:09.878 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:04:09.910 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:09.986 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T16:04:10.007 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T16:04:10.044 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:04:10.138 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T16:04:10.156 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:04:10.188 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:10.514 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T16:04:10.532 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T16:04:10.572 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T16:04:10.675 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T16:04:10.695 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:10.726 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:10.909 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T16:04:10.926 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T16:04:10.967 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T16:04:11.145 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T16:04:11.162 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T16:04:11.221 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:04:11.270 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T16:04:11.291 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T16:04:11.328 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T16:04:11.566 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T16:04:11.583 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:04:11.624 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:11.673 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T16:04:11.690 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T16:04:11.731 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:04:12.063 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-py. 2023-10-08T16:04:12.081 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T16:04:12.121 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:04:12.466 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T16:04:12.487 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T16:04:12.523 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:04:12.827 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T16:04:12.847 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T16:04:12.884 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T16:04:13.247 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T16:04:13.250 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T16:04:13.265 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T16:04:13.272 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T16:04:13.304 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:04:13.308 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T16:04:13.582 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T16:04:13.640 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:04:13.678 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T16:04:13.697 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T16:04:13.737 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:04:14.048 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-attr. 2023-10-08T16:04:14.068 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T16:04:14.106 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T16:04:14.442 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T16:04:14.461 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T16:04:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:04:14.787 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package radosgw. 2023-10-08T16:04:14.803 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T16:04:14.805 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T16:04:14.845 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:14.861 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T16:04:15.223 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T16:04:15.240 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T16:04:15.281 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:04:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T16:04:15.809 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T16:04:16.087 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T16:04:16.108 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T16:04:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T16:04:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T16:04:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T16:04:16.543 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T16:04:16.590 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T16:04:16.609 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:16.652 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:16.863 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T16:04:16.880 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T16:04:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:04:16.957 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T16:04:17.274 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-py. 2023-10-08T16:04:17.282 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:04:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T16:04:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:04:17.417 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:04:17.543 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:04:17.668 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T16:04:17.686 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T16:04:17.726 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:18.037 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T16:04:18.054 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T16:04:18.095 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user cephadm....done 2023-10-08T16:04:18.474 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T16:04:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T16:04:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:04:18.574 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:04:18.819 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T16:04:18.835 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T16:04:18.876 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:04:19.039 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T16:04:19.323 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:19.482 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T16:04:19.610 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:04:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package radosgw. 2023-10-08T16:04:19.661 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:19.960 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T16:04:20.381 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:04:20.647 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T16:04:20.948 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T16:04:21.257 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:04:21.462 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T16:04:21.479 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:04:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:21.550 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:04:21.854 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T16:04:21.876 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:22.160 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:04:22.186 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:04:22.286 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:04:22.311 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T16:04:22.445 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:04:22.596 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:04:22.639 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:22.855 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:04:23.165 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:04:23.258 INFO:teuthology.orchestra.run.smithi003.stdout:Adding system user cephadm....done 2023-10-08T16:04:23.316 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:04:23.419 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:23.545 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:04:23.711 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T16:04:23.889 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T16:04:24.005 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:04:24.181 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:04:24.307 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T16:04:24.331 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:04:24.433 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:04:24.690 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:04:24.793 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T16:04:25.008 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T16:04:25.220 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:04:25.376 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T16:04:25.505 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T16:04:25.694 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T16:04:25.781 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T16:04:26.006 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:04:26.101 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:04:26.132 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:04:26.258 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:04:26.400 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:04:26.543 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:04:26.693 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:26.961 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:04:26.994 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:04:27.120 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T16:04:27.278 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:04:27.440 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:04:27.638 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:04:27.724 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:04:27.984 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T16:04:28.008 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:04:28.143 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:04:28.143 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:28.486 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:04:28.536 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T16:04:28.621 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T16:04:28.845 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:04:28.980 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:04:29.098 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:04:29.146 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:04:29.224 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T16:04:29.533 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:04:29.534 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:04:29.827 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T16:04:29.893 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:04:30.019 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:04:30.145 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:04:30.203 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T16:04:30.495 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T16:04:30.496 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:04:30.764 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T16:04:30.830 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:04:30.955 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:04:31.065 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:04:31.081 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:04:31.213 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:04:31.391 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:04:31.501 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T16:04:31.795 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:04:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:04:32.104 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:04:32.111 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:04:32.489 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:04:32.494 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T16:04:32.781 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:04:32.866 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T16:04:32.906 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:04:32.991 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:33.233 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:04:33.328 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:04:33.479 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T16:04:33.601 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:04:33.727 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:04:33.822 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:04:33.853 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T16:04:33.948 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:04:34.099 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T16:04:34.187 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:04:34.400 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:04:34.488 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:34.614 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T16:04:34.760 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:04:34.877 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:04:35.012 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:04:35.347 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:04:35.664 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T16:04:35.974 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:04:36.099 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:04:36.145 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:36.254 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:04:36.380 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T16:04:36.434 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T16:04:36.743 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:04:36.774 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T16:04:37.091 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:04:37.094 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:04:37.401 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:04:37.486 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T16:04:37.560 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T16:04:37.764 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:04:37.890 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:04:37.894 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:38.004 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:04:38.233 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:04:38.339 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:38.465 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:04:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:04:38.727 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:04:38.808 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:04:38.878 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T16:04:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:04:39.497 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:39.656 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T16:04:39.897 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:40.022 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:04:40.148 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T16:04:40.274 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:04:40.400 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T16:04:40.712 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:04:40.821 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T16:04:41.187 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:41.216 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:41.296 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:04:41.342 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:41.422 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T16:04:41.604 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:04:41.605 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:04:41.807 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T16:04:42.069 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:42.116 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:04:42.228 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:04:42.426 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:04:42.521 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T16:04:42.551 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T16:04:42.822 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:04:42.932 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.054 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:04:43.183 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.304 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.364 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.413 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.490 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:04:43.539 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.665 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:43.816 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T16:04:43.841 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:04:44.126 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T16:04:44.419 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:44.570 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:44.696 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:44.805 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:04:44.922 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:45.073 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:04:45.198 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T16:04:45.324 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:04:45.450 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T16:04:45.734 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:45.751 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:04:45.878 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T16:04:46.273 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:46.305 INFO:teuthology.orchestra.run.smithi027.stdout:Adding group ceph....done 2023-10-08T16:04:46.432 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:46.663 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:04:46.664 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:04:46.682 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user ceph....done 2023-10-08T16:04:46.875 INFO:teuthology.orchestra.run.smithi027.stdout:Setting system user ceph properties....done 2023-10-08T16:04:46.902 INFO:teuthology.orchestra.run.smithi027.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T16:04:47.060 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T16:04:47.100 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:47.226 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:04:47.370 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T16:04:47.537 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T16:04:47.796 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:47.865 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:04:48.018 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:04:48.018 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:04:48.234 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.402 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.447 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.528 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.606 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.646 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.764 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:48.890 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T16:04:48.926 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:04:48.926 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:04:49.191 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T16:04:49.492 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:49.551 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:49.618 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:49.778 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:49.904 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:04:49.933 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T16:04:50.378 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:50.610 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:04:50.610 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:04:50.868 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:51.261 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:04:51.261 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:04:51.429 INFO:teuthology.orchestra.run.smithi003.stdout:Adding group ceph....done 2023-10-08T16:04:51.689 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:51.839 INFO:teuthology.orchestra.run.smithi003.stdout:Adding system user ceph....done 2023-10-08T16:04:52.017 INFO:teuthology.orchestra.run.smithi003.stdout:Setting system user ceph properties....done 2023-10-08T16:04:52.037 INFO:teuthology.orchestra.run.smithi003.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T16:04:52.196 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T16:04:52.208 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:04:52.209 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:04:52.528 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T16:04:52.633 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:52.750 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:52.893 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:52.979 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:53.119 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:04:53.120 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:04:53.194 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:04:53.194 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:04:53.578 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:53.656 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:53.720 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:53.781 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:53.838 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:53.997 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:54.088 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:04:54.088 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:04:54.124 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:04:54.276 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:04:54.561 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:55.115 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T16:04:55.561 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:55.790 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:04:55.790 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:04:56.213 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:56.441 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:04:56.442 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:04:56.898 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:57.404 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:04:57.404 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:04:57.497 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T16:04:57.849 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:58.008 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:58.121 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:04:58.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T16:04:58.151 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:58.193 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-08T16:04:58.382 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:04:58.382 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:04:58.401 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-08T16:04:58.402 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-08T16:04:58.610 INFO:teuthology.orchestra.run.smithi027.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T16:04:58.611 INFO:teuthology.orchestra.run.smithi027.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T16:04:58.611 INFO:teuthology.orchestra.run.smithi027.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T16:04:58.611 INFO:teuthology.orchestra.run.smithi027.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T16:04:58.611 INFO:teuthology.orchestra.run.smithi027.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T16:04:58.611 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:04:58.612 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:04:58.613 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:04:58.613 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2023-10-08T16:04:58.613 INFO:teuthology.orchestra.run.smithi027.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T16:04:58.613 INFO:teuthology.orchestra.run.smithi027.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T16:04:58.613 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T16:04:58.614 INFO:teuthology.orchestra.run.smithi027.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T16:04:58.614 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2023-10-08T16:04:58.614 INFO:teuthology.orchestra.run.smithi027.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T16:04:58.615 INFO:teuthology.orchestra.run.smithi027.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T16:04:58.662 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2023-10-08T16:04:58.662 INFO:teuthology.orchestra.run.smithi027.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T16:04:58.662 INFO:teuthology.orchestra.run.smithi027.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T16:04:58.663 INFO:teuthology.orchestra.run.smithi027.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T16:04:58.663 INFO:teuthology.orchestra.run.smithi027.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T16:04:58.664 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi027.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T16:04:58.819 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:58.847 INFO:teuthology.orchestra.run.smithi027.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T16:04:58.847 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 10.4 MB of archives. 2023-10-08T16:04:58.847 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T16:04:58.847 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T16:04:58.953 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:59.080 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:59.222 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:04:59.383 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:04:59.468 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T16:04:59.470 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T16:04:59.471 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T16:04:59.484 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T16:04:59.486 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T16:04:59.534 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:04:59.584 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T16:04:59.586 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T16:04:59.594 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T16:04:59.599 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T16:04:59.599 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T16:04:59.766 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T16:04:59.827 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:05:00.035 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T16:05:00.163 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T16:05:00.169 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T16:05:00.264 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T16:05:00.269 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T16:05:00.351 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T16:05:00.425 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T16:05:00.425 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T16:05:00.514 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T16:05:00.514 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T16:05:00.709 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T16:05:01.351 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T16:05:01.464 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T16:05:01.481 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T16:05:01.482 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T16:05:01.483 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T16:05:01.485 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T16:05:01.827 INFO:teuthology.orchestra.run.smithi027.stdout:Preconfiguring packages ... 2023-10-08T16:05:01.968 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 10.4 MB in 3s (3,707 kB/s) 2023-10-08T16:05:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:05:02.253 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:05:02.416 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:05:02.772 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T16:05:03.369 INFO:teuthology.orchestra.run.smithi003.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:05:03.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T16:05:03.445 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T16:05:03.556 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T16:05:03.655 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T16:05:03.655 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T16:05:03.861 INFO:teuthology.orchestra.run.smithi003.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T16:05:03.861 INFO:teuthology.orchestra.run.smithi003.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T16:05:03.861 INFO:teuthology.orchestra.run.smithi003.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T16:05:03.861 INFO:teuthology.orchestra.run.smithi003.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T16:05:03.861 INFO:teuthology.orchestra.run.smithi003.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T16:05:03.861 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T16:05:03.863 INFO:teuthology.orchestra.run.smithi003.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T16:05:03.864 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-10-08T16:05:03.864 INFO:teuthology.orchestra.run.smithi003.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T16:05:03.864 INFO:teuthology.orchestra.run.smithi003.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T16:05:03.912 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-10-08T16:05:03.912 INFO:teuthology.orchestra.run.smithi003.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T16:05:03.912 INFO:teuthology.orchestra.run.smithi003.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T16:05:03.913 INFO:teuthology.orchestra.run.smithi003.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T16:05:03.913 INFO:teuthology.orchestra.run.smithi003.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T16:05:03.914 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-10-08T16:05:03.915 INFO:teuthology.orchestra.run.smithi003.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T16:05:04.099 INFO:teuthology.orchestra.run.smithi003.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T16:05:04.099 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 10.4 MB of archives. 2023-10-08T16:05:04.099 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T16:05:04.099 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T16:05:04.723 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T16:05:04.725 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T16:05:04.726 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T16:05:04.738 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T16:05:04.741 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T16:05:04.839 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T16:05:04.842 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T16:05:04.849 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T16:05:04.854 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T16:05:04.855 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T16:05:04.985 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:05:04.990 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:05:05.021 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T16:05:05.121 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:05:05.294 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T16:05:05.423 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T16:05:05.427 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T16:05:05.523 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T16:05:05.528 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T16:05:05.610 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T16:05:05.684 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T16:05:05.684 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T16:05:05.773 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T16:05:05.774 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T16:05:05.907 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:05:05.968 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T16:05:06.605 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:05:06.609 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T16:05:06.723 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T16:05:06.738 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T16:05:06.740 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T16:05:06.742 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T16:05:06.744 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T16:05:06.932 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:05:07.080 INFO:teuthology.orchestra.run.smithi003.stdout:Preconfiguring packages ... 2023-10-08T16:05:07.230 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 10.4 MB in 3s (3,697 kB/s) 2023-10-08T16:05:07.391 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:05:07.395 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:05:07.520 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:05:07.556 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:05:07.561 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:05:07.716 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:05:07.959 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:05:08.134 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:05:08.614 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:05:08.747 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T16:05:08.913 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T16:05:09.267 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T16:05:09.285 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T16:05:09.326 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:05:09.679 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package dump. 2023-10-08T16:05:09.696 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T16:05:09.737 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T16:05:10.032 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package indent. 2023-10-08T16:05:10.051 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:05:10.090 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:05:10.342 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:05:10.347 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:05:10.427 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T16:05:10.444 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T16:05:10.480 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:05:10.485 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:05:10.772 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T16:05:10.791 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T16:05:10.830 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:05:11.065 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:05:11.108 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T16:05:11.125 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:05:11.191 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:11.527 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T16:05:11.547 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:11.748 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:11.804 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:05:12.498 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T16:05:12.515 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:12.548 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:12.573 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:05:12.876 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T16:05:12.896 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:12.934 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:13.033 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:05:13.038 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:05:13.171 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:05:13.295 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T16:05:13.313 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T16:05:13.353 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:05:13.643 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:05:13.656 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T16:05:13.674 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:05:13.706 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:13.767 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:05:14.093 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T16:05:14.112 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:14.151 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:14.242 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:05:14.389 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T16:05:14.504 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T16:05:14.521 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:14.562 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:14.789 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T16:05:14.809 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:05:14.849 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:05:15.035 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T16:05:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T16:05:15.093 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:05:15.393 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T16:05:15.410 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T16:05:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package dump. 2023-10-08T16:05:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T16:05:15.451 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:05:15.470 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package indent. 2023-10-08T16:05:15.804 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package modemmanager. 2023-10-08T16:05:15.816 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:05:15.821 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:15.857 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:05:15.897 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:16.194 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T16:05:16.211 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T16:05:16.269 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:05:16.493 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T16:05:16.512 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T16:05:16.551 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:05:16.580 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T16:05:16.600 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T16:05:16.638 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:05:16.908 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T16:05:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:05:16.983 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:17.107 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager. 2023-10-08T16:05:17.124 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:05:17.189 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T16:05:17.354 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:17.394 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:17.907 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T16:05:17.927 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:18.276 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T16:05:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:18.359 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:18.729 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T16:05:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T16:05:18.787 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:05:19.098 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T16:05:19.118 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:05:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:19.165 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ppp. 2023-10-08T16:05:19.184 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T16:05:19.449 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:05:19.518 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T16:05:19.537 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:19.576 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:19.820 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T16:05:19.839 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T16:05:19.878 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T16:05:19.929 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T16:05:19.946 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:19.987 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T16:05:20.240 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T16:05:20.248 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:05:20.257 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T16:05:20.289 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:05:20.316 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T16:05:20.592 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T16:05:20.612 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T16:05:20.659 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T16:05:20.826 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T16:05:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T16:05:20.884 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:05:21.038 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T16:05:21.059 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T16:05:21.107 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:05:21.221 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package modemmanager. 2023-10-08T16:05:21.238 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:05:21.281 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:21.431 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:05:21.743 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:05:21.869 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:05:21.894 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T16:05:21.910 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T16:05:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:05:21.995 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:05:22.404 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:05:22.404 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:05:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package network-manager. 2023-10-08T16:05:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:05:22.739 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:22.890 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:05:23.041 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:05:23.167 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:05:23.293 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T16:05:23.419 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:23.545 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:05:23.649 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ppp. 2023-10-08T16:05:23.668 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T16:05:23.930 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:05:24.288 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T16:05:24.306 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T16:05:24.346 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T16:05:24.682 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T16:05:24.733 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T16:05:24.750 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T16:05:24.809 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T16:05:24.926 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T16:05:25.021 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T16:05:25.060 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T16:05:25.078 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T16:05:25.086 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:25.112 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T16:05:25.212 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:05:25.363 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:05:25.464 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:05:25.524 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T16:05:25.542 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T16:05:25.593 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:05:25.607 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:05:25.716 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:25.842 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:25.918 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:05:25.968 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T16:05:26.153 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:26.279 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:26.313 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:05:26.439 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:05:26.590 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:05:26.990 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:05:26.990 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:05:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:26.996 INFO:teuthology.orchestra.run.smithi027.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T16:05:26.996 INFO:teuthology.orchestra.run.smithi027.stdout:which means they are currently configured by ifupdown: 2023-10-08T16:05:26.996 INFO:teuthology.orchestra.run.smithi027.stdout:- ens1f0 2023-10-08T16:05:26.996 INFO:teuthology.orchestra.run.smithi027.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T16:05:26.996 INFO:teuthology.orchestra.run.smithi027.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T16:05:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:27.160 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T16:05:27.476 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:05:27.482 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T16:05:27.602 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:05:27.712 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:05:27.838 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T16:05:27.997 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:28.016 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T16:05:28.123 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:05:28.490 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:28.608 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T16:05:28.751 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:28.877 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:29.003 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:29.129 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:29.209 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T16:05:29.446 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T16:05:29.541 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T16:05:29.606 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:05:29.771 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:05:29.771 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:05:29.858 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:05:30.009 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:05:30.185 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:05:30.249 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T16:05:30.311 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:30.341 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T16:05:30.421 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:30.459 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:05:30.547 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T16:05:30.611 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:30.875 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:05:30.887 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:05:31.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:31.613 INFO:teuthology.orchestra.run.smithi003.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T16:05:31.613 INFO:teuthology.orchestra.run.smithi003.stdout:which means they are currently configured by ifupdown: 2023-10-08T16:05:31.614 INFO:teuthology.orchestra.run.smithi003.stdout:- ens1f0 2023-10-08T16:05:31.614 INFO:teuthology.orchestra.run.smithi003.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T16:05:31.614 INFO:teuthology.orchestra.run.smithi003.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T16:05:31.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:31.780 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T16:05:32.623 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T16:05:33.103 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:05:33.246 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T16:05:33.430 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:05:33.556 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:34.007 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:05:34.158 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:05:34.433 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:05:34.433 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:05:34.932 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T16:05:34.944 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T16:05:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T16:05:35.045 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T16:05:35.163 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:05:35.314 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:05:35.882 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:05:35.884 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:39.527 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T16:05:39.652 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T16:05:40.487 INFO:teuthology.orchestra.run.smithi003.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:05:40.490 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:40.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:05:40.711 DEBUG:teuthology.orchestra.run.smithi003:> dpkg-query -W -f '${Version}' ceph 2023-10-08T16:05:40.735 INFO:teuthology.orchestra.run.smithi003.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T16:05:40.735 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:05:40.736 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T16:05:40.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:05:40.960 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-query -W -f '${Version}' ceph 2023-10-08T16:05:40.985 INFO:teuthology.orchestra.run.smithi027.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T16:05:40.986 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:05:40.986 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T16:05:40.986 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T16:05:40.986 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:40.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:05:41.003 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:41.003 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:05:41.017 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T16:05:41.017 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:41.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:05:41.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:05:41.046 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:41.046 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:05:41.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:05:41.089 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T16:05:41.090 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:41.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:05:41.105 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:05:41.159 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:41.159 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:05:41.175 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:05:41.235 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T16:05:41.236 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:41.236 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:05:41.252 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:05:41.261 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:41.261 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:05:41.275 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:05:41.286 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T16:05:41.352 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T16:05:41.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2023-10-08T16:05:41.355 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2023-10-08T16:05:41.370 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T16:05:41.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:05:41.411 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:05:41.428 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T16:05:41.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:05:41.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:05:41.450 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T16:05:41.450 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T16:05:41.450 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T16:05:41.451 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:41.451 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:05:41.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:41.537 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:41.537 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:05:41.543 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:41.587 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T16:05:41.587 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T16:05:41.587 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits}', 'email': None, 'first_in_suite': False, 'job_id': '7418289', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006', 'targets': {'smithi003.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_limits']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-08_15:41:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T16:05:41.588 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:05:41.590 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:05:41.597 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:05:41.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:05:41.616 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:41.616 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:05:41.664 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:05:41.664 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2023-10-08T16:05:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:05:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:41.671 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-10-08T16:05:41.671 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:41.671 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 16:00:39.899066645 +0000 2023-10-08T16:05:41.672 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 16:00:39.631072812 +0000 2023-10-08T16:05:41.672 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 16:00:39.631072812 +0000 2023-10-08T16:05:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T16:05:41.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:05:41.683 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T16:05:41.684 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T16:05:41.684 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.00041635 s, 1.2 MB/s 2023-10-08T16:05:41.685 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:05:41.693 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2023-10-08T16:05:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:05:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:41.699 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 368 Links: 1 2023-10-08T16:05:41.699 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:41.700 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 16:00:40.423054587 +0000 2023-10-08T16:05:41.700 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 16:00:40.151060845 +0000 2023-10-08T16:05:41.700 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 16:00:40.151060845 +0000 2023-10-08T16:05:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T16:05:41.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:05:41.756 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T16:05:41.756 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T16:05:41.756 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000368485 s, 1.4 MB/s 2023-10-08T16:05:41.757 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:05:41.764 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2023-10-08T16:05:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:05:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:41.770 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-10-08T16:05:41.770 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:41.770 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 16:00:40.635049708 +0000 2023-10-08T16:05:41.770 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 16:00:40.631049800 +0000 2023-10-08T16:05:41.771 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 16:00:40.631049800 +0000 2023-10-08T16:05:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T16:05:41.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:05:41.827 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T16:05:41.827 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T16:05:41.827 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.00039216 s, 1.3 MB/s 2023-10-08T16:05:41.828 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:05:41.836 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2023-10-08T16:05:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:05:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:41.841 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-08T16:05:41.841 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:41.841 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 16:00:41.159037649 +0000 2023-10-08T16:05:41.842 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 16:00:41.155037742 +0000 2023-10-08T16:05:41.842 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 16:00:41.155037742 +0000 2023-10-08T16:05:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T16:05:41.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:05:41.854 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T16:05:41.854 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T16:05:41.854 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000341316 s, 1.5 MB/s 2023-10-08T16:05:41.855 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:05:41.906 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:41.906 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:41.906 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:05:41.915 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:05:41.915 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2023-10-08T16:05:41.963 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:05:41.963 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:41.963 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-10-08T16:05:41.963 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:41.963 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-08 16:00:39.031146038 +0000 2023-10-08T16:05:41.964 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-08 16:00:38.743152679 +0000 2023-10-08T16:05:41.964 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-08 16:00:38.743152679 +0000 2023-10-08T16:05:41.964 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-08T16:05:41.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:05:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-08T16:05:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-08T16:05:41.977 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000392495 s, 1.3 MB/s 2023-10-08T16:05:41.977 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:05:41.986 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2023-10-08T16:05:41.993 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-08 16:00:39.531134507 +0000 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-08 16:00:39.259140780 +0000 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-08 16:00:39.259140780 +0000 2023-10-08T16:05:41.994 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-08T16:05:41.995 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:05:42.055 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-08T16:05:42.055 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-08T16:05:42.055 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000395749 s, 1.3 MB/s 2023-10-08T16:05:42.056 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:05:42.065 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-08 16:00:40.043122700 +0000 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-08 16:00:39.771128973 +0000 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-08 16:00:39.771128973 +0000 2023-10-08T16:05:42.071 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-08T16:05:42.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:05:42.127 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-08T16:05:42.127 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-08T16:05:42.127 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000399331 s, 1.3 MB/s 2023-10-08T16:05:42.128 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:05:42.136 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2023-10-08T16:05:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:05:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:05:42.143 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-10-08T16:05:42.143 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:05:42.143 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-08 16:00:40.247117995 +0000 2023-10-08T16:05:42.143 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-08 16:00:40.243118087 +0000 2023-10-08T16:05:42.143 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-08 16:00:40.243118087 +0000 2023-10-08T16:05:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-08T16:05:42.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:05:42.203 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-08T16:05:42.203 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-08T16:05:42.203 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000420925 s, 1.2 MB/s 2023-10-08T16:05:42.204 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:05:42.212 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:42.212 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:05:42.212 INFO:tasks.ceph:Generating config... 2023-10-08T16:05:42.213 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T16:05:42.214 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T16:05:42.214 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T16:05:42.214 INFO:tasks.ceph:[client] pid file = 2023-10-08T16:05:42.214 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T16:05:42.214 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T16:05:42.214 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T16:05:42.214 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T16:05:42.214 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T16:05:42.214 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T16:05:42.214 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T16:05:42.215 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T16:05:42.215 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T16:05:42.215 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T16:05:42.216 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T16:05:42.217 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T16:05:42.217 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T16:05:42.217 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T16:05:42.217 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T16:05:42.252 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T16:05:42.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T16:05:42.284 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:05:42.293 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3'), ('mon.b', '172.21.15.27'), ('mon.c', '[v2:172.21.15.27:3301,v1:172.21.15.27:6790]')] 2023-10-08T16:05:42.294 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3,172.21.15.27,[v2:172.21.15.27:3301,v1:172.21.15.27:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T16:05:42.294 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:42.295 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:05:42.343 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --add b 172.21.15.27 --addv c '[v2:172.21.15.27:3301,v1:172.21.15.27:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:42.382 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:42.382 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid 3007c8b5-937d-4f26-8e83-7370fb7a9cb4 2023-10-08T16:05:42.382 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = octopus 2023-10-08T16:05:42.382 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 3007c8b5-937d-4f26-8e83-7370fb7a9cb4 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2023-10-08T16:05:42.381354+0000 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:created 2023-10-08T16:05:42.381354+0000 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 15 (octopus) 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:1: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:2: [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] mon.c 2023-10-08T16:05:42.383 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T16:05:42.384 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:05:42.388 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3007c8b5-937d-4f26-8e83-7370fb7a9cb4... 2023-10-08T16:05:42.390 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:05:42.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.421 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.422 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2023-10-08T16:05:42.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "172.21.15.3,172.21.15.27,[v2:172.21.15.27:3301,v1:172.21.15.27:6790]" 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 3007c8b5-937d-4f26-8e83-7370fb7a9cb4 2023-10-08T16:05:42.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2023-10-08T16:05:42.425 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.426 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: bdev async discard = True 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: bdev enable discard = True 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore allocator = bitmap 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 1/20 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 1/20 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T16:05:42.427 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 4/10 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2023-10-08T16:05:42.428 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-10-08T16:05:42.429 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:05:42.430 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: mon op complaint time = 120 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2023-10-08T16:05:42.431 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: client mount timeout = 600 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: debug client = 20 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = "" 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2023-10-08T16:05:42.432 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c] 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d] 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout:[mds] 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: debug mds = 20 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug frag = True 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug scatterstat = True 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: mds op complaint time = 180 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: mds verify scatter = True 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-10-08T16:05:42.433 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-10-08T16:05:42.434 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-10-08T16:05:42.434 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2023-10-08T16:05:42.434 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2023-10-08T16:05:42.434 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2023-10-08T16:05:42.435 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2023-10-08T16:05:42.436 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2023-10-08T16:05:42.437 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.3,172.21.15.27,[v2:172.21.15.27:3301,v1:172.21.15.27:6790]" 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 3007c8b5-937d-4f26-8e83-7370fb7a9cb4 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2023-10-08T16:05:42.438 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.439 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.440 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: bdev async discard = True 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: bdev enable discard = True 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore allocator = bitmap 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2023-10-08T16:05:42.441 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-10-08T16:05:42.442 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:05:42.443 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2023-10-08T16:05:42.444 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2023-10-08T16:05:42.445 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = "" 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2023-10-08T16:05:42.446 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-10-08T16:05:42.447 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-10-08T16:05:42.448 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T16:05:42.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T16:05:42.540 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T16:05:42.540 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:42.540 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T16:05:42.546 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:42.546 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T16:05:42.553 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:05:42.553 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:42.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:05:42.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:05:42.579 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:05:42.579 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:42.586 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:05:42.586 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:42.586 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:05:42.586 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:05:42.613 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:05:42.613 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:42.620 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T16:05:42.620 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T16:05:42.620 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:05:42.676 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:05:42.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:05:42.725 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:05:42.727 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T16:05:42.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:05:42.773 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:05:42.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T16:05:42.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T16:05:42.824 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T16:05:42.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T16:05:42.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:05:42.882 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:05:42.885 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T16:05:42.895 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T16:05:42.936 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T16:05:42.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T16:05:42.997 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T16:05:42.997 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T16:05:43.035 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T16:05:43.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T16:05:43.080 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T16:05:43.092 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T16:05:43.130 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T16:05:43.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T16:05:43.176 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T16:05:43.188 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T16:05:43.188 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:05:43.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T16:05:43.204 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:43.204 INFO:tasks.ceph:role: osd.0 2023-10-08T16:05:43.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:05:43.205 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:05:43.759 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:05:43.760 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:05:43.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T16:05:43.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T16:05:43.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T16:05:43.861 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:05:43.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:43.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T16:05:43.873 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:43.873 INFO:tasks.ceph:role: osd.1 2023-10-08T16:05:43.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:05:43.873 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:05:44.371 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:05:44.372 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:05:44.373 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T16:05:44.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T16:05:44.458 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T16:05:44.469 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:05:44.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:44.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T16:05:44.482 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:44.482 INFO:tasks.ceph:role: osd.2 2023-10-08T16:05:44.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:05:44.482 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:05:44.997 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:05:44.997 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:05:44.997 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:05:44.997 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T16:05:44.997 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:05:44.998 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:05:44.998 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:05:44.998 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:05:44.998 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:05:44.998 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:05:44.999 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T16:05:44.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T16:05:45.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T16:05:45.062 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:05:45.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:45.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T16:05:45.073 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:45.074 INFO:tasks.ceph:role: osd.3 2023-10-08T16:05:45.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:05:45.074 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:05:45.578 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:05:45.578 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:05:45.578 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:05:45.578 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T16:05:45.578 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:05:45.578 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:05:45.579 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:05:45.579 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:05:45.579 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:05:45.579 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:05:45.580 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T16:05:45.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T16:05:45.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T16:05:45.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:05:45.655 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:45.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:45.714+0000 7fd1ce91b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T16:05:45.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:45.714+0000 7fd1ce91b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T16:05:45.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:45.714+0000 7fd1ce91b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:05:45.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:45.714+0000 7fd1ce91b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:05:45.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:45.714+0000 7fd1ce91b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:05:45.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:45.718+0000 7fd1ce91b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T16:05:46.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:46.526+0000 7fd1ce91b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:47.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:47.315+0000 7fd1ce91b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:48.095+0000 7fd1ce91b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:48.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T16:05:48.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.015+0000 7f1488ef83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T16:05:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.015+0000 7f1488ef83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T16:05:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.015+0000 7f1488ef83c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:05:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.015+0000 7f1488ef83c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:05:49.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.015+0000 7f1488ef83c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:05:49.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.015+0000 7f1488ef83c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T16:05:49.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:49.579+0000 7f1488ef83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:50.363+0000 7f1488ef83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:51.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:51.143+0000 7f1488ef83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:52.015 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T16:05:52.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:52.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.067+0000 7f90f55bf3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T16:05:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.067+0000 7f90f55bf3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T16:05:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.067+0000 7f90f55bf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:05:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.067+0000 7f90f55bf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:05:52.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.067+0000 7f90f55bf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:05:52.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.067+0000 7f90f55bf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T16:05:52.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:52.627+0000 7f90f55bf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:53.411+0000 7f90f55bf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:54.191+0000 7f90f55bf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:55.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T16:05:55.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:05:55.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.159+0000 7f2cee7643c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T16:05:55.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.159+0000 7f2cee7643c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T16:05:55.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.159+0000 7f2cee7643c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:05:55.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.159+0000 7f2cee7643c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:05:55.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.159+0000 7f2cee7643c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:05:55.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.159+0000 7f2cee7643c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T16:05:55.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:55.735+0000 7f2cee7643c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:56.519+0000 7f2cee7643c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:57.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:05:57.299+0000 7f2cee7643c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:05:58.181 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T16:05:58.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T16:05:58.214 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:58.215 INFO:tasks.ceph:role: osd.4 2023-10-08T16:05:58.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:05:58.215 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:05:58.788 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:05:58.789 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:05:58.789 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:05:58.789 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:05:58.790 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-08T16:05:58.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T16:05:58.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T16:05:58.899 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:05:58.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:58.900 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T16:05:58.910 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:58.910 INFO:tasks.ceph:role: osd.5 2023-10-08T16:05:58.910 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:05:58.910 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:05:59.462 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:05:59.462 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:05:59.462 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:05:59.463 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:05:59.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-08T16:05:59.465 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T16:05:59.497 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T16:05:59.506 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:05:59.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:59.507 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T16:05:59.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:05:59.518 INFO:tasks.ceph:role: osd.6 2023-10-08T16:05:59.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:05:59.518 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:06:00.040 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:06:00.040 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:06:00.040 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:06:00.040 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-08T16:06:00.041 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:06:00.041 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:06:00.041 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:06:00.041 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:06:00.041 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:06:00.041 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:06:00.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-08T16:06:00.042 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T16:06:00.107 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T16:06:00.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:06:00.119 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:06:00.119 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T16:06:00.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:06:00.134 INFO:tasks.ceph:role: osd.7 2023-10-08T16:06:00.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:06:00.134 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:06:00.657 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:06:00.658 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:06:00.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-08T16:06:00.660 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T16:06:00.720 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T16:06:00.732 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:06:00.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:06:00.733 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:06:00.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:00.843+0000 7fe2ab6ac3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T16:06:00.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:00.847+0000 7fe2ab6ac3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T16:06:00.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:00.847+0000 7fe2ab6ac3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:06:00.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:00.847+0000 7fe2ab6ac3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:06:00.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:00.847+0000 7fe2ab6ac3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:06:00.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:00.855+0000 7fe2ab6ac3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T16:06:01.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:01.671+0000 7fe2ab6ac3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:02.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:02.455+0000 7fe2ab6ac3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:03.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:03.243+0000 7fe2ab6ac3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:04.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T16:06:04.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:06:04.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.159+0000 7f2d019c43c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T16:06:04.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.163+0000 7f2d019c43c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T16:06:04.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.163+0000 7f2d019c43c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:06:04.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.163+0000 7f2d019c43c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:06:04.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.163+0000 7f2d019c43c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:06:04.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.163+0000 7f2d019c43c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T16:06:04.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:04.727+0000 7f2d019c43c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:05.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:05.511+0000 7f2d019c43c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:06.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:06.291+0000 7f2d019c43c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:07.157 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T16:06:07.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:06:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.203+0000 7f0b99efd3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T16:06:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.203+0000 7f0b99efd3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T16:06:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.207+0000 7f0b99efd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:06:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.207+0000 7f0b99efd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:06:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.207+0000 7f0b99efd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:06:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.207+0000 7f0b99efd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T16:06:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:07.767+0000 7f0b99efd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:08.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:08.547+0000 7f0b99efd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:09.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:09.327+0000 7f0b99efd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:10.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T16:06:10.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:06:10.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.287+0000 7f4c7db9d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T16:06:10.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.287+0000 7f4c7db9d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T16:06:10.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.287+0000 7f4c7db9d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:06:10.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.287+0000 7f4c7db9d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:06:10.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.287+0000 7f4c7db9d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:06:10.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.291+0000 7f4c7db9d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T16:06:10.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:10.867+0000 7f4c7db9d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:11.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:11.592 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:11.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:11.663+0000 7f4c7db9d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:12.451+0000 7f4c7db9d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:06:13.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T16:06:13.339 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T16:06:13.340 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T16:06:13.356 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T16:06:13.367 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T16:06:13.378 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T16:06:13.436 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T16:06:13.452 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T16:06:13.463 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T16:06:13.518 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.518 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T16:06:13.534 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.534 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T16:06:13.549 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.549 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T16:06:13.606 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.606 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T16:06:13.616 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T16:06:13.626 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.626 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T16:06:13.640 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.640 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T16:06:13.700 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.700 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T16:06:13.707 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:13.707 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T16:06:13.714 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.714 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T16:06:13.721 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:13.721 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T16:06:13.771 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T16:06:13.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:06:13.773 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.y] 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBW0yJl7/U/KBAAQmD+MsjUF24AqK2YG+MMMg== 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBW0yJl1/8ILhAAyKLwO7/Ctogmlzw9Nlh2EQ== 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBW0yJlP70ZMRAAh+ahn+CKXBXJJV57hLmsbg== 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBZ0yJlgfzEKhAAwDxiw16aqOzNkcJbCI4ncQ== 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2023-10-08T16:06:13.784 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBd0yJlPl4WARAAhXD6n5SOm0mEbZzn4cToYw== 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBg0yJlNSseBBAA/Xzx+O6bgrc4W0BhSzhumw== 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBj0yJlskmsCRAAOmjrOSwgaxuwXWy93JU8OQ== 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBW0yJltBo5KxAAiIBcjJ0B063R9P6Xu6cOHQ== 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBW0yJlCvCjNBAAfhsbLyOg/EVp1XW4Jr9LJQ== 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBW0yJl9Z7hNxAAcAN+TJ5pxlpl9HjSannwCA== 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.4] 2023-10-08T16:06:13.785 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBo0yJl/HqaMhAAHDfaHSmtumyI9YZILWACkw== 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.5] 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBs0yJlsxHeCRAA00mNdz2Cs7DmNX6QTIDZZA== 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.6] 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBv0yJlRzR5DBAASd+vxCwHW4+cqcY7han+6g== 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.7] 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBy0yJlwAt6ERAAy9CTIOqeZgW7mx0SPn6w4g== 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBX0yJlZDIHAhAAzDCJhj1kSsHWF6uzqAZX+A== 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:[client.2] 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBX0yJlOeq5BBAAHe7rJQfMMjJdT9T25nAvXQ== 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:[client.1] 2023-10-08T16:06:13.786 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBX0yJlI3TABxAA3Q9fhC7mcsEG6gTgZf++7g== 2023-10-08T16:06:13.787 INFO:teuthology.orchestra.run.smithi027.stdout:[client.3] 2023-10-08T16:06:13.787 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBX0yJlGXuSChAA8kVCX/d1wfYqXJmwS2nfUA== 2023-10-08T16:06:13.788 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2023-10-08T16:06:13.788 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBW0yJl7/U/KBAAQmD+MsjUF24AqK2YG+MMMg== 2023-10-08T16:06:13.788 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-10-08T16:06:13.788 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBW0yJl1/8ILhAAyKLwO7/Ctogmlzw9Nlh2EQ== 2023-10-08T16:06:13.788 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c] 2023-10-08T16:06:13.788 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBW0yJlP70ZMRAAh+ahn+CKXBXJJV57hLmsbg== 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBZ0yJlgfzEKhAAwDxiw16aqOzNkcJbCI4ncQ== 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBd0yJlPl4WARAAhXD6n5SOm0mEbZzn4cToYw== 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBg0yJlNSseBBAA/Xzx+O6bgrc4W0BhSzhumw== 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBj0yJlskmsCRAAOmjrOSwgaxuwXWy93JU8OQ== 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBW0yJltBo5KxAAiIBcjJ0B063R9P6Xu6cOHQ== 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-10-08T16:06:13.789 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBW0yJlCvCjNBAAfhsbLyOg/EVp1XW4Jr9LJQ== 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d] 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBW0yJl9Z7hNxAAcAN+TJ5pxlpl9HjSannwCA== 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBo0yJl/HqaMhAAHDfaHSmtumyI9YZILWACkw== 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBs0yJlsxHeCRAA00mNdz2Cs7DmNX6QTIDZZA== 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBv0yJlRzR5DBAASd+vxCwHW4+cqcY7han+6g== 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBy0yJlwAt6ERAAy9CTIOqeZgW7mx0SPn6w4g== 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2023-10-08T16:06:13.790 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBX0yJlZDIHAhAAzDCJhj1kSsHWF6uzqAZX+A== 2023-10-08T16:06:13.791 INFO:teuthology.orchestra.run.smithi003.stdout:[client.2] 2023-10-08T16:06:13.791 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBX0yJlOeq5BBAAHe7rJQfMMjJdT9T25nAvXQ== 2023-10-08T16:06:13.791 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2023-10-08T16:06:13.791 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBX0yJlI3TABxAA3Q9fhC7mcsEG6gTgZf++7g== 2023-10-08T16:06:13.791 INFO:teuthology.orchestra.run.smithi003.stdout:[client.3] 2023-10-08T16:06:13.791 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBX0yJlGXuSChAA8kVCX/d1wfYqXJmwS2nfUA== 2023-10-08T16:06:13.791 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:06:13.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:06:13.876 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:13.879 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:13.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:13.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:14.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.064 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.066 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.202 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:06:14.245 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:06:14.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:14.333 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:14.382 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:14.384 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:06:14.431 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.433 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.478 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.520 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.609 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:06:14.655 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.657 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.744 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.791 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.793 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:06:14.884 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T16:06:14.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T16:06:14.898 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:06:14.952 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T16:06:14.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T16:06:14.980 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:06:15.032 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T16:06:15.045 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T16:06:15.058 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:06:15.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T16:06:15.129 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:06:15.131 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:06:15.136 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T16:06:15.137 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T16:06:15.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T16:06:15.139 INFO:tasks.ceph.mon.a:Started 2023-10-08T16:06:15.139 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T16:06:15.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T16:06:15.182 INFO:tasks.ceph.mon.b:Started 2023-10-08T16:06:15.182 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T16:06:15.182 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T16:06:15.184 INFO:tasks.ceph.mon.c:Started 2023-10-08T16:06:15.184 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T16:06:15.185 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T16:06:15.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T16:06:15.187 INFO:tasks.ceph.mgr.y:Started 2023-10-08T16:06:15.187 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T16:06:15.187 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T16:06:15.189 INFO:tasks.ceph.mgr.x:Started 2023-10-08T16:06:15.189 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T16:06:15.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T16:06:15.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 Processor -- start 2023-10-08T16:06:15.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 -- start start 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b4140 con 0x7f458006db60 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b45a0 con 0x7f45800b37c0 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458006a3a0 con 0x7f4580158c80 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33668/0 (socket says 172.21.15.3:33668) 2023-10-08T16:06:15.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 learned_addr learned my addr 172.21.15.3:0/3719717169 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457f7fe700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 msgr2=0x7f45800b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457f7fe700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 msgr2=0x7f45800b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 msgr2=0x7f458006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 msgr2=0x7f458006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457effd700 1 -- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 msgr2=0x7f458015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457effd700 1 -- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 msgr2=0x7f458015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:06:15.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:06:15.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:06:15.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:06:15.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.283+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:06:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457effd700 1 -- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 msgr2=0x7f458015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:06:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457effd700 1 -- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 msgr2=0x7f458015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457f7fe700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 msgr2=0x7f45800b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457f7fe700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 msgr2=0x7f45800b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 msgr2=0x7f458006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 msgr2=0x7f458006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:06:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.487+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:06:15.708 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:15.703+0000 7f8a4de73000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:06:15.715 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:15.711+0000 7fa47138b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:06:15.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.3:3300/0 conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457f7fe700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457effd700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 msgr2=0x7f458015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 msgr2=0x7f45800b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 -- 172.21.15.3:0/3719717169 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458006a680 con 0x7f458006db60 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457e7fc700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f458006db60 0x7f458006b440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45800b2990 tx=0x7f4574008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635adb98b6a431bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457dffb700 1 -- 172.21.15.3:0/3719717169 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574010710 con 0x7f458006db60 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457dffb700 1 -- 172.21.15.3:0/3719717169 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457400c050 con 0x7f458006db60 2023-10-08T16:06:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457dffb700 1 -- 172.21.15.3:0/3719717169 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574010ae0 con 0x7f458006db60 2023-10-08T16:06:15.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 -- 172.21.15.3:0/3719717169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f458006db60 msgr2=0x7f458006b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f458006db60 0x7f458006b440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45800b2990 tx=0x7f4574008040 comp rx=0 tx=0).stop 2023-10-08T16:06:15.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 -- 172.21.15.3:0/3719717169 shutdown_connections 2023-10-08T16:06:15.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 --2- 172.21.15.3:0/3719717169 >> v2:172.21.15.27:3300/0 conn(0x7f45800b37c0 0x7f45800b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f458006db60 0x7f458006b440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 --2- 172.21.15.3:0/3719717169 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4580158c80 0x7f458015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 -- 172.21.15.3:0/3719717169 >> 172.21.15.3:0/3719717169 conn(0x7f45800d0820 msgr2=0x7f45800b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 -- 172.21.15.3:0/3719717169 shutdown_connections 2023-10-08T16:06:15.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.891+0000 7f457ffff700 1 -- 172.21.15.3:0/3719717169 wait complete. 2023-10-08T16:06:15.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 Processor -- start 2023-10-08T16:06:15.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 -- start start 2023-10-08T16:06:15.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f458006db60 0x7f45800ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 0x7f45801474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4580158c80 0x7f45801479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c7760 con 0x7f45800b37c0 2023-10-08T16:06:15.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c6e70 con 0x7f4580158c80 2023-10-08T16:06:15.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c7110 con 0x7f458006db60 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 0x7f45801474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 0x7f45801474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33712/0 (socket says 172.21.15.3:33712) 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 -- 172.21.15.3:0/2624880796 learned_addr learned my addr 172.21.15.3:0/2624880796 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457effd700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f458006db60 0x7f45800ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457f7fe700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4580158c80 0x7f45801479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 -- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f458006db60 msgr2=0x7f45800ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f458006db60 0x7f45800ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 -- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4580158c80 msgr2=0x7f45801479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4580158c80 0x7f45801479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 -- 172.21.15.3:0/2624880796 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457400e5d0 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457f7fe700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4580158c80 0x7f45801479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457e7fc700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 0x7f45801474a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4574006fd0 tx=0x7f457401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574015700 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4574015860 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45800c73f0 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574015c20 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45800cec60 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4574032440 con 0x7f45800b37c0 2023-10-08T16:06:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.895+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4574029790 con 0x7f45800b37c0 2023-10-08T16:06:15.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.899+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45800c7580 con 0x7f45800b37c0 2023-10-08T16:06:15.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.903+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f457401a030 con 0x7f45800b37c0 2023-10-08T16:06:15.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.975+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f45800cee50 con 0x7f45800b37c0 2023-10-08T16:06:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f4566ffd700 1 -- 172.21.15.3:0/2624880796 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f457400f040 con 0x7f45800b37c0 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 msgr2=0x7f45801474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 0x7f45801474a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4574006fd0 tx=0x7f457401c000 comp rx=0 tx=0).stop 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 shutdown_connections 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4580158c80 0x7f45801479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45800b37c0 0x7f45801474a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 --2- 172.21.15.3:0/2624880796 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f458006db60 0x7f45800ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 >> 172.21.15.3:0/2624880796 conn(0x7f45800d0820 msgr2=0x7f45800cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 shutdown_connections 2023-10-08T16:06:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:15.979+0000 7f457ffff700 1 -- 172.21.15.3:0/2624880796 wait complete. 2023-10-08T16:06:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2023-10-08T16:06:15.995 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T16:06:15.996 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:15.996 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T16:06:16.008 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:16.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T16:06:16.017 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:16.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T16:06:16.031 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T16:06:16.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T16:06:16.044 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:16.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T16:06:16.059 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:16.060 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T16:06:16.070 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:16.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T16:06:16.125 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-08T16:06:16.125 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T16:06:16.135 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new 141cc8f2-f2bc-485b-9209-0d8bb852fb14 0 2023-10-08T16:06:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.254+0000 7f8e0e779700 1 Processor -- start 2023-10-08T16:06:16.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.254+0000 7f8e0e779700 1 -- start start 2023-10-08T16:06:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 0x7f8e08160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8e0815d540 0x7f8e080c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080caf60 con 0x7f8e0815d170 2023-10-08T16:06:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e08161dc0 con 0x7f8e0815d540 2023-10-08T16:06:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080cac30 con 0x7f8e080bfe50 2023-10-08T16:06:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 0x7f8e08160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0df78700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8e0815d540 0x7f8e080c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 0x7f8e08160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34880/0 (socket says 172.21.15.27:34880) 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 -- 172.21.15.27:0/2808866831 learned_addr learned my addr 172.21.15.27:0/2808866831 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 -- 172.21.15.27:0/2808866831 >> v2:172.21.15.27:3300/0 conn(0x7f8e0815d540 msgr2=0x7f8e080c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 --2- 172.21.15.27:0/2808866831 >> v2:172.21.15.27:3300/0 conn(0x7f8e0815d540 0x7f8e080c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 -- 172.21.15.27:0/2808866831 >> v1:172.21.15.3:6789/0 conn(0x7f8e0815d170 legacy=0x7f8e080ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 -- 172.21.15.27:0/2808866831 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08161800 con 0x7f8e080bfe50 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0cf76700 1 --2- 172.21.15.27:0/2808866831 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 0x7f8e08160eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0099b0 tx=0x7f8dfc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dfbf99c7bbf73d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8dfbfff700 1 -- 172.21.15.27:0/2808866831 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009ea0 con 0x7f8e080bfe50 2023-10-08T16:06:16.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8dfbfff700 1 -- 172.21.15.27:0/2808866831 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc00b860 con 0x7f8e080bfe50 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8dfbfff700 1 -- 172.21.15.27:0/2808866831 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00bc00 con 0x7f8e080bfe50 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- 172.21.15.27:0/2808866831 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 msgr2=0x7f8e08160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 --2- 172.21.15.27:0/2808866831 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 0x7f8e08160eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0099b0 tx=0x7f8dfc009250 comp rx=0 tx=0).stop 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- 172.21.15.27:0/2808866831 shutdown_connections 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 --2- 172.21.15.27:0/2808866831 >> v2:172.21.15.27:3300/0 conn(0x7f8e0815d540 0x7f8e080c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 --2- 172.21.15.27:0/2808866831 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e080bfe50 0x7f8e08160eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- 172.21.15.27:0/2808866831 >> 172.21.15.27:0/2808866831 conn(0x7f8e0806b4f0 msgr2=0x7f8e0806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- 172.21.15.27:0/2808866831 shutdown_connections 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.258+0000 7f8e0e779700 1 -- 172.21.15.27:0/2808866831 wait complete. 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 Processor -- start 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 -- start start 2023-10-08T16:06:16.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 0x7f8e080c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 0x7f8e080b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0815d540 0x7f8e0815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080af800 con 0x7f8e0815d540 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c30a0 con 0x7f8e080bfe50 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080b1be0 con 0x7f8e0815d170 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 0x7f8e080c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0cf76700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 0x7f8e080b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0cf76700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 0x7f8e080b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34888/0 (socket says 172.21.15.27:34888) 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 0x7f8e080c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45670/0 (socket says 172.21.15.27:45670) 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0cf76700 1 -- 172.21.15.27:0/3821934991 learned_addr learned my addr 172.21.15.27:0/3821934991 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0df78700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0815d540 0x7f8e0815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 -- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 msgr2=0x7f8e080b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 0x7f8e080b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 -- 172.21.15.27:0/3821934991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0815d540 msgr2=0x7f8e0815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0815d540 0x7f8e0815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 -- 172.21.15.27:0/3821934991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0094f0 con 0x7f8e080bfe50 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0cf76700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 0x7f8e080b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0d777700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 0x7f8e080c2b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c590 tx=0x7f8e04007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400ce80 con 0x7f8e080bfe50 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04011590 con 0x7f8e080bfe50 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04011950 con 0x7f8e080bfe50 2023-10-08T16:06:16.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e080b0340 con 0x7f8e080bfe50 2023-10-08T16:06:16.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e080affd0 con 0x7f8e080bfe50 2023-10-08T16:06:16.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8e04012420 con 0x7f8e080bfe50 2023-10-08T16:06:16.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.262+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8e04012a20 con 0x7f8e080bfe50 2023-10-08T16:06:16.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.270+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e08163fe0 con 0x7f8e080bfe50 2023-10-08T16:06:16.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.270+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8e08163fe0 con 0x7f8e080bfe50 2023-10-08T16:06:16.328 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:16.326+0000 7f8a4de73000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:06:16.344 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:16.339+0000 7fa47138b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:06:16.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.350+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "141cc8f2-f2bc-485b-9209-0d8bb852fb14", "id": 0} v 0) v1 -- 0x7f8e080afb20 con 0x7f8e080bfe50 2023-10-08T16:06:16.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8df97fa700 1 -- 172.21.15.27:0/3821934991 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "141cc8f2-f2bc-485b-9209-0d8bb852fb14", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e04021060 con 0x7f8e080bfe50 2023-10-08T16:06:16.363 INFO:teuthology.orchestra.run.smithi027.stdout:0 2023-10-08T16:06:16.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 msgr2=0x7f8e080c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 0x7f8e080c2b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c590 tx=0x7f8e04007ec0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 shutdown_connections 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0815d540 0x7f8e0815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e0815d170 0x7f8e080b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 --2- 172.21.15.27:0/3821934991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e080bfe50 0x7f8e080c2b60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 >> 172.21.15.27:0/3821934991 conn(0x7f8e0806b4f0 msgr2=0x7f8e081638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 shutdown_connections 2023-10-08T16:06:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.358+0000 7f8e0e779700 1 -- 172.21.15.27:0/3821934991 wait complete. 2023-10-08T16:06:16.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new 2cb792db-0837-4f4d-b645-12d5f3fc5afa 1 2023-10-08T16:06:16.389 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:16.386+0000 7f8a4de73000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:06:16.404 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:16.399+0000 7fa47138b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:06:16.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 Processor -- start 2023-10-08T16:06:16.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 -- start start 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff0e4068910 0x7ff0e40ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0e4139e70 0x7ff0e40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e40cb6b0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40cb990 con 0x7ff0e4068910 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e9eb0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40cbc70 con 0x7ff0e4139e70 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0e4139e70 0x7ff0e40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0e4139e70 0x7ff0e40cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45678/0 (socket says 172.21.15.27:45678) 2023-10-08T16:06:16.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 -- 172.21.15.27:0/3857762737 learned_addr learned my addr 172.21.15.27:0/3857762737 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e3fff700 1 --2- 172.21.15.27:0/3857762737 >> v2:172.21.15.3:3300/0 conn(0x7ff0e4068910 0x7ff0e40ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 -- 172.21.15.27:0/3857762737 >> v2:172.21.15.3:3300/0 conn(0x7ff0e4068910 msgr2=0x7ff0e40ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 --2- 172.21.15.27:0/3857762737 >> v2:172.21.15.3:3300/0 conn(0x7ff0e4068910 0x7ff0e40ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 -- 172.21.15.27:0/3857762737 >> v1:172.21.15.3:6789/0 conn(0x7ff0e4139aa0 legacy=0x7ff0e4068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 -- 172.21.15.27:0/3857762737 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4158470 con 0x7ff0e4139e70 2023-10-08T16:06:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e96af700 1 --2- 172.21.15.27:0/3857762737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139e70 0x7ff0e40cae70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4068db0 tx=0x7ff0dc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=654bbf360abf97c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e37fe700 1 -- 172.21.15.27:0/3857762737 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00e070 con 0x7ff0e4139e70 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e37fe700 1 -- 172.21.15.27:0/3857762737 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc00ba20 con 0x7ff0e4139e70 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.478+0000 7ff0e37fe700 1 -- 172.21.15.27:0/3857762737 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0092e0 con 0x7ff0e4139e70 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/3857762737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139e70 msgr2=0x7ff0e40cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/3857762737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139e70 0x7ff0e40cae70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4068db0 tx=0x7ff0dc009840 comp rx=0 tx=0).stop 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/3857762737 shutdown_connections 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/3857762737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139e70 0x7ff0e40cae70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/3857762737 >> v2:172.21.15.3:3300/0 conn(0x7ff0e4068910 0x7ff0e40ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/3857762737 >> 172.21.15.27:0/3857762737 conn(0x7ff0e4067b30 msgr2=0x7ff0e40adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/3857762737 shutdown_connections 2023-10-08T16:06:16.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/3857762737 wait complete. 2023-10-08T16:06:16.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 Processor -- start 2023-10-08T16:06:16.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- start start 2023-10-08T16:06:16.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0e4068910 0x7ff0e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 0x7ff0e40aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 0x7ff0e40ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40ac7b0 con 0x7ff0e4068910 2023-10-08T16:06:16.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40abba0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e9eb0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40abe80 con 0x7ff0e4139e70 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 0x7ff0e40aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e96af700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 0x7ff0e40ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e8eae700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0e4068910 0x7ff0e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e96af700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 0x7ff0e40ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34902/0 (socket says 172.21.15.27:34902) 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e96af700 1 -- 172.21.15.27:0/1665619173 learned_addr learned my addr 172.21.15.27:0/1665619173 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.482+0000 7ff0e3fff700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 0x7ff0e40aad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45680/0 (socket says 172.21.15.27:45680) 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e3fff700 1 -- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 msgr2=0x7ff0e40ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e3fff700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 0x7ff0e40ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e3fff700 1 -- 172.21.15.27:0/1665619173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0e4068910 msgr2=0x7ff0e406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e3fff700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0e4068910 0x7ff0e406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e3fff700 1 -- 172.21.15.27:0/1665619173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009ae0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e96af700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 0x7ff0e40ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e3fff700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 0x7ff0e40aad60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00ea20 tx=0x7ff0cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0095d0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00c7f0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e40ac160 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00cbb0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e406e5d0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff0cc0136f0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e40ac960 con 0x7ff0e4139aa0 2023-10-08T16:06:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.486+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7ff0cc01c810 con 0x7ff0e4139aa0 2023-10-08T16:06:16.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.490+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff0e40ac960 con 0x7ff0e4139aa0 2023-10-08T16:06:16.510 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:16.506+0000 7f8a4de73000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:06:16.610 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:16.519+0000 7fa47138b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:06:16.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.570+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2cb792db-0837-4f4d-b645-12d5f3fc5afa", "id": 1} v 0) v1 -- 0x7ff0e40ac5e0 con 0x7ff0e4139aa0 2023-10-08T16:06:16.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.578+0000 7ff0e0ff9700 1 -- 172.21.15.27:0/1665619173 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2cb792db-0837-4f4d-b645-12d5f3fc5afa", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff0cc021060 con 0x7ff0e4139aa0 2023-10-08T16:06:16.611 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-10-08T16:06:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 msgr2=0x7ff0e40aad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 0x7ff0e40aad60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00ea20 tx=0x7ff0cc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 shutdown_connections 2023-10-08T16:06:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff0e4139e70 0x7ff0e40ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e4139aa0 0x7ff0e40aad60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 --2- 172.21.15.27:0/1665619173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0e4068910 0x7ff0e406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 >> 172.21.15.27:0/1665619173 conn(0x7ff0e4067b30 msgr2=0x7ff0e4138a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 shutdown_connections 2023-10-08T16:06:16.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.582+0000 7ff0e9eb0700 1 -- 172.21.15.27:0/1665619173 wait complete. 2023-10-08T16:06:16.621 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new 26ac4b95-9e4e-4688-b8f0-0441d50d0350 2 2023-10-08T16:06:16.756 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:16.750+0000 7f8a4de73000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:06:16.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.758+0000 7f9fa3fff700 1 Processor -- start 2023-10-08T16:06:16.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.758+0000 7f9fa3fff700 1 -- start start 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9fa40cb950 0x7f9fa4069270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa4068910 0x7f9fa406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa406c7c0 con 0x7f9fa415d870 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa415ddc0 con 0x7f9fa40cb950 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa415e0a0 con 0x7f9fa4068910 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa37fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa4068910 0x7f9fa406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa2ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9fa40cb950 0x7f9fa4069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa27fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9fa415d870 0x7f9fa4068200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46718/0 (socket says 172.21.15.27:46718) 2023-10-08T16:06:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa27fc700 1 -- 172.21.15.27:0/3762121598 learned_addr learned my addr 172.21.15.27:0/3762121598 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-08T16:06:16.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa1ffb700 1 -- 172.21.15.27:0/3762121598 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470032946 0 0) 0x7f9fa406c7c0 con 0x7f9fa415d870 2023-10-08T16:06:16.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa37fe700 1 -- 172.21.15.27:0/3762121598 >> v2:172.21.15.27:3300/0 conn(0x7f9fa40cb950 msgr2=0x7f9fa4069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:16.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa37fe700 1 --2- 172.21.15.27:0/3762121598 >> v2:172.21.15.27:3300/0 conn(0x7f9fa40cb950 0x7f9fa4069270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa37fe700 1 -- 172.21.15.27:0/3762121598 >> v1:172.21.15.27:6789/0 conn(0x7f9fa415d870 legacy=0x7f9fa4068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa37fe700 1 -- 172.21.15.27:0/3762121598 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa415e380 con 0x7f9fa4068910 2023-10-08T16:06:16.767 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:16.763+0000 7fa47138b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa37fe700 1 --2- 172.21.15.27:0/3762121598 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa4068910 0x7f9fa406cc50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009e60 tx=0x7f9f9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2771af3093ae77e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa1ffb700 1 -- 172.21.15.27:0/3762121598 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00e070 con 0x7f9fa4068910 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa1ffb700 1 -- 172.21.15.27:0/3762121598 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00bb60 con 0x7f9fa4068910 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa1ffb700 1 -- 172.21.15.27:0/3762121598 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c012430 con 0x7f9fa4068910 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3762121598 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa4068910 msgr2=0x7f9fa406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3762121598 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa4068910 0x7f9fa406cc50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009e60 tx=0x7f9f9c009780 comp rx=0 tx=0).stop 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3762121598 shutdown_connections 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3762121598 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa4068910 0x7f9fa406cc50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3762121598 >> v2:172.21.15.27:3300/0 conn(0x7f9fa40cb950 0x7f9fa4069270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3762121598 >> 172.21.15.27:0/3762121598 conn(0x7f9fa4067b30 msgr2=0x7f9fa40adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3762121598 shutdown_connections 2023-10-08T16:06:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.762+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3762121598 wait complete. 2023-10-08T16:06:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 Processor -- start 2023-10-08T16:06:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 -- start start 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fa4068910 0x7f9fa40a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa40cb950 0x7f9fa4156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fa415d870 0x7f9fa40a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40ab460 con 0x7f9fa4068910 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40a9f40 con 0x7f9fa415d870 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa3fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40abcc0 con 0x7f9fa40cb950 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa27fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa40cb950 0x7f9fa4156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fa415d870 0x7f9fa40a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa27fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa40cb950 0x7f9fa4156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34916/0 (socket says 172.21.15.27:34916) 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa27fc700 1 -- 172.21.15.27:0/3993467980 learned_addr learned my addr 172.21.15.27:0/3993467980 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.766+0000 7f9fa2ffd700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fa4068910 0x7f9fa40a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa37fe700 1 -- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa40cb950 msgr2=0x7f9fa4156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa37fe700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa40cb950 0x7f9fa4156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa37fe700 1 -- 172.21.15.27:0/3993467980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fa4068910 msgr2=0x7f9fa40a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa37fe700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fa4068910 0x7f9fa40a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa37fe700 1 -- 172.21.15.27:0/3993467980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c009a20 con 0x7f9fa415d870 2023-10-08T16:06:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa37fe700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fa415d870 0x7f9fa40a92f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c016000 tx=0x7f9f9c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c012e60 con 0x7f9fa415d870 2023-10-08T16:06:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c027470 con 0x7f9fa415d870 2023-10-08T16:06:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa40a9c60 con 0x7f9fa415d870 2023-10-08T16:06:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c027810 con 0x7f9fa415d870 2023-10-08T16:06:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa40ab950 con 0x7f9fa415d870 2023-10-08T16:06:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9f9c024070 con 0x7f9fa415d870 2023-10-08T16:06:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9f9c027c00 con 0x7f9fa415d870 2023-10-08T16:06:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.770+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa404be40 con 0x7f9fa415d870 2023-10-08T16:06:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.774+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9f9c0476d0 con 0x7f9fa415d870 2023-10-08T16:06:16.812 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:16.806+0000 7f8a4de73000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:06:16.822 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:16.819+0000 7fa47138b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:06:16.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.850+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26ac4b95-9e4e-4688-b8f0-0441d50d0350", "id": 2} v 0) v1 -- 0x7f9fa40abe00 con 0x7f9fa415d870 2023-10-08T16:06:16.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9f8affd700 1 -- 172.21.15.27:0/3993467980 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26ac4b95-9e4e-4688-b8f0-0441d50d0350", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f9c036070 con 0x7f9fa415d870 2023-10-08T16:06:16.861 INFO:teuthology.orchestra.run.smithi027.stdout:2 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fa415d870 msgr2=0x7f9fa40a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fa415d870 0x7f9fa40a92f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c016000 tx=0x7f9f9c019000 comp rx=0 tx=0).stop 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 shutdown_connections 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fa415d870 0x7f9fa40a92f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9fa40cb950 0x7f9fa4156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 --2- 172.21.15.27:0/3993467980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fa4068910 0x7f9fa40a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 >> 172.21.15.27:0/3993467980 conn(0x7f9fa4067b30 msgr2=0x7f9fa4157500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 shutdown_connections 2023-10-08T16:06:16.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.858+0000 7f9fa3fff700 1 -- 172.21.15.27:0/3993467980 wait complete. 2023-10-08T16:06:16.874 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new f628415a-e2bc-4a78-9612-626aff31178c 3 2023-10-08T16:06:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 Processor -- start 2023-10-08T16:06:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 -- start start 2023-10-08T16:06:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95f01558d0 0x7f95f00c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 0x7f95f00cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f00ca900 con 0x7f95f00ad740 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00cabc0 con 0x7f95f01558d0 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95f4824700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00caea0 con 0x7f95f00c9ba0 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 0x7f95f00cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95ef7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95f01558d0 0x7f95f00c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 0x7f95f00cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34932/0 (socket says 172.21.15.27:34932) 2023-10-08T16:06:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 -- 172.21.15.27:0/2832562690 learned_addr learned my addr 172.21.15.27:0/2832562690 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 -- 172.21.15.27:0/2832562690 >> v2:172.21.15.27:3300/0 conn(0x7f95f01558d0 msgr2=0x7f95f00c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 --2- 172.21.15.27:0/2832562690 >> v2:172.21.15.27:3300/0 conn(0x7f95f01558d0 0x7f95f00c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95ee7fc700 1 -- 172.21.15.27:0/2832562690 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245557700 0 0) 0x7f95f00ca900 con 0x7f95f00ad740 2023-10-08T16:06:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 -- 172.21.15.27:0/2832562690 >> v1:172.21.15.27:6789/0 conn(0x7f95f00ad740 legacy=0x7f95f01596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 -- 172.21.15.27:0/2832562690 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00cb180 con 0x7f95f00c9ba0 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95ef7fe700 1 --2- 172.21.15.27:0/2832562690 >> v2:172.21.15.27:3300/0 conn(0x7f95f01558d0 0x7f95f00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95eeffd700 1 --2- 172.21.15.27:0/2832562690 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 0x7f95f00cbdf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95e40099b0 tx=0x7f95e4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328363aad5fc078b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95ee7fc700 1 -- 172.21.15.27:0/2832562690 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4009ea0 con 0x7f95f00c9ba0 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95ee7fc700 1 -- 172.21.15.27:0/2832562690 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400b860 con 0x7f95f00c9ba0 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.978+0000 7f95ee7fc700 1 -- 172.21.15.27:0/2832562690 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400bc00 con 0x7f95f00c9ba0 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- 172.21.15.27:0/2832562690 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 msgr2=0x7f95f00cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 --2- 172.21.15.27:0/2832562690 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 0x7f95f00cbdf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95e40099b0 tx=0x7f95e4009250 comp rx=0 tx=0).stop 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- 172.21.15.27:0/2832562690 shutdown_connections 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 --2- 172.21.15.27:0/2832562690 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00c9ba0 0x7f95f00cbdf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 --2- 172.21.15.27:0/2832562690 >> v2:172.21.15.27:3300/0 conn(0x7f95f01558d0 0x7f95f00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- 172.21.15.27:0/2832562690 >> 172.21.15.27:0/2832562690 conn(0x7f95f006b4f0 msgr2=0x7f95f006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- 172.21.15.27:0/2832562690 shutdown_connections 2023-10-08T16:06:16.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- 172.21.15.27:0/2832562690 wait complete. 2023-10-08T16:06:16.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 Processor -- start 2023-10-08T16:06:16.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- start start 2023-10-08T16:06:16.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 0x7f95f0165c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95f00c9ba0 0x7f95f0154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95f01558d0 0x7f95f0157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00c6cc0 con 0x7f95f00c9ba0 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00c48f0 con 0x7f95f01558d0 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95f4824700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0166160 con 0x7f95f00ad740 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 0x7f95f0165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95effff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95f01558d0 0x7f95f0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 0x7f95f0165c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34942/0 (socket says 172.21.15.27:34942) 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 -- 172.21.15.27:0/2083569053 learned_addr learned my addr 172.21.15.27:0/2083569053 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95eeffd700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95f00c9ba0 0x7f95f0154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 -- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95f01558d0 msgr2=0x7f95f0157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95f01558d0 0x7f95f0157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 -- 172.21.15.27:0/2083569053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95f00c9ba0 msgr2=0x7f95f0154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95f00c9ba0 0x7f95f0154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95ef7fe700 1 -- 172.21.15.27:0/2083569053 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e000b6d0 con 0x7f95f00ad740 2023-10-08T16:06:16.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.982+0000 7f95effff700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95f01558d0 0x7f95f0157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:16.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95ef7fe700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 0x7f95f0165c20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95e000e410 tx=0x7f95e000b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011450 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e00115b0 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011930 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e40094f0 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f00c3fc0 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f95e0011ca0 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f95e0005a00 con 0x7f95f00ad740 2023-10-08T16:06:16.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.986+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00b1810 con 0x7f95f00ad740 2023-10-08T16:06:16.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:16.990+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f95f00b1810 con 0x7f95f00ad740 2023-10-08T16:06:17.006 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:17.002+0000 7f8a4de73000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:06:17.014 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:17.011+0000 7fa47138b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:06:17.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.066+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f628415a-e2bc-4a78-9612-626aff31178c", "id": 3} v 0) v1 -- 0x7f95f004be40 con 0x7f95f00ad740 2023-10-08T16:06:17.074 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:17.070+0000 7f8a4de73000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:06:17.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95d77fe700 1 -- 172.21.15.27:0/2083569053 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f628415a-e2bc-4a78-9612-626aff31178c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95e001e070 con 0x7f95f00ad740 2023-10-08T16:06:17.077 INFO:teuthology.orchestra.run.smithi027.stdout:3 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 msgr2=0x7f95f0165c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 0x7f95f0165c20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95e000e410 tx=0x7f95e000b430 comp rx=0 tx=0).stop 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 shutdown_connections 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95f01558d0 0x7f95f0157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95f00c9ba0 0x7f95f0154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 --2- 172.21.15.27:0/2083569053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f95f00ad740 0x7f95f0165c20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 >> 172.21.15.27:0/2083569053 conn(0x7f95f006b4f0 msgr2=0x7f95f0159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 shutdown_connections 2023-10-08T16:06:17.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.074+0000 7f95f4824700 1 -- 172.21.15.27:0/2083569053 wait complete. 2023-10-08T16:06:17.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:17.075+0000 7fa47138b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:06:17.090 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new 224fc661-d05e-48e6-b388-5c22ea990499 4 2023-10-08T16:06:17.145 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:17.142+0000 7f8a4de73000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:06:17.148 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:17.143+0000 7fa47138b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:06:17.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 Processor -- start 2023-10-08T16:06:17.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 -- start start 2023-10-08T16:06:17.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40af000 0x7f47f406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 0x7f47f40b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f406d5f0 con 0x7f47f40b14c0 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f406c700 con 0x7f47f4155d80 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f3fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406c9e0 con 0x7f47f40af000 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 0x7f47f40b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 0x7f47f40b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45716/0 (socket says 172.21.15.27:45716) 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f2ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40af000 0x7f47f406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f27fc700 1 -- 172.21.15.27:0/2811522480 learned_addr learned my addr 172.21.15.27:0/2811522480 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f2ffd700 1 -- 172.21.15.27:0/2811522480 >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 msgr2=0x7f47f40b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f2ffd700 1 --2- 172.21.15.27:0/2811522480 >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 0x7f47f40b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f2ffd700 1 -- 172.21.15.27:0/2811522480 >> v1:172.21.15.3:6789/0 conn(0x7f47f40b14c0 legacy=0x7f47f40af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f2ffd700 1 -- 172.21.15.27:0/2811522480 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f406ccc0 con 0x7f47f40af000 2023-10-08T16:06:17.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f27fc700 1 --2- 172.21.15.27:0/2811522480 >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 0x7f47f40b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:17.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f2ffd700 1 --2- 172.21.15.27:0/2811522480 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40af000 0x7f47f406da80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009e60 tx=0x7f47e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1882f500193a2ccb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f1ffb700 1 -- 172.21.15.27:0/2811522480 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400bb60 con 0x7f47f40af000 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f1ffb700 1 -- 172.21.15.27:0/2811522480 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e400bcc0 con 0x7f47f40af000 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.194+0000 7f47f1ffb700 1 -- 172.21.15.27:0/2811522480 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40116b0 con 0x7f47f40af000 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- 172.21.15.27:0/2811522480 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40af000 msgr2=0x7f47f406da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2811522480 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40af000 0x7f47f406da80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009e60 tx=0x7f47e4009780 comp rx=0 tx=0).stop 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- 172.21.15.27:0/2811522480 shutdown_connections 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2811522480 >> v2:172.21.15.27:3300/0 conn(0x7f47f4155d80 0x7f47f40b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2811522480 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40af000 0x7f47f406da80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- 172.21.15.27:0/2811522480 >> 172.21.15.27:0/2811522480 conn(0x7f47f4067b30 msgr2=0x7f47f40adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- 172.21.15.27:0/2811522480 shutdown_connections 2023-10-08T16:06:17.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- 172.21.15.27:0/2811522480 wait complete. 2023-10-08T16:06:17.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 Processor -- start 2023-10-08T16:06:17.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- start start 2023-10-08T16:06:17.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f40af000 0x7f47f416ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 0x7f47f416cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f4155d80 0x7f47f4151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4152fb0 con 0x7f47f4155d80 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41529f0 con 0x7f47f40af000 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f3fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4152cd0 con 0x7f47f40b14c0 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f40af000 0x7f47f416ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 0x7f47f416cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 0x7f47f416cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34958/0 (socket says 172.21.15.27:34958) 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 -- 172.21.15.27:0/2870235535 learned_addr learned my addr 172.21.15.27:0/2870235535 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f37fe700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f4155d80 0x7f47f4151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 -- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f40af000 msgr2=0x7f47f416ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f40af000 0x7f47f416ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 -- 172.21.15.27:0/2870235535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f4155d80 msgr2=0x7f47f4151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f4155d80 0x7f47f4151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f27fc700 1 -- 172.21.15.27:0/2870235535 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0094f0 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.198+0000 7f47f37fe700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f4155d80 0x7f47f4151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47f27fc700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 0x7f47f416cf50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00ec50 tx=0x7f47dc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00c850 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc00c9b0 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e4009a20 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00cd30 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40ac4b0 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f47dc005c80 con 0x7f47f40b14c0 2023-10-08T16:06:17.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f47dc013cc0 con 0x7f47f40b14c0 2023-10-08T16:06:17.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.202+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f404be40 con 0x7f47f40b14c0 2023-10-08T16:06:17.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.206+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f47dc03b6d0 con 0x7f47f40b14c0 2023-10-08T16:06:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.282+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd new", "uuid": "224fc661-d05e-48e6-b388-5c22ea990499", "id": 4} v 0) v1 -- 0x7f47f406cfa0 con 0x7f47f40b14c0 2023-10-08T16:06:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.290+0000 7f47eaffd700 1 -- 172.21.15.27:0/2870235535 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "224fc661-d05e-48e6-b388-5c22ea990499", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47dc02a070 con 0x7f47f40b14c0 2023-10-08T16:06:17.296 INFO:teuthology.orchestra.run.smithi027.stdout:4 2023-10-08T16:06:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 msgr2=0x7f47f416cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 0x7f47f416cf50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00ec50 tx=0x7f47dc009250 comp rx=0 tx=0).stop 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 shutdown_connections 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47f4155d80 0x7f47f4151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f47f40b14c0 0x7f47f416cf50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 --2- 172.21.15.27:0/2870235535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f40af000 0x7f47f416ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 >> 172.21.15.27:0/2870235535 conn(0x7f47f4067b30 msgr2=0x7f47f40b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 shutdown_connections 2023-10-08T16:06:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.294+0000 7f47f3fff700 1 -- 172.21.15.27:0/2870235535 wait complete. 2023-10-08T16:06:17.309 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new e9ef314e-7fb8-483c-987a-79d4ed749c5a 5 2023-10-08T16:06:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.414+0000 7feab34af700 1 Processor -- start 2023-10-08T16:06:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.414+0000 7feab34af700 1 -- start start 2023-10-08T16:06:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139aa0 0x7feaac068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0cb6b0 con 0x7feaac139e70 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0cb990 con 0x7feaac0cb040 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0cb4a0 con 0x7feaac139aa0 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab2cae700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7feaac0cb040 0x7feaac158c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46742/0 (socket says 172.21.15.27:46742) 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab24ad700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139aa0 0x7feaac068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab2cae700 1 -- 172.21.15.27:0/311807757 learned_addr learned my addr 172.21.15.27:0/311807757 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab14ab700 1 -- 172.21.15.27:0/311807757 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148969777 0 0) 0x7feaac0cb990 con 0x7feaac0cb040 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab14ab700 1 -- 172.21.15.27:0/311807757 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea98003570 con 0x7feaac0cb040 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab24ad700 1 -- 172.21.15.27:0/311807757 >> v1:172.21.15.27:6789/0 conn(0x7feaac0cb040 legacy=0x7feaac158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab24ad700 1 -- 172.21.15.27:0/311807757 >> v1:172.21.15.3:6789/0 conn(0x7feaac139e70 legacy=0x7feaac0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab24ad700 1 -- 172.21.15.27:0/311807757 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0cbc70 con 0x7feaac139aa0 2023-10-08T16:06:17.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab24ad700 1 --2- 172.21.15.27:0/311807757 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139aa0 0x7feaac068200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009910 tx=0x7feaa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a8ff6fa3900a558 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab14ab700 1 -- 172.21.15.27:0/311807757 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800b680 con 0x7feaac139aa0 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab14ab700 1 -- 172.21.15.27:0/311807757 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800b7e0 con 0x7feaac139aa0 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab14ab700 1 -- 172.21.15.27:0/311807757 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800bb60 con 0x7feaac139aa0 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- 172.21.15.27:0/311807757 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139aa0 msgr2=0x7feaac068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 --2- 172.21.15.27:0/311807757 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139aa0 0x7feaac068200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009910 tx=0x7feaa80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- 172.21.15.27:0/311807757 shutdown_connections 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 --2- 172.21.15.27:0/311807757 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139aa0 0x7feaac068200 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- 172.21.15.27:0/311807757 >> 172.21.15.27:0/311807757 conn(0x7feaac067b30 msgr2=0x7feaac0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- 172.21.15.27:0/311807757 shutdown_connections 2023-10-08T16:06:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 -- 172.21.15.27:0/311807757 wait complete. 2023-10-08T16:06:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.418+0000 7feab34af700 1 Processor -- start 2023-10-08T16:06:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 -- start start 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaac0cb040 0x7feaac152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac139aa0 0x7feaac0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139e70 0x7feaac0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac153f20 con 0x7feaac0cb040 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ac070 con 0x7feaac139aa0 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1534a0 con 0x7feaac139e70 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab1cac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac139aa0 0x7feaac0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139e70 0x7feaac0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab24ad700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaac0cb040 0x7feaac152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab1cac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac139aa0 0x7feaac0af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45730/0 (socket says 172.21.15.27:45730) 2023-10-08T16:06:17.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab1cac700 1 -- 172.21.15.27:0/337721212 learned_addr learned my addr 172.21.15.27:0/337721212 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:17.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 -- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac139aa0 msgr2=0x7feaac0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac139aa0 0x7feaac0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 -- 172.21.15.27:0/337721212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaac0cb040 msgr2=0x7feaac152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaac0cb040 0x7feaac152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 -- 172.21.15.27:0/337721212 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8009420 con 0x7feaac139e70 2023-10-08T16:06:17.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab2cae700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139e70 0x7feaac0afe40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feaa400cbc0 tx=0x7feaa4001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400a7e0 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400a940 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0aaeb0 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400acc0 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac0abd00 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feaa4007300 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.422+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7feaa401b980 con 0x7feaac139e70 2023-10-08T16:06:17.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.426+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0c9210 con 0x7feaac139e70 2023-10-08T16:06:17.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.426+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feaac0c9210 con 0x7feaac139e70 2023-10-08T16:06:17.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.510+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e9ef314e-7fb8-483c-987a-79d4ed749c5a", "id": 5} v 0) v1 -- 0x7feaac04be40 con 0x7feaac139e70 2023-10-08T16:06:17.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.522+0000 7feaa27fc700 1 -- 172.21.15.27:0/337721212 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9ef314e-7fb8-483c-987a-79d4ed749c5a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7feaa402a0b0 con 0x7feaac139e70 2023-10-08T16:06:17.528 INFO:teuthology.orchestra.run.smithi027.stdout:5 2023-10-08T16:06:17.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139e70 msgr2=0x7feaac0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139e70 0x7feaac0afe40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feaa400cbc0 tx=0x7feaa4001a20 comp rx=0 tx=0).stop 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 shutdown_connections 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7feaac139e70 0x7feaac0afe40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac139aa0 0x7feaac0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 --2- 172.21.15.27:0/337721212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaac0cb040 0x7feaac152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 >> 172.21.15.27:0/337721212 conn(0x7feaac067b30 msgr2=0x7feaac1384a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 shutdown_connections 2023-10-08T16:06:17.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.526+0000 7feab34af700 1 -- 172.21.15.27:0/337721212 wait complete. 2023-10-08T16:06:17.542 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new 01c26efd-8a3d-4000-a8b8-29447b790b0e 6 2023-10-08T16:06:17.575 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:17.570+0000 7f8a4de73000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:06:17.575 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:17.571+0000 7fa47138b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:06:17.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 Processor -- start 2023-10-08T16:06:17.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 -- start start 2023-10-08T16:06:17.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 0x7f80040cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8004068e70 0x7f80040c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800406daf0 con 0x7f80041593f0 2023-10-08T16:06:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800406dd90 con 0x7f8004068e70 2023-10-08T16:06:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f800a0aa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040c8e30 con 0x7f8004068aa0 2023-10-08T16:06:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f80090a8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 0x7f80040cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f80090a8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 0x7f80040cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:34994/0 (socket says 172.21.15.27:34994) 2023-10-08T16:06:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.638+0000 7f80090a8700 1 -- 172.21.15.27:0/121779730 learned_addr learned my addr 172.21.15.27:0/121779730 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f80088a7700 1 --2- 172.21.15.27:0/121779730 >> v2:172.21.15.3:3300/0 conn(0x7f8004068e70 0x7f80040c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f80090a8700 1 -- 172.21.15.27:0/121779730 >> v2:172.21.15.3:3300/0 conn(0x7f8004068e70 msgr2=0x7f80040c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f80090a8700 1 --2- 172.21.15.27:0/121779730 >> v2:172.21.15.3:3300/0 conn(0x7f8004068e70 0x7f80040c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f80090a8700 1 -- 172.21.15.27:0/121779730 >> v1:172.21.15.3:6789/0 conn(0x7f80041593f0 legacy=0x7f80041597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f80090a8700 1 -- 172.21.15.27:0/121779730 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040c9110 con 0x7f8004068aa0 2023-10-08T16:06:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f80090a8700 1 --2- 172.21.15.27:0/121779730 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 0x7f80040cb860 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40099a0 tx=0x7f7ff4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751809d8a5fe626f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f7ffbfff700 1 -- 172.21.15.27:0/121779730 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4009e90 con 0x7f8004068aa0 2023-10-08T16:06:17.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f7ffbfff700 1 -- 172.21.15.27:0/121779730 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400b860 con 0x7f8004068aa0 2023-10-08T16:06:17.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f7ffbfff700 1 -- 172.21.15.27:0/121779730 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400bc20 con 0x7f8004068aa0 2023-10-08T16:06:17.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 -- 172.21.15.27:0/121779730 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 msgr2=0x7f80040cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 --2- 172.21.15.27:0/121779730 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 0x7f80040cb860 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40099a0 tx=0x7f7ff4009250 comp rx=0 tx=0).stop 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 -- 172.21.15.27:0/121779730 shutdown_connections 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 --2- 172.21.15.27:0/121779730 >> v2:172.21.15.3:3300/0 conn(0x7f8004068e70 0x7f80040c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 --2- 172.21.15.27:0/121779730 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068aa0 0x7f80040cb860 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 -- 172.21.15.27:0/121779730 >> 172.21.15.27:0/121779730 conn(0x7f80040ca5e0 msgr2=0x7f80040ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 -- 172.21.15.27:0/121779730 shutdown_connections 2023-10-08T16:06:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 -- 172.21.15.27:0/121779730 wait complete. 2023-10-08T16:06:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 Processor -- start 2023-10-08T16:06:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.642+0000 7f800a0aa700 1 -- start start 2023-10-08T16:06:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 0x7f80041566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 0x7f800416d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80041593f0 0x7f800414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800416d5d0 con 0x7f80041593f0 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040b3510 con 0x7f8004068aa0 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040b2f20 con 0x7f8004068e70 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 0x7f80041566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80088a7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 0x7f800416d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 0x7f80041566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45742/0 (socket says 172.21.15.27:45742) 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 -- 172.21.15.27:0/693693604 learned_addr learned my addr 172.21.15.27:0/693693604 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80088a7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 0x7f800416d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:35008/0 (socket says 172.21.15.27:35008) 2023-10-08T16:06:17.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80098a9700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80041593f0 0x7f800414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 -- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 msgr2=0x7f800416d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 0x7f800416d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 -- 172.21.15.27:0/693693604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80041593f0 msgr2=0x7f800414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80041593f0 0x7f800414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 -- 172.21.15.27:0/693693604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4009490 con 0x7f8004068aa0 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80088a7700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 0x7f800416d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f80090a8700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 0x7f80041566e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4006fd0 tx=0x7f7ff4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff401f070 con 0x7f8004068aa0 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4002f30 con 0x7f8004068aa0 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400bc00 con 0x7f8004068aa0 2023-10-08T16:06:17.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040b14a0 con 0x7f8004068aa0 2023-10-08T16:06:17.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80040b1a60 con 0x7f8004068aa0 2023-10-08T16:06:17.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7ff40118b0 con 0x7f8004068aa0 2023-10-08T16:06:17.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f7ff4011b60 con 0x7f8004068aa0 2023-10-08T16:06:17.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.646+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800404be40 con 0x7f8004068aa0 2023-10-08T16:06:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.650+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7ff4028070 con 0x7f8004068aa0 2023-10-08T16:06:17.699 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:17.694+0000 7f8a4de73000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:06:17.700 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:17.695+0000 7fa47138b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:06:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.726+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01c26efd-8a3d-4000-a8b8-29447b790b0e", "id": 6} v 0) v1 -- 0x7f80040ccb50 con 0x7f8004068aa0 2023-10-08T16:06:17.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f7ff97fa700 1 -- 172.21.15.27:0/693693604 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01c26efd-8a3d-4000-a8b8-29447b790b0e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ff4015020 con 0x7f8004068aa0 2023-10-08T16:06:17.741 INFO:teuthology.orchestra.run.smithi027.stdout:6 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 msgr2=0x7f80041566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 0x7f80041566e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4006fd0 tx=0x7f7ff4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 shutdown_connections 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80041593f0 0x7f800414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8004068e70 0x7f800416d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 --2- 172.21.15.27:0/693693604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8004068aa0 0x7f80041566e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 >> 172.21.15.27:0/693693604 conn(0x7f80040ca5e0 msgr2=0x7f8004158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 shutdown_connections 2023-10-08T16:06:17.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.738+0000 7f800a0aa700 1 -- 172.21.15.27:0/693693604 wait complete. 2023-10-08T16:06:17.755 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd new 6acc100b-c7fb-4966-8373-536007deab14 7 2023-10-08T16:06:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.854+0000 7fcf63fff700 1 Processor -- start 2023-10-08T16:06:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.854+0000 7fcf63fff700 1 -- start start 2023-10-08T16:06:17.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf641558d0 0x7fcf640c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640c9ba0 0x7fcf640cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf640ca900 con 0x7fcf640ad740 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf640cabc0 con 0x7fcf641558d0 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640caea0 con 0x7fcf640c9ba0 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf62ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf641558d0 0x7fcf640c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf637fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcf640ad740 0x7fcf641596e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46744/0 (socket says 172.21.15.27:46744) 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf637fe700 1 -- 172.21.15.27:0/1839352051 learned_addr learned my addr 172.21.15.27:0/1839352051 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-08T16:06:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf627fc700 1 --2- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640c9ba0 0x7fcf640cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640c9ba0 msgr2=0x7fcf640cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf62ffd700 1 --2- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640c9ba0 0x7fcf640cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf61ffb700 1 -- 172.21.15.27:0/1839352051 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094475391 0 0) 0x7fcf640ca900 con 0x7fcf640ad740 2023-10-08T16:06:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1839352051 >> v1:172.21.15.27:6789/0 conn(0x7fcf640ad740 legacy=0x7fcf641596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1839352051 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640cb180 con 0x7fcf641558d0 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf62ffd700 1 --2- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c9660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcf540098e0 tx=0x7fcf540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428f179676701fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf61ffb700 1 -- 172.21.15.27:0/1839352051 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400b640 con 0x7fcf641558d0 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf61ffb700 1 -- 172.21.15.27:0/1839352051 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5400b7a0 con 0x7fcf641558d0 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf61ffb700 1 -- 172.21.15.27:0/1839352051 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400bb40 con 0x7fcf641558d0 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 msgr2=0x7fcf640c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c9660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcf540098e0 tx=0x7fcf540091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- 172.21.15.27:0/1839352051 shutdown_connections 2023-10-08T16:06:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640c9ba0 0x7fcf640cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1839352051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c9660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- 172.21.15.27:0/1839352051 >> 172.21.15.27:0/1839352051 conn(0x7fcf6406b4f0 msgr2=0x7fcf6406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- 172.21.15.27:0/1839352051 shutdown_connections 2023-10-08T16:06:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.858+0000 7fcf63fff700 1 -- 172.21.15.27:0/1839352051 wait complete. 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 Processor -- start 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 -- start start 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 0x7fcf64154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf640c9ba0 0x7fcf640c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c5440 con 0x7fcf640c9ba0 2023-10-08T16:06:17.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c6410 con 0x7fcf641558d0 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c5650 con 0x7fcf640ad740 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 0x7fcf64154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 0x7fcf64154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.27:35028/0 (socket says 172.21.15.27:35028) 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1748678001 learned_addr learned my addr 172.21.15.27:0/1748678001 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf637fe700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf627fc700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf640c9ba0 0x7fcf640c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 msgr2=0x7fcf640c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1748678001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf640c9ba0 msgr2=0x7fcf640c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf640c9ba0 0x7fcf640c0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 -- 172.21.15.27:0/1748678001 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009420 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf627fc700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf640c9ba0 0x7fcf640c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf62ffd700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 0x7fcf64154e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009f80 tx=0x7fcf54017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400bb20 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54000c90 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011630 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf640c5930 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf640c5ef0 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcf540119a0 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.862+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fcf5402cc90 con 0x7fcf640ad740 2023-10-08T16:06:17.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.866+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6404be40 con 0x7fcf640ad740 2023-10-08T16:06:17.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.866+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcf54031060 con 0x7fcf640ad740 2023-10-08T16:06:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.942+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6acc100b-c7fb-4966-8373-536007deab14", "id": 7} v 0) v1 -- 0x7fcf640c60e0 con 0x7fcf640ad740 2023-10-08T16:06:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf4affd700 1 -- 172.21.15.27:0/1748678001 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6acc100b-c7fb-4966-8373-536007deab14", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf54015020 con 0x7fcf640ad740 2023-10-08T16:06:17.957 INFO:teuthology.orchestra.run.smithi027.stdout:7 2023-10-08T16:06:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 msgr2=0x7fcf64154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 0x7fcf64154e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009f80 tx=0x7fcf54017000 comp rx=0 tx=0).stop 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 shutdown_connections 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf641558d0 0x7fcf640c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf640c9ba0 0x7fcf640c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 --2- 172.21.15.27:0/1748678001 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf640ad740 0x7fcf64154e00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 >> 172.21.15.27:0/1748678001 conn(0x7fcf6406b4f0 msgr2=0x7fcf64067bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 shutdown_connections 2023-10-08T16:06:17.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-08T16:06:17.954+0000 7fcf63fff700 1 -- 172.21.15.27:0/1748678001 wait complete. 2023-10-08T16:06:17.972 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T16:06:17.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T16:06:17.974 INFO:tasks.ceph.osd.0:Started 2023-10-08T16:06:17.975 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T16:06:17.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T16:06:17.977 INFO:tasks.ceph.osd.1:Started 2023-10-08T16:06:17.977 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T16:06:17.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T16:06:17.979 INFO:tasks.ceph.osd.2:Started 2023-10-08T16:06:17.980 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T16:06:17.980 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T16:06:17.982 INFO:tasks.ceph.osd.3:Started 2023-10-08T16:06:17.982 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T16:06:17.982 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T16:06:17.985 INFO:tasks.ceph.osd.4:Started 2023-10-08T16:06:17.985 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T16:06:17.985 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T16:06:17.987 INFO:tasks.ceph.osd.5:Started 2023-10-08T16:06:17.987 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T16:06:17.988 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T16:06:17.990 INFO:tasks.ceph.osd.6:Started 2023-10-08T16:06:17.990 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T16:06:17.990 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T16:06:17.993 INFO:tasks.ceph.osd.7:Started 2023-10-08T16:06:17.993 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:18.034 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.031+0000 7fa47138b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:06:18.039 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.034+0000 7f8a4de73000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:06:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.131+0000 7faeb759e700 1 Processor -- start 2023-10-08T16:06:18.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.131+0000 7faeb759e700 1 -- start start 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faeb80c2b50 0x7faeb8160d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80c16b0 con 0x7faeb8155e20 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80c8710 con 0x7faeb80c80d0 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80c1060 con 0x7faeb80c2b50 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb6d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faeb80c2b50 0x7faeb8160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7faeb8155e20 0x7faeb815a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:34618/0 (socket says 172.21.15.3:34618) 2023-10-08T16:06:18.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb659c700 1 -- 172.21.15.3:0/3878683142 learned_addr learned my addr 172.21.15.3:0/3878683142 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb6d9d700 1 -- 172.21.15.3:0/3878683142 >> v1:172.21.15.27:6789/0 conn(0x7faeb80c80d0 legacy=0x7faeb806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb6d9d700 1 -- 172.21.15.3:0/3878683142 >> v1:172.21.15.3:6789/0 conn(0x7faeb8155e20 legacy=0x7faeb815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb6d9d700 1 -- 172.21.15.3:0/3878683142 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80c1340 con 0x7faeb80c2b50 2023-10-08T16:06:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb559a700 1 -- 172.21.15.3:0/3878683142 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222907824 0 0) 0x7faeb80c16b0 con 0x7faeb8155e20 2023-10-08T16:06:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb6d9d700 1 --2- 172.21.15.3:0/3878683142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb80c2b50 0x7faeb8160d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009e60 tx=0x7faeb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bb6b94083d3c67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb559a700 1 -- 172.21.15.3:0/3878683142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000bc30 con 0x7faeb80c2b50 2023-10-08T16:06:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb559a700 1 -- 172.21.15.3:0/3878683142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000bd90 con 0x7faeb80c2b50 2023-10-08T16:06:18.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb559a700 1 -- 172.21.15.3:0/3878683142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00116b0 con 0x7faeb80c2b50 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- 172.21.15.3:0/3878683142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb80c2b50 msgr2=0x7faeb8160d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 --2- 172.21.15.3:0/3878683142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb80c2b50 0x7faeb8160d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009e60 tx=0x7faeb0009780 comp rx=0 tx=0).stop 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- 172.21.15.3:0/3878683142 shutdown_connections 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 --2- 172.21.15.3:0/3878683142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb80c2b50 0x7faeb8160d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- 172.21.15.3:0/3878683142 >> 172.21.15.3:0/3878683142 conn(0x7faeb80c8c90 msgr2=0x7faeb80c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- 172.21.15.3:0/3878683142 shutdown_connections 2023-10-08T16:06:18.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 -- 172.21.15.3:0/3878683142 wait complete. 2023-10-08T16:06:18.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.135+0000 7faeb759e700 1 Processor -- start 2023-10-08T16:06:18.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 -- start start 2023-10-08T16:06:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb80c2b50 0x7faeb80c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7faeb80c80d0 0x7faeb8153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 0x7faeb8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8156fb0 con 0x7faeb8155e20 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c46c0 con 0x7faeb80c2b50 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c49a0 con 0x7faeb80c80d0 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 0x7faeb8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 0x7faeb8150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33772/0 (socket says 172.21.15.3:33772) 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 -- 172.21.15.3:0/2499432689 learned_addr learned my addr 172.21.15.3:0/2499432689 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb5d9b700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7faeb80c80d0 0x7faeb8153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb659c700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb80c2b50 0x7faeb80c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 -- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7faeb80c80d0 msgr2=0x7faeb8153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7faeb80c80d0 0x7faeb8153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 -- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb80c2b50 msgr2=0x7faeb80c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb80c2b50 0x7faeb80c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 -- 172.21.15.3:0/2499432689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009a20 con 0x7faeb8155e20 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb659c700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb80c2b50 0x7faeb80c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb6d9d700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 0x7faeb8150ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faeb806a110 tx=0x7faeb001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000bc30 con 0x7faeb8155e20 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00032f0 con 0x7faeb8155e20 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0011ea0 con 0x7faeb8155e20 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80c4c80 con 0x7faeb8155e20 2023-10-08T16:06:18.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8153300 con 0x7faeb8155e20 2023-10-08T16:06:18.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faeb002d6c0 con 0x7faeb8155e20 2023-10-08T16:06:18.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.139+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7faeb0023ae0 con 0x7faeb8155e20 2023-10-08T16:06:18.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.143+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb8156d60 con 0x7faeb8155e20 2023-10-08T16:06:18.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.147+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faeb0028070 con 0x7faeb8155e20 2023-10-08T16:06:18.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeb8157120 con 0x7faeb8155e20 2023-10-08T16:06:18.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faea67fc700 1 -- 172.21.15.3:0/2499432689 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7faeb0023400 con 0x7faeb8155e20 2023-10-08T16:06:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:18.215 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:17.947622+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:18.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 msgr2=0x7faeb8150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 0x7faeb8150ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faeb806a110 tx=0x7faeb001b000 comp rx=0 tx=0).stop 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 shutdown_connections 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb8155e20 0x7faeb8150ce0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7faeb80c80d0 0x7faeb8153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 --2- 172.21.15.3:0/2499432689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb80c2b50 0x7faeb80c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 >> 172.21.15.3:0/2499432689 conn(0x7faeb80c8c90 msgr2=0x7faeb80caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 shutdown_connections 2023-10-08T16:06:18.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:18.211+0000 7faeb759e700 1 -- 172.21.15.3:0/2499432689 wait complete. 2023-10-08T16:06:18.226 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T16:06:18.226 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T16:06:18.227 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.222+0000 7f8a4de73000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:06:18.235 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.231+0000 7fa47138b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:06:18.300 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.294+0000 7f8a4de73000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:06:18.302 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.299+0000 7fa47138b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:06:18.337 INFO:tasks.ceph.osd.4.smithi027.stderr:2023-10-08T16:06:18.334+0000 7fee813be3c0 -1 Falling back to public interface 2023-10-08T16:06:18.350 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T16:06:18.347+0000 7f09da2473c0 -1 Falling back to public interface 2023-10-08T16:06:18.351 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T16:06:18.347+0000 7fec4ec7e3c0 -1 Falling back to public interface 2023-10-08T16:06:18.355 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.351+0000 7fa47138b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:06:18.360 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.354+0000 7f8a4de73000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:06:18.374 INFO:tasks.ceph.osd.6.smithi027.stderr:2023-10-08T16:06:18.370+0000 7f93ae47a3c0 -1 Falling back to public interface 2023-10-08T16:06:18.377 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T16:06:18.375+0000 7f3335ec03c0 -1 Falling back to public interface 2023-10-08T16:06:18.406 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T16:06:18.403+0000 7fd9ebefe3c0 -1 Falling back to public interface 2023-10-08T16:06:18.412 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.407+0000 7fa47138b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:06:18.424 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.418+0000 7f8a4de73000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:06:18.595 INFO:tasks.ceph.osd.5.smithi027.stderr:2023-10-08T16:06:18.590+0000 7f21f54143c0 -1 Falling back to public interface 2023-10-08T16:06:18.606 INFO:tasks.ceph.osd.7.smithi027.stderr:2023-10-08T16:06:18.602+0000 7fb70116a3c0 -1 Falling back to public interface 2023-10-08T16:06:18.697 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.695+0000 7fa47138b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:06:18.719 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.714+0000 7f8a4de73000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:06:18.750 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.747+0000 7fa47138b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:06:18.781 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.778+0000 7f8a4de73000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:06:18.816 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.811+0000 7fa47138b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:06:18.853 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:18.850+0000 7f8a4de73000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:06:18.983 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:18.979+0000 7fa47138b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:06:19.031 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:19.032 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:19.026+0000 7f8a4de73000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:06:19.047 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:19.043+0000 7fa47138b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:06:19.105 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:19.102+0000 7f8a4de73000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:06:19.118 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 Processor -- start 2023-10-08T16:06:19.118 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 -- start start 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3db41536e0 0x7f3db40b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3db40b0ca0 0x7f3db40b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db40c8b50 con 0x7f3db4156cd0 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db4153ab0 con 0x7f3db41536e0 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dba598700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db40b15e0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3db41536e0 0x7f3db40b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.120 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3db41536e0 0x7f3db40b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33786/0 (socket says 172.21.15.3:33786) 2023-10-08T16:06:19.121 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 -- 172.21.15.3:0/3985159500 learned_addr learned my addr 172.21.15.3:0/3985159500 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:19.121 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9d97700 1 --2- 172.21.15.3:0/3985159500 >> v2:172.21.15.27:3300/0 conn(0x7f3db40b0ca0 0x7f3db40b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.122 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 -- 172.21.15.3:0/3985159500 >> v2:172.21.15.27:3300/0 conn(0x7f3db40b0ca0 msgr2=0x7f3db40b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.122 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 --2- 172.21.15.3:0/3985159500 >> v2:172.21.15.27:3300/0 conn(0x7f3db40b0ca0 0x7f3db40b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.122 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 -- 172.21.15.3:0/3985159500 >> v1:172.21.15.3:6789/0 conn(0x7f3db4156cd0 legacy=0x7f3db40c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.122 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3dabfff700 1 -- 172.21.15.3:0/3985159500 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203182755 0 0) 0x7f3db40c8b50 con 0x7f3db4156cd0 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.115+0000 7f3db9596700 1 -- 172.21.15.3:0/3985159500 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40af050 con 0x7f3db41536e0 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3db9596700 1 --2- 172.21.15.3:0/3985159500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db41536e0 0x7f3db40b00f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3db40685c0 tx=0x7f3db0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced711b5583e639f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dabfff700 1 -- 172.21.15.3:0/3985159500 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0009e70 con 0x7f3db41536e0 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dabfff700 1 -- 172.21.15.3:0/3985159500 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db000b860 con 0x7f3db41536e0 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dabfff700 1 -- 172.21.15.3:0/3985159500 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000bc00 con 0x7f3db41536e0 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 -- 172.21.15.3:0/3985159500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db41536e0 msgr2=0x7f3db40b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 --2- 172.21.15.3:0/3985159500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db41536e0 0x7f3db40b00f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3db40685c0 tx=0x7f3db0009250 comp rx=0 tx=0).stop 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 -- 172.21.15.3:0/3985159500 shutdown_connections 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 --2- 172.21.15.3:0/3985159500 >> v2:172.21.15.27:3300/0 conn(0x7f3db40b0ca0 0x7f3db40b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.123 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 --2- 172.21.15.3:0/3985159500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db41536e0 0x7f3db40b00f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.124 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 -- 172.21.15.3:0/3985159500 >> 172.21.15.3:0/3985159500 conn(0x7f3db4069f60 msgr2=0x7f3db40adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:19.124 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 -- 172.21.15.3:0/3985159500 shutdown_connections 2023-10-08T16:06:19.124 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 -- 172.21.15.3:0/3985159500 wait complete. 2023-10-08T16:06:19.124 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 Processor -- start 2023-10-08T16:06:19.124 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.119+0000 7f3dba598700 1 -- start start 2023-10-08T16:06:19.125 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 0x7f3db4148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.125 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3db41536e0 0x7f3db414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db4156cd0 0x7f3db40c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40c1c90 con 0x7f3db40b0ca0 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4148c40 con 0x7f3db4156cd0 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db414ab90 con 0x7f3db41536e0 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 0x7f3db4148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 0x7f3db4148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33800/0 (socket says 172.21.15.3:33800) 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 -- 172.21.15.3:0/2090953783 learned_addr learned my addr 172.21.15.3:0/2090953783 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9d97700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db4156cd0 0x7f3db40c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.126 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db8d95700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3db41536e0 0x7f3db414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 -- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3db41536e0 msgr2=0x7f3db414b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3db41536e0 0x7f3db414b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 -- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db4156cd0 msgr2=0x7f3db40c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db4156cd0 0x7f3db40c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 -- 172.21.15.3:0/2090953783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00094f0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9d97700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db4156cd0 0x7f3db40c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:19.128 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3db9596700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 0x7f3db4148700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3db0006fd0 tx=0x7f3db0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0000d10 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db000bbe0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db414a840 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0011670 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db4169bb0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3db0011ca0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3db00253f0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.123+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db4169da0 con 0x7f3db40b0ca0 2023-10-08T16:06:19.131 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.127+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3db0033060 con 0x7f3db40b0ca0 2023-10-08T16:06:19.194 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3db404be40 con 0x7f3db40b0ca0 2023-10-08T16:06:19.195 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3da97fa700 1 -- 172.21.15.3:0/2090953783 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f3db003c090 con 0x7f3db40b0ca0 2023-10-08T16:06:19.195 INFO:teuthology.misc.health.smithi003.stdout: 2023-10-08T16:06:19.195 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:17.947622+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 msgr2=0x7f3db4148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3dba598700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 0x7f3db4148700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3db0006fd0 tx=0x7f3db0017000 comp rx=0 tx=0).stop 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 shutdown_connections 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3dba598700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db4156cd0 0x7f3db40c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.191+0000 7f3dba598700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3db41536e0 0x7f3db414b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.195+0000 7f3dba598700 1 --2- 172.21.15.3:0/2090953783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3db40b0ca0 0x7f3db4148700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.197 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.195+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 >> 172.21.15.3:0/2090953783 conn(0x7f3db4069f60 msgr2=0x7f3db40cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:19.198 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.195+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 shutdown_connections 2023-10-08T16:06:19.198 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:19.195+0000 7f3dba598700 1 -- 172.21.15.3:0/2090953783 wait complete. 2023-10-08T16:06:19.210 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:06:19.783 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:19.779+0000 7fa47138b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:06:19.860 INFO:tasks.ceph.mgr.x.smithi027.stderr:2023-10-08T16:06:19.854+0000 7f8a4de73000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:06:20.829 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:20.827+0000 7fa45a483700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T16:06:20.833 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T16:06:20.831+0000 7fa45a483700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T16:06:21.895 INFO:tasks.ceph.osd.4.smithi027.stderr:2023-10-08T16:06:21.890+0000 7fee813be3c0 -1 osd.4 0 log_to_monitors true 2023-10-08T16:06:21.960 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T16:06:21.955+0000 7f3335ec03c0 -1 osd.3 0 log_to_monitors true 2023-10-08T16:06:22.011 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T16:06:22.007+0000 7f09da2473c0 -1 osd.0 0 log_to_monitors true 2023-10-08T16:06:22.136 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T16:06:22.131+0000 7fec4ec7e3c0 -1 osd.1 0 log_to_monitors true 2023-10-08T16:06:22.190 INFO:tasks.ceph.osd.6.smithi027.stderr:2023-10-08T16:06:22.186+0000 7f93ae47a3c0 -1 osd.6 0 log_to_monitors true 2023-10-08T16:06:22.339 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T16:06:22.335+0000 7fd9ebefe3c0 -1 osd.2 0 log_to_monitors true 2023-10-08T16:06:22.352 INFO:tasks.ceph.osd.5.smithi027.stderr:2023-10-08T16:06:22.350+0000 7f21f54143c0 -1 osd.5 0 log_to_monitors true 2023-10-08T16:06:22.444 INFO:tasks.ceph.osd.7.smithi027.stderr:2023-10-08T16:06:22.438+0000 7fb70116a3c0 -1 osd.7 0 log_to_monitors true 2023-10-08T16:06:26.016 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:26.045 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T16:06:26.043+0000 7f3331660700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T16:06:26.052 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T16:06:26.047+0000 7f332a404700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.067 INFO:tasks.ceph.osd.6.smithi027.stderr:2023-10-08T16:06:26.062+0000 7f93a9c1a700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T16:06:26.075 INFO:tasks.ceph.osd.6.smithi027.stderr:2023-10-08T16:06:26.070+0000 7f93a29be700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.104 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T16:06:26.099+0000 7fec4a41e700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T16:06:26.105 INFO:tasks.ceph.osd.4.smithi027.stderr:2023-10-08T16:06:26.102+0000 7fee7cb5e700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T16:06:26.110 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T16:06:26.107+0000 7fec431c2700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.111 INFO:tasks.ceph.osd.4.smithi027.stderr:2023-10-08T16:06:26.106+0000 7fee75902700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 Processor -- start 2023-10-08T16:06:26.129 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- start start 2023-10-08T16:06:26.131 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff998156cd0 0x7ff9980b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.131 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9980b0ca0 0x7ff9980b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.131 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980c8b50 con 0x7ff9981536e0 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff998153ab0 con 0x7ff998156cd0 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b15e0 con 0x7ff9980b0ca0 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff998156cd0 0x7ff9980b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff998156cd0 0x7ff9980b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52726/0 (socket says 172.21.15.3:52726) 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 -- 172.21.15.3:0/2566542025 learned_addr learned my addr 172.21.15.3:0/2566542025 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff997fff700 1 --2- 172.21.15.3:0/2566542025 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9980b0ca0 0x7ff9980b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 -- 172.21.15.3:0/2566542025 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9980b0ca0 msgr2=0x7ff9980b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 --2- 172.21.15.3:0/2566542025 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9980b0ca0 0x7ff9980b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 -- 172.21.15.3:0/2566542025 >> v1:172.21.15.27:6789/0 conn(0x7ff9981536e0 legacy=0x7ff9980c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 -- 172.21.15.3:0/2566542025 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980af050 con 0x7ff998156cd0 2023-10-08T16:06:26.132 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff996ffd700 1 --2- 172.21.15.3:0/2566542025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff9980b00f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0099b0 tx=0x7ff98c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf11a652c3395e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:26.133 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff9967fc700 1 -- 172.21.15.3:0/2566542025 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c009ea0 con 0x7ff998156cd0 2023-10-08T16:06:26.133 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff9967fc700 1 -- 172.21.15.3:0/2566542025 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c00b860 con 0x7ff998156cd0 2023-10-08T16:06:26.133 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff9967fc700 1 -- 172.21.15.3:0/2566542025 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00bc00 con 0x7ff998156cd0 2023-10-08T16:06:26.135 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- 172.21.15.3:0/2566542025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 msgr2=0x7ff9980b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.135 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/2566542025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff9980b00f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0099b0 tx=0x7ff98c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:26.135 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- 172.21.15.3:0/2566542025 shutdown_connections 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/2566542025 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9980b0ca0 0x7ff9980b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/2566542025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff9980b00f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- 172.21.15.3:0/2566542025 >> 172.21.15.3:0/2566542025 conn(0x7ff998069f60 msgr2=0x7ff9980adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- 172.21.15.3:0/2566542025 shutdown_connections 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.127+0000 7ff99cdbc700 1 -- 172.21.15.3:0/2566542025 wait complete. 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 Processor -- start 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 -- start start 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9980b0ca0 0x7ff998149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9981536e0 0x7ff998151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.136 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff998145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff998152a60 con 0x7ff998156cd0 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99814a780 con 0x7ff9980b0ca0 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff998151f60 con 0x7ff9981536e0 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff998145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff998145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52732/0 (socket says 172.21.15.3:52732) 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9980b0ca0 0x7ff998149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 -- 172.21.15.3:0/988705890 learned_addr learned my addr 172.21.15.3:0/988705890 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff996ffd700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9981536e0 0x7ff998151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 -- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9981536e0 msgr2=0x7ff998151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9981536e0 0x7ff998151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.137 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 -- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9980b0ca0 msgr2=0x7ff998149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9980b0ca0 0x7ff998149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 -- 172.21.15.3:0/988705890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0094f0 con 0x7ff998156cd0 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff997fff700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff998145e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff990009e20 tx=0x7ff99000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000caa0 con 0x7ff998156cd0 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99000f040 con 0x7ff998156cd0 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000ce70 con 0x7ff998156cd0 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff998168bd0 con 0x7ff998156cd0 2023-10-08T16:06:26.138 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9981524a0 con 0x7ff998156cd0 2023-10-08T16:06:26.139 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.131+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7ff990014690 con 0x7ff998156cd0 2023-10-08T16:06:26.139 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.135+0000 7ff97f7fe700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff9800605e0 0x7ff980062a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.139 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.135+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7ff99007c160 con 0x7ff998156cd0 2023-10-08T16:06:26.139 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.135+0000 7ff9977fe700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff9800605e0 0x7ff980062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.139 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.135+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99804be40 con 0x7ff998156cd0 2023-10-08T16:06:26.140 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.135+0000 7ff9977fe700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff9800605e0 0x7ff980062a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff988003a80 tx=0x7ff988007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:26.143 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T16:06:26.139+0000 7fd9e769e700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T16:06:26.144 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T16:06:26.139+0000 7f09d720c700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T16:06:26.145 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.143+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff990018080 con 0x7ff998156cd0 2023-10-08T16:06:26.154 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T16:06:26.151+0000 7fd9e0442700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.154 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T16:06:26.151+0000 7f09ce78b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.159 INFO:tasks.ceph.osd.5.smithi027.stderr:2023-10-08T16:06:26.154+0000 7f21f23d9700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T16:06:26.165 INFO:tasks.ceph.osd.5.smithi027.stderr:2023-10-08T16:06:26.162+0000 7f21e9958700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.170 INFO:tasks.ceph.osd.7.smithi027.stderr:2023-10-08T16:06:26.166+0000 7fb6fc90a700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T16:06:26.176 INFO:tasks.ceph.osd.7.smithi027.stderr:2023-10-08T16:06:26.174+0000 7fb6f56ae700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:06:26.302 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.299+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99814a8c0 con 0x7ff998156cd0 2023-10-08T16:06:26.303 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.299+0000 7ff97f7fe700 1 -- 172.21.15.3:0/988705890 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff99004d5c0 con 0x7ff998156cd0 2023-10-08T16:06:26.303 INFO:teuthology.misc.health.smithi003.stdout: 2023-10-08T16:06:26.303 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":12,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:23.833473+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff9800605e0 msgr2=0x7ff980062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff9800605e0 0x7ff980062a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff988003a80 tx=0x7ff988007ec0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 msgr2=0x7ff998145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff998145e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff990009e20 tx=0x7ff99000b040 comp rx=0 tx=0).stop 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 shutdown_connections 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff9800605e0 0x7ff980062a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.307 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff998156cd0 0x7ff998145e30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.308 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9981536e0 0x7ff998151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.308 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 --2- 172.21.15.3:0/988705890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9980b0ca0 0x7ff998149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.308 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 >> 172.21.15.3:0/988705890 conn(0x7ff998069f60 msgr2=0x7ff9980cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:26.308 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 shutdown_connections 2023-10-08T16:06:26.308 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:26.303+0000 7ff99cdbc700 1 -- 172.21.15.3:0/988705890 wait complete. 2023-10-08T16:06:26.322 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:06:33.128 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:33.232 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.227+0000 7fa5488c9700 1 Processor -- start 2023-10-08T16:06:33.232 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.227+0000 7fa5488c9700 1 -- start start 2023-10-08T16:06:33.233 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa544067b10 0x7fa544067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.233 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa54415d360 0x7fa5441593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa544159900 0x7fa544156390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa544159e80 con 0x7fa544067b10 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54415a160 con 0x7fa54415d360 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415cb60 con 0x7fa544159900 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa544067b10 0x7fa544067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa544067b10 0x7fa544067ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33302/0 (socket says 172.21.15.3:33302) 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 -- 172.21.15.3:0/1564888819 learned_addr learned my addr 172.21.15.3:0/1564888819 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa543fff700 1 --2- 172.21.15.3:0/1564888819 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa544159900 0x7fa544156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.234 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa542ffd700 1 --2- 172.21.15.3:0/1564888819 >> v2:172.21.15.27:3300/0 conn(0x7fa54415d360 0x7fa5441593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 -- 172.21.15.3:0/1564888819 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa544159900 msgr2=0x7fa544156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 --2- 172.21.15.3:0/1564888819 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa544159900 0x7fa544156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 -- 172.21.15.3:0/1564888819 >> v2:172.21.15.27:3300/0 conn(0x7fa54415d360 msgr2=0x7fa5441593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 --2- 172.21.15.3:0/1564888819 >> v2:172.21.15.27:3300/0 conn(0x7fa54415d360 0x7fa5441593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 -- 172.21.15.3:0/1564888819 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54415ce40 con 0x7fa544067b10 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5437fe700 1 --2- 172.21.15.3:0/1564888819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544067b10 0x7fa544067ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa544068850 tx=0x7fa534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0837c9a6ec82879 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.236 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5427fc700 1 -- 172.21.15.3:0/1564888819 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400b640 con 0x7fa544067b10 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5427fc700 1 -- 172.21.15.3:0/1564888819 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400b7a0 con 0x7fa544067b10 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5427fc700 1 -- 172.21.15.3:0/1564888819 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400bb60 con 0x7fa544067b10 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- 172.21.15.3:0/1564888819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544067b10 msgr2=0x7fa544067ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- 172.21.15.3:0/1564888819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544067b10 0x7fa544067ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa544068850 tx=0x7fa534009250 comp rx=0 tx=0).stop 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- 172.21.15.3:0/1564888819 shutdown_connections 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- 172.21.15.3:0/1564888819 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa544159900 0x7fa544156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- 172.21.15.3:0/1564888819 >> v2:172.21.15.27:3300/0 conn(0x7fa54415d360 0x7fa5441593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 --2- 172.21.15.3:0/1564888819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544067b10 0x7fa544067ee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- 172.21.15.3:0/1564888819 >> 172.21.15.3:0/1564888819 conn(0x7fa5440cdb60 msgr2=0x7fa5440cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- 172.21.15.3:0/1564888819 shutdown_connections 2023-10-08T16:06:33.237 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.231+0000 7fa5488c9700 1 -- 172.21.15.3:0/1564888819 wait complete. 2023-10-08T16:06:33.238 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.235+0000 7fa5488c9700 1 Processor -- start 2023-10-08T16:06:33.238 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.235+0000 7fa5488c9700 1 -- start start 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa544067b10 0x7fa5440c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 0x7fa5440afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa54415d360 0x7fa5440ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa544154410 con 0x7fa544159900 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5441590f0 con 0x7fa544067b10 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa544158430 con 0x7fa54415d360 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa542ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 0x7fa5440afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.242 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa542ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 0x7fa5440afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33306/0 (socket says 172.21.15.3:33306) 2023-10-08T16:06:33.243 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa542ffd700 1 -- 172.21.15.3:0/28097832 learned_addr learned my addr 172.21.15.3:0/28097832 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:33.243 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5437fe700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa544067b10 0x7fa5440c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.243 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa54415d360 0x7fa5440ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 -- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa544067b10 msgr2=0x7fa5440c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa544067b10 0x7fa5440c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 -- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 msgr2=0x7fa5440afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 0x7fa5440afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 -- 172.21.15.3:0/28097832 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009490 con 0x7fa54415d360 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa542ffd700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 0x7fa5440afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:33.244 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa543fff700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa54415d360 0x7fa5440ca960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009e80 tx=0x7fa53c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.245 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00caa0 con 0x7fa54415d360 2023-10-08T16:06:33.245 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c00f040 con 0x7fa54415d360 2023-10-08T16:06:33.245 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5440ccd30 con 0x7fa54415d360 2023-10-08T16:06:33.245 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00ce70 con 0x7fa54415d360 2023-10-08T16:06:33.245 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa544157e60 con 0x7fa54415d360 2023-10-08T16:06:33.246 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.239+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5441585e0 con 0x7fa54415d360 2023-10-08T16:06:33.246 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.243+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa53c014690 con 0x7fa54415d360 2023-10-08T16:06:33.246 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.243+0000 7fa52b7fe700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa530060550 0x7fa530062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.246 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.243+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa53c07d100 con 0x7fa54415d360 2023-10-08T16:06:33.246 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.243+0000 7fa5437fe700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa530060550 0x7fa530062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.246 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.243+0000 7fa5437fe700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa530060550 0x7fa530062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa544068850 tx=0x7fa534017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.255 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.251+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5441585e0 con 0x7fa54415d360 2023-10-08T16:06:33.420 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.415+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa544158570 con 0x7fa54415d360 2023-10-08T16:06:33.422 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa52b7fe700 1 -- 172.21.15.3:0/28097832 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12031 (secure 0 0 0) 0x7fa53c051430 con 0x7fa54415d360 2023-10-08T16:06:33.422 INFO:teuthology.misc.health.smithi003.stdout: 2023-10-08T16:06:33.422 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":16,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:30.090813+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:33.424 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa530060550 msgr2=0x7fa530062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa530060550 0x7fa530062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa544068850 tx=0x7fa534017000 comp rx=0 tx=0).stop 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa54415d360 msgr2=0x7fa5440ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa54415d360 0x7fa5440ca960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009e80 tx=0x7fa53c00b040 comp rx=0 tx=0).stop 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 shutdown_connections 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa530060550 0x7fa530062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa54415d360 0x7fa5440ca960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa544159900 0x7fa5440afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 --2- 172.21.15.3:0/28097832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa544067b10 0x7fa5440c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 >> 172.21.15.3:0/28097832 conn(0x7fa5440cdb60 msgr2=0x7fa544070090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 shutdown_connections 2023-10-08T16:06:33.425 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T16:06:33.419+0000 7fa5488c9700 1 -- 172.21.15.3:0/28097832 wait complete. 2023-10-08T16:06:33.435 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T16:06:33.435 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T16:06:33.435 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:06:33.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:06:33.438 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:06:33.438 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:06:33.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:06:33.440 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:06:33.440 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:06:33.441 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:06:33.443 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:06:33.443 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:06:33.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:06:33.445 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:06:33.445 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T16:06:33.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:33.517 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-10-08T16:06:33.530 INFO:tasks.ceph.mds.d.smithi027.stdout:starting mds.d at 2023-10-08T16:06:33.531 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T16:06:33.536 INFO:tasks.ceph.mds.b.smithi027.stdout:starting mds.b at 2023-10-08T16:06:33.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 Processor -- start 2023-10-08T16:06:33.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 -- start start 2023-10-08T16:06:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc4d4159400 0x7fc4d4067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4d40675a0 0x7fc4d406a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4067a00 con 0x7fc4d4159030 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d4159880 con 0x7fc4d4159400 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4dbdfb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d406b3f0 con 0x7fc4d40675a0 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4d9396700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc4d4159400 0x7fc4d4067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4d9b97700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc4d4159030 0x7fc4d406d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49624/0 (socket says 172.21.15.3:49624) 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4d9b97700 1 -- 172.21.15.3:0/6597839 learned_addr learned my addr 172.21.15.3:0/6597839 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.535+0000 7fc4da398700 1 --2- 172.21.15.3:0/6597839 >> v2:172.21.15.27:3300/0 conn(0x7fc4d40675a0 0x7fc4d406a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.539+0000 7fc4d9396700 1 -- 172.21.15.3:0/6597839 >> v2:172.21.15.27:3300/0 conn(0x7fc4d40675a0 msgr2=0x7fc4d406a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.539+0000 7fc4d9396700 1 --2- 172.21.15.3:0/6597839 >> v2:172.21.15.27:3300/0 conn(0x7fc4d40675a0 0x7fc4d406a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.539+0000 7fc4d9396700 1 -- 172.21.15.3:0/6597839 >> v1:172.21.15.3:6789/0 conn(0x7fc4d4159030 legacy=0x7fc4d406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.539+0000 7fc4d9396700 1 -- 172.21.15.3:0/6597839 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d406cdb0 con 0x7fc4d4159400 2023-10-08T16:06:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.539+0000 7fc4d9396700 1 --2- 172.21.15.3:0/6597839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d4159400 0x7fc4d4067060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40098e0 tx=0x7fc4c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85209dc12c29b0e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4d8b95700 1 -- 172.21.15.3:0/6597839 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4011630 con 0x7fc4d4159400 2023-10-08T16:06:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4d8b95700 1 -- 172.21.15.3:0/6597839 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4011790 con 0x7fc4d4159400 2023-10-08T16:06:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4d8b95700 1 -- 172.21.15.3:0/6597839 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4011b30 con 0x7fc4d4159400 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/6597839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d4159400 msgr2=0x7fc4d4067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/6597839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d4159400 0x7fc4d4067060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40098e0 tx=0x7fc4c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/6597839 shutdown_connections 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/6597839 >> v2:172.21.15.27:3300/0 conn(0x7fc4d40675a0 0x7fc4d406a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/6597839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d4159400 0x7fc4d4067060 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/6597839 >> 172.21.15.3:0/6597839 conn(0x7fc4d40cbb00 msgr2=0x7fc4d40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/6597839 shutdown_connections 2023-10-08T16:06:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/6597839 wait complete. 2023-10-08T16:06:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 Processor -- start 2023-10-08T16:06:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.543+0000 7fc4dbdfb700 1 -- start start 2023-10-08T16:06:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4dbdfb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 0x7fc4d40af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4dbdfb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4d4159030 0x7fc4d4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4dbdfb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc4d4159400 0x7fc4d40a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4dbdfb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40aefd0 con 0x7fc4d40675a0 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4dbdfb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40b0980 con 0x7fc4d4159030 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4dbdfb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40ae980 con 0x7fc4d4159400 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 0x7fc4d40af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 0x7fc4d40af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33348/0 (socket says 172.21.15.3:33348) 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 -- 172.21.15.3:0/3141635554 learned_addr learned my addr 172.21.15.3:0/3141635554 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9396700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4d4159030 0x7fc4d4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4da398700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc4d4159400 0x7fc4d40a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 -- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc4d4159400 msgr2=0x7fc4d40a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc4d4159400 0x7fc4d40a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 -- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4d4159030 msgr2=0x7fc4d4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4d4159030 0x7fc4d4155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 -- 172.21.15.3:0/3141635554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4009420 con 0x7fc4d40675a0 2023-10-08T16:06:33.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.547+0000 7fc4d9b97700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 0x7fc4d40af460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c7c0 tx=0x7fc4d0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.551+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0005b30 con 0x7fc4d40675a0 2023-10-08T16:06:33.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.551+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0005c90 con 0x7fc4d40675a0 2023-10-08T16:06:33.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.551+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d40aec60 con 0x7fc4d40675a0 2023-10-08T16:06:33.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.551+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0004a80 con 0x7fc4d40675a0 2023-10-08T16:06:33.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.551+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d40b0c60 con 0x7fc4d40675a0 2023-10-08T16:06:33.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.551+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d404be40 con 0x7fc4d40675a0 2023-10-08T16:06:33.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.555+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc4d00070d0 con 0x7fc4d40675a0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.555+0000 7fc4c9ffb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc4b8060550 0x7fc4b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.555+0000 7fc4d9396700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc4b8060550 0x7fc4b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.555+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc4d007c250 con 0x7fc4d40675a0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.559+0000 7fc4d9396700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc4b8060550 0x7fc4b8062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40091e0 tx=0x7fc4c4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.563+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc4d004cb70 con 0x7fc4d40675a0 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.727+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4d40aedf0 con 0x7fc4d40675a0 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4c9ffb700 1 -- 172.21.15.3:0/3141635554 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12031 (secure 0 0 0) 0x7fc4d0021090 con 0x7fc4d40675a0 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":16,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:30.090813+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc4b8060550 msgr2=0x7fc4b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc4b8060550 0x7fc4b8062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40091e0 tx=0x7fc4c4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 msgr2=0x7fc4d40af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 0x7fc4d40af460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c7c0 tx=0x7fc4d0007f70 comp rx=0 tx=0).stop 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 shutdown_connections 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc4b8060550 0x7fc4b8062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc4d4159400 0x7fc4d40a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4d4159030 0x7fc4d4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 --2- 172.21.15.3:0/3141635554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4d40675a0 0x7fc4d40af460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 >> 172.21.15.3:0/3141635554 conn(0x7fc4d40cbb00 msgr2=0x7fc4d4158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 shutdown_connections 2023-10-08T16:06:33.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.731+0000 7fc4dbdfb700 1 -- 172.21.15.3:0/3141635554 wait complete. 2023-10-08T16:06:33.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:06:33.749 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:06:33.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 Processor -- start 2023-10-08T16:06:33.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 -- start start 2023-10-08T16:06:33.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4bec0ad120 0x7f4bec0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 0x7f4bec06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec0c8da0 con 0x7f4bec06cc40 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0cd9c0 con 0x7f4bec0cc280 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0cc700 con 0x7f4bec0ad120 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf0ee5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 0x7f4bec06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf0ee5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 0x7f4bec06c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33356/0 (socket says 172.21.15.3:33356) 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf0ee5700 1 -- 172.21.15.3:0/3425972621 learned_addr learned my addr 172.21.15.3:0/3425972621 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf16e6700 1 --2- 172.21.15.3:0/3425972621 >> v2:172.21.15.27:3300/0 conn(0x7f4bec0ad120 0x7f4bec0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf16e6700 1 -- 172.21.15.3:0/3425972621 >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 msgr2=0x7f4bec06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf16e6700 1 --2- 172.21.15.3:0/3425972621 >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 0x7f4bec06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf16e6700 1 -- 172.21.15.3:0/3425972621 >> v1:172.21.15.27:6789/0 conn(0x7f4bec06cc40 legacy=0x7f4bec0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf16e6700 1 -- 172.21.15.3:0/3425972621 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0cd530 con 0x7f4bec0ad120 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf0ee5700 1 --2- 172.21.15.3:0/3425972621 >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 0x7f4bec06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf16e6700 1 --2- 172.21.15.3:0/3425972621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec0ad120 0x7f4bec0cbd40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bec06bce0 tx=0x7f4be8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df94d24dc8a62a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4be3fff700 1 -- 172.21.15.3:0/3425972621 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8005c10 con 0x7f4bec0ad120 2023-10-08T16:06:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4be3fff700 1 -- 172.21.15.3:0/3425972621 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8005d70 con 0x7f4bec0ad120 2023-10-08T16:06:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4be3fff700 1 -- 172.21.15.3:0/3425972621 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8006260 con 0x7f4bec0ad120 2023-10-08T16:06:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3425972621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec0ad120 msgr2=0x7f4bec0cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3425972621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec0ad120 0x7f4bec0cbd40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bec06bce0 tx=0x7f4be8009120 comp rx=0 tx=0).stop 2023-10-08T16:06:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3425972621 shutdown_connections 2023-10-08T16:06:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3425972621 >> v2:172.21.15.3:3300/0 conn(0x7f4bec0cc280 0x7f4bec06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.859+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3425972621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec0ad120 0x7f4bec0cbd40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3425972621 >> 172.21.15.3:0/3425972621 conn(0x7f4bec0ca5e0 msgr2=0x7f4bec0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3425972621 shutdown_connections 2023-10-08T16:06:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3425972621 wait complete. 2023-10-08T16:06:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 Processor -- start 2023-10-08T16:06:33.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- start start 2023-10-08T16:06:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec06cc40 0x7f4bec155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 0x7f4bec0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4bec0cc280 0x7f4bec0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0b18e0 con 0x7f4bec0ad120 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0b2740 con 0x7f4bec06cc40 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf26e8700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0b2bd0 con 0x7f4bec0cc280 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf0ee5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 0x7f4bec0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf0ee5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 0x7f4bec0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33370/0 (socket says 172.21.15.3:33370) 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf0ee5700 1 -- 172.21.15.3:0/3984122251 learned_addr learned my addr 172.21.15.3:0/3984122251 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf16e6700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec06cc40 0x7f4bec155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.863+0000 7f4bf1ee7700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4bec0cc280 0x7f4bec0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf0ee5700 1 -- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4bec0cc280 msgr2=0x7f4bec0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf0ee5700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4bec0cc280 0x7f4bec0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf0ee5700 1 -- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec06cc40 msgr2=0x7f4bec155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf0ee5700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec06cc40 0x7f4bec155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf0ee5700 1 -- 172.21.15.3:0/3984122251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0094f0 con 0x7f4bec0ad120 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf0ee5700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 0x7f4bec0c7540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00ec80 tx=0x7f4bdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00c850 con 0x7f4bec0ad120 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00c9b0 con 0x7f4bec0ad120 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be80093c0 con 0x7f4bec0ad120 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00cd50 con 0x7f4bec0ad120 2023-10-08T16:06:33.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec0b1e90 con 0x7f4bec0ad120 2023-10-08T16:06:33.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.867+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec0b28d0 con 0x7f4bec0ad120 2023-10-08T16:06:33.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.871+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4bdc013680 con 0x7f4bec0ad120 2023-10-08T16:06:33.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.871+0000 7f4be17fa700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4bd0060550 0x7f4bd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.871+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4bdc07c770 con 0x7f4bec0ad120 2023-10-08T16:06:33.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.871+0000 7f4bf16e6700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4bd0060550 0x7f4bd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.871+0000 7f4bf16e6700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4bd0060550 0x7f4bd0062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4be800a010 tx=0x7f4be8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:33.875+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bdc04d0b0 con 0x7f4bec0ad120 2023-10-08T16:06:34.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.031+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bec04be40 con 0x7f4bec0ad120 2023-10-08T16:06:34.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.031+0000 7f4be17fa700 1 -- 172.21.15.3:0/3984122251 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bdc0506d0 con 0x7f4bec0ad120 2023-10-08T16:06:34.035 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4bd0060550 msgr2=0x7f4bd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4bd0060550 0x7f4bd0062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4be800a010 tx=0x7f4be8016000 comp rx=0 tx=0).stop 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 msgr2=0x7f4bec0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 0x7f4bec0c7540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00ec80 tx=0x7f4bdc009250 comp rx=0 tx=0).stop 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 shutdown_connections 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4bd0060550 0x7f4bd0062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4bec0cc280 0x7f4bec0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bec0ad120 0x7f4bec0c7540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 --2- 172.21.15.3:0/3984122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4bec06cc40 0x7f4bec155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 >> 172.21.15.3:0/3984122251 conn(0x7f4bec0ca5e0 msgr2=0x7f4bec0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 shutdown_connections 2023-10-08T16:06:34.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.035+0000 7f4bf26e8700 1 -- 172.21.15.3:0/3984122251 wait complete. 2023-10-08T16:06:34.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 Processor -- start 2023-10-08T16:06:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 -- start start 2023-10-08T16:06:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c9990 0x7ffb940cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffb94156980 0x7ffb94156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb940ad520 con 0x7ffb940c95c0 2023-10-08T16:06:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb940c9dc0 con 0x7ffb94156980 2023-10-08T16:06:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb98a60700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940ac250 con 0x7ffb940c9990 2023-10-08T16:06:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb937fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ffb940c95c0 0x7ffb940ac630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49628/0 (socket says 172.21.15.3:49628) 2023-10-08T16:06:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb937fe700 1 -- 172.21.15.3:0/1413320568 learned_addr learned my addr 172.21.15.3:0/1413320568 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb92ffd700 1 --2- 172.21.15.3:0/1413320568 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c9990 0x7ffb940cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb93fff700 1 --2- 172.21.15.3:0/1413320568 >> v2:172.21.15.27:3300/0 conn(0x7ffb94156980 0x7ffb94156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb927fc700 1 -- 172.21.15.3:0/1413320568 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557473654 0 0) 0x7ffb940ad520 con 0x7ffb940c95c0 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb927fc700 1 -- 172.21.15.3:0/1413320568 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb80003570 con 0x7ffb940c95c0 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb92ffd700 1 -- 172.21.15.3:0/1413320568 >> v2:172.21.15.27:3300/0 conn(0x7ffb94156980 msgr2=0x7ffb94156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb92ffd700 1 --2- 172.21.15.3:0/1413320568 >> v2:172.21.15.27:3300/0 conn(0x7ffb94156980 0x7ffb94156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb92ffd700 1 -- 172.21.15.3:0/1413320568 >> v1:172.21.15.3:6789/0 conn(0x7ffb940c95c0 legacy=0x7ffb940ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb92ffd700 1 -- 172.21.15.3:0/1413320568 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940aef80 con 0x7ffb940c9990 2023-10-08T16:06:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.155+0000 7ffb92ffd700 1 --2- 172.21.15.3:0/1413320568 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c9990 0x7ffb940cbb20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009910 tx=0x7ffb7c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24050164f929be71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb927fc700 1 -- 172.21.15.3:0/1413320568 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c011630 con 0x7ffb940c9990 2023-10-08T16:06:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb927fc700 1 -- 172.21.15.3:0/1413320568 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c011790 con 0x7ffb940c9990 2023-10-08T16:06:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb927fc700 1 -- 172.21.15.3:0/1413320568 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c011b30 con 0x7ffb940c9990 2023-10-08T16:06:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 -- 172.21.15.3:0/1413320568 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c9990 msgr2=0x7ffb940cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1413320568 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c9990 0x7ffb940cbb20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009910 tx=0x7ffb7c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 -- 172.21.15.3:0/1413320568 shutdown_connections 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1413320568 >> v2:172.21.15.27:3300/0 conn(0x7ffb94156980 0x7ffb94156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1413320568 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c9990 0x7ffb940cbb20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 -- 172.21.15.3:0/1413320568 >> 172.21.15.3:0/1413320568 conn(0x7ffb9406b6b0 msgr2=0x7ffb9406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 -- 172.21.15.3:0/1413320568 shutdown_connections 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 -- 172.21.15.3:0/1413320568 wait complete. 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 Processor -- start 2023-10-08T16:06:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.159+0000 7ffb98a60700 1 -- start start 2023-10-08T16:06:34.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c95c0 0x7ffb940ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb940c9990 0x7ffb9415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 0x7ffb94167060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb941684b0 con 0x7ffb94156980 2023-10-08T16:06:34.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb941681d0 con 0x7ffb940c9990 2023-10-08T16:06:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9415b620 con 0x7ffb940c95c0 2023-10-08T16:06:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 0x7ffb94167060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 0x7ffb94167060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33386/0 (socket says 172.21.15.3:33386) 2023-10-08T16:06:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb940c9990 0x7ffb9415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb937fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c95c0 0x7ffb940ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb93fff700 1 -- 172.21.15.3:0/1368584305 learned_addr learned my addr 172.21.15.3:0/1368584305 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:34.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 -- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c95c0 msgr2=0x7ffb940ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c95c0 0x7ffb940ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 -- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 msgr2=0x7ffb94167060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 0x7ffb94167060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 -- 172.21.15.3:0/1368584305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009420 con 0x7ffb940c9990 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb93fff700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 0x7ffb94167060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb92ffd700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb940c9990 0x7ffb9415abf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c016000 tx=0x7ffb7c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c011900 con 0x7ffb940c9990 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c011a60 con 0x7ffb940c9990 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9415b900 con 0x7ffb940c9990 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c025640 con 0x7ffb940c9990 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb941556d0 con 0x7ffb940c9990 2023-10-08T16:06:34.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.163+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb94168660 con 0x7ffb940c9990 2023-10-08T16:06:34.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.167+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffb7c0193b0 con 0x7ffb940c9990 2023-10-08T16:06:34.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.167+0000 7ffb8b7fe700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ffb74060550 0x7ffb74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.167+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffb7c07dd00 con 0x7ffb940c9990 2023-10-08T16:06:34.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.167+0000 7ffb937fe700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ffb74060550 0x7ffb74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.167+0000 7ffb937fe700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ffb74060550 0x7ffb74062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c005c50 tx=0x7ffb8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:34.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.179+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffb94168660 con 0x7ffb940c9990 2023-10-08T16:06:34.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.375+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb94168660 con 0x7ffb940c9990 2023-10-08T16:06:34.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.375+0000 7ffb8b7fe700 1 -- 172.21.15.3:0/1368584305 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1250 (secure 0 0 0) 0x7ffb94168660 con 0x7ffb940c9990 2023-10-08T16:06:34.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:34.381 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-08T16:06:34.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ffb74060550 msgr2=0x7ffb74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ffb74060550 0x7ffb74062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c005c50 tx=0x7ffb8c009040 comp rx=0 tx=0).stop 2023-10-08T16:06:34.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb940c9990 msgr2=0x7ffb9415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb940c9990 0x7ffb9415abf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c016000 tx=0x7ffb7c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:34.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 shutdown_connections 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ffb74060550 0x7ffb74062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb94156980 0x7ffb94167060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb940c9990 0x7ffb9415abf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 --2- 172.21.15.3:0/1368584305 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ffb940c95c0 0x7ffb940ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 >> 172.21.15.3:0/1368584305 conn(0x7ffb9406b6b0 msgr2=0x7ffb940cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 shutdown_connections 2023-10-08T16:06:34.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:34.379+0000 7ffb98a60700 1 -- 172.21.15.3:0/1368584305 wait complete. 2023-10-08T16:06:34.386 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 2 2023-10-08T16:06:36.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:36.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.515+0000 7f0892e6f700 1 Processor -- start 2023-10-08T16:06:36.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.515+0000 7f0892e6f700 1 -- start start 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.515+0000 7f0892e6f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f088c15d1e0 0x7f088c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.515+0000 7f0892e6f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c067a60 con 0x7f088c15ce10 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.515+0000 7f0892e6f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c067d40 con 0x7f088c0675f0 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.515+0000 7f0892e6f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c068020 con 0x7f088c15d1e0 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0891e6d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f088c15ce10 0x7f088c068b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49640/0 (socket says 172.21.15.3:49640) 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0891e6d700 1 -- 172.21.15.3:0/957000844 learned_addr learned my addr 172.21.15.3:0/957000844 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:36.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f089266e700 1 --2- 172.21.15.3:0/957000844 >> v2:172.21.15.3:3300/0 conn(0x7f088c15d1e0 0x7f088c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0890e6b700 1 -- 172.21.15.3:0/957000844 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705774924 0 0) 0x7f088c067a60 con 0x7f088c15ce10 2023-10-08T16:06:36.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0890e6b700 1 -- 172.21.15.3:0/957000844 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0874003570 con 0x7f088c15ce10 2023-10-08T16:06:36.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f089266e700 1 -- 172.21.15.3:0/957000844 >> v1:172.21.15.27:6789/0 conn(0x7f088c0675f0 legacy=0x7f088c0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0890e6b700 1 -- 172.21.15.3:0/957000844 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055055331 0 0) 0x7f088c067d40 con 0x7f088c0675f0 2023-10-08T16:06:36.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f089266e700 1 -- 172.21.15.3:0/957000844 >> v1:172.21.15.3:6789/0 conn(0x7f088c15ce10 legacy=0x7f088c068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f089266e700 1 -- 172.21.15.3:0/957000844 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c068300 con 0x7f088c15d1e0 2023-10-08T16:06:36.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f089266e700 1 --2- 172.21.15.3:0/957000844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c15d1e0 0x7f088c1589a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08840098e0 tx=0x7f08840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d915fe66018d2aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:36.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0890e6b700 1 -- 172.21.15.3:0/957000844 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400b640 con 0x7f088c15d1e0 2023-10-08T16:06:36.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0890e6b700 1 -- 172.21.15.3:0/957000844 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088400b7a0 con 0x7f088c15d1e0 2023-10-08T16:06:36.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0890e6b700 1 -- 172.21.15.3:0/957000844 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400bb40 con 0x7f088c15d1e0 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 -- 172.21.15.3:0/957000844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c15d1e0 msgr2=0x7f088c1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 --2- 172.21.15.3:0/957000844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c15d1e0 0x7f088c1589a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08840098e0 tx=0x7f08840091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 -- 172.21.15.3:0/957000844 shutdown_connections 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 --2- 172.21.15.3:0/957000844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c15d1e0 0x7f088c1589a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 -- 172.21.15.3:0/957000844 >> 172.21.15.3:0/957000844 conn(0x7f088c0cdb50 msgr2=0x7f088c0cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 -- 172.21.15.3:0/957000844 shutdown_connections 2023-10-08T16:06:36.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.519+0000 7f0892e6f700 1 -- 172.21.15.3:0/957000844 wait complete. 2023-10-08T16:06:36.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 Processor -- start 2023-10-08T16:06:36.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 -- start start 2023-10-08T16:06:36.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 0x7f088c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c15ce10 0x7f088c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f088c15d1e0 0x7f088c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0c7970 con 0x7f088c0675f0 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0c7c50 con 0x7f088c15ce10 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0892e6f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15a180 con 0x7f088c15d1e0 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.523+0000 7f0891e6d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 0x7f088c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 0x7f088c154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33406/0 (socket says 172.21.15.3:33406) 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 -- 172.21.15.3:0/2729646789 learned_addr learned my addr 172.21.15.3:0/2729646789 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f089266e700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f088c15d1e0 0x7f088c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f089166c700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c15ce10 0x7f088c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 -- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f088c15d1e0 msgr2=0x7f088c0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f088c15d1e0 0x7f088c0caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 -- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c15ce10 msgr2=0x7f088c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c15ce10 0x7f088c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 -- 172.21.15.3:0/2729646789 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884009420 con 0x7f088c0675f0 2023-10-08T16:06:36.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f089166c700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c15ce10 0x7f088c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:36.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0891e6d700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 0x7f088c154b00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f087c00cd00 tx=0x7f087c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:36.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00ce60 con 0x7f088c0675f0 2023-10-08T16:06:36.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c00ab10 con 0x7f088c0675f0 2023-10-08T16:06:36.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c15a460 con 0x7f088c0675f0 2023-10-08T16:06:36.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c0c7610 con 0x7f088c0675f0 2023-10-08T16:06:36.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0070f0 con 0x7f088c0675f0 2023-10-08T16:06:36.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c168b70 con 0x7f088c0675f0 2023-10-08T16:06:36.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.527+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f087c007460 con 0x7f088c0675f0 2023-10-08T16:06:36.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.531+0000 7f0889ffb700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0878060550 0x7f0878062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.531+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f087c07c910 con 0x7f088c0675f0 2023-10-08T16:06:36.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.531+0000 7f089166c700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0878060550 0x7f0878062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.531+0000 7f089166c700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0878060550 0x7f0878062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c8450 tx=0x7f0880009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.539+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f088c168b70 con 0x7f088c0675f0 2023-10-08T16:06:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f088c168b70 con 0x7f088c0675f0 2023-10-08T16:06:36.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0889ffb700 1 -- 172.21.15.3:0/2729646789 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3509 (secure 0 0 0) 0x7f088c168b70 con 0x7f088c0675f0 2023-10-08T16:06:36.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:36.854 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0878060550 msgr2=0x7f0878062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0878060550 0x7f0878062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c8450 tx=0x7f0880009040 comp rx=0 tx=0).stop 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 msgr2=0x7f088c154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 0x7f088c154b00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f087c00cd00 tx=0x7f087c001b00 comp rx=0 tx=0).stop 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 shutdown_connections 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0878060550 0x7f0878062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f088c15d1e0 0x7f088c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c15ce10 0x7f088c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 --2- 172.21.15.3:0/2729646789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c0675f0 0x7f088c154b00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 >> 172.21.15.3:0/2729646789 conn(0x7f088c0cdb50 msgr2=0x7f088c1561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 shutdown_connections 2023-10-08T16:06:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.743+0000 7f0892e6f700 1 -- 172.21.15.3:0/2729646789 wait complete. 2023-10-08T16:06:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 3 2023-10-08T16:06:36.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:36.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.967+0000 7fe4df59e700 1 Processor -- start 2023-10-08T16:06:36.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.967+0000 7fe4df59e700 1 -- start start 2023-10-08T16:06:36.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4df59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe4e0155e20 0x7fe4e00c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4df59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e00c16b0 con 0x7fe4e015a3a0 2023-10-08T16:06:36.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4df59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e00c8710 con 0x7fe4e006e4d0 2023-10-08T16:06:36.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4df59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e00c1060 con 0x7fe4e0155e20 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ddd9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe4e015a3a0 0x7fe4e006ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49648/0 (socket says 172.21.15.3:49648) 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ddd9b700 1 -- 172.21.15.3:0/1102506330 learned_addr learned my addr 172.21.15.3:0/1102506330 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4de59c700 1 --2- 172.21.15.3:0/1102506330 >> v2:172.21.15.27:3300/0 conn(0x7fe4e0155e20 0x7fe4e00c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632107536 0 0) 0x7fe4e00c16b0 con 0x7fe4e015a3a0 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c8003570 con 0x7fe4e015a3a0 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4116619773 0 0) 0x7fe4c8003570 con 0x7fe4e015a3a0 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 >> v2:172.21.15.27:3300/0 conn(0x7fe4e0155e20 msgr2=0x7fe4e00c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 --2- 172.21.15.3:0/1102506330 >> v2:172.21.15.27:3300/0 conn(0x7fe4e0155e20 0x7fe4e00c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 >> v1:172.21.15.27:6789/0 conn(0x7fe4e006e4d0 legacy=0x7fe4e00c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00c1340 con 0x7fe4e015a3a0 2023-10-08T16:06:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fe4d0001470 con 0x7fe4e015a3a0 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 >> v1:172.21.15.3:6789/0 conn(0x7fe4e015a3a0 legacy=0x7fe4e006ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c8003a60 0x7fe4c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8004810 0x7fe4c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4c80051c0 0x7fe4c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00c1060 con 0x7fe4c80051c0 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c800c050 con 0x7fe4c8004810 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c800c210 con 0x7fe4c8003a60 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4c80051c0 0x7fe4c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4de59c700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c8003a60 0x7fe4c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ddd9b700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8004810 0x7fe4c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 -- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c8003a60 msgr2=0x7fe4c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c8003a60 0x7fe4c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 -- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8004810 msgr2=0x7fe4c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8004810 0x7fe4c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 -- 172.21.15.3:0/1102506330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8003570 con 0x7fe4c80051c0 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ddd9b700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8004810 0x7fe4c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 -- 172.21.15.3:0/1102506330 reap_dead start 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4ded9d700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4c80051c0 0x7fe4c800ba60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8002170 tx=0x7fe4d80017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3813c33b529e9e85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8001ae0 con 0x7fe4c80051c0 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800c940 con 0x7fe4c80051c0 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.971+0000 7fe4dd59a700 1 -- 172.21.15.3:0/1102506330 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800cd20 con 0x7fe4c80051c0 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 -- 172.21.15.3:0/1102506330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4c80051c0 msgr2=0x7fe4c800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4c80051c0 0x7fe4c800ba60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8002170 tx=0x7fe4d80017d0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 -- 172.21.15.3:0/1102506330 shutdown_connections 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 --2- 172.21.15.3:0/1102506330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4c80051c0 0x7fe4c800ba60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 -- 172.21.15.3:0/1102506330 >> 172.21.15.3:0/1102506330 conn(0x7fe4e00c8c90 msgr2=0x7fe4e00c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 -- 172.21.15.3:0/1102506330 shutdown_connections 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 -- 172.21.15.3:0/1102506330 wait complete. 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 Processor -- start 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.975+0000 7fe4df59e700 1 -- start start 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c80051c0 0x7fe4e014b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 0x7fe4e0068280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4e014cb40 0x7fe4e00687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e014b9a0 con 0x7fe4e014c6d0 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e014c240 con 0x7fe4e014cb40 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e014fd10 con 0x7fe4c80051c0 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 0x7fe4e0068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 0x7fe4e0068280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33416/0 (socket says 172.21.15.3:33416) 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 -- 172.21.15.3:0/933935620 learned_addr learned my addr 172.21.15.3:0/933935620 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4de59c700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c80051c0 0x7fe4e014b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ded9d700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4e014cb40 0x7fe4e00687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 -- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c80051c0 msgr2=0x7fe4e014b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c80051c0 0x7fe4e014b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 -- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4e014cb40 msgr2=0x7fe4e00687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4e014cb40 0x7fe4e00687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 -- 172.21.15.3:0/933935620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e014bbf0 con 0x7fe4e014c6d0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4de59c700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c80051c0 0x7fe4e014b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ddd9b700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 0x7fe4e0068280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000e780 tx=0x7fe4d0000c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0010490 con 0x7fe4e014c6d0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0010040 con 0x7fe4e014c6d0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e014bed0 con 0x7fe4e014c6d0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0010820 con 0x7fe4e014c6d0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.979+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e01505e0 con 0x7fe4e014c6d0 2023-10-08T16:06:36.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.983+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e004be40 con 0x7fe4e014c6d0 2023-10-08T16:06:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.983+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe4d0010bd0 con 0x7fe4e014c6d0 2023-10-08T16:06:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.983+0000 7fe4ce7fc700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe4c0060550 0x7fe4c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.983+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe4d007b660 con 0x7fe4e014c6d0 2023-10-08T16:06:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.983+0000 7fe4de59c700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe4c0060550 0x7fe4c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.983+0000 7fe4de59c700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe4c0060550 0x7fe4c0062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:36.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:36.991+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4d004bfb0 con 0x7fe4e014c6d0 2023-10-08T16:06:37.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.155+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4e014c380 con 0x7fe4e014c6d0 2023-10-08T16:06:37.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4ce7fc700 1 -- 172.21.15.3:0/933935620 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12031 (secure 0 0 0) 0x7fe4d0019090 con 0x7fe4e014c6d0 2023-10-08T16:06:37.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:37.162 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":16,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:30.090813+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:37.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe4c0060550 msgr2=0x7fe4c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe4c0060550 0x7fe4c0062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d4008040 comp rx=0 tx=0).stop 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 msgr2=0x7fe4e0068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 0x7fe4e0068280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000e780 tx=0x7fe4d0000c50 comp rx=0 tx=0).stop 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 shutdown_connections 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe4c0060550 0x7fe4c0062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4e014cb40 0x7fe4e00687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4e014c6d0 0x7fe4e0068280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 --2- 172.21.15.3:0/933935620 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe4c80051c0 0x7fe4e014b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 >> 172.21.15.3:0/933935620 conn(0x7fe4e00c8c90 msgr2=0x7fe4e0154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 shutdown_connections 2023-10-08T16:06:37.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.159+0000 7fe4df59e700 1 -- 172.21.15.3:0/933935620 wait complete. 2023-10-08T16:06:37.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:06:37.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:06:37.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 Processor -- start 2023-10-08T16:06:37.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- start start 2023-10-08T16:06:37.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7facf4158c80 0x7facf415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf40b45a0 con 0x7facf40b37c0 2023-10-08T16:06:37.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf415a060 con 0x7facf4158c80 2023-10-08T16:06:37.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf406a3a0 con 0x7facf406db60 2023-10-08T16:06:37.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7facf4158c80 0x7facf415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf8bbf700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7facf40b37c0 0x7facf406c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49662/0 (socket says 172.21.15.3:49662) 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf8bbf700 1 -- 172.21.15.3:0/795701433 learned_addr learned my addr 172.21.15.3:0/795701433 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf37fe700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf2ffd700 1 -- 172.21.15.3:0/795701433 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869376057 0 0) 0x7facf40b45a0 con 0x7facf40b37c0 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf3fff700 1 -- 172.21.15.3:0/795701433 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 msgr2=0x7facf406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf3fff700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf406b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf3fff700 1 -- 172.21.15.3:0/795701433 >> v1:172.21.15.3:6789/0 conn(0x7facf40b37c0 legacy=0x7facf406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf3fff700 1 -- 172.21.15.3:0/795701433 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf406a680 con 0x7facf4158c80 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf37fe700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf406b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf3fff700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf415d4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7face80098e0 tx=0x7face80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb00c0dff0ed2dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf2ffd700 1 -- 172.21.15.3:0/795701433 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8009e80 con 0x7facf4158c80 2023-10-08T16:06:37.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf2ffd700 1 -- 172.21.15.3:0/795701433 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face800b860 con 0x7facf4158c80 2023-10-08T16:06:37.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf2ffd700 1 -- 172.21.15.3:0/795701433 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face800bbe0 con 0x7facf4158c80 2023-10-08T16:06:37.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- 172.21.15.3:0/795701433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 msgr2=0x7facf415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf415d4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7face80098e0 tx=0x7face80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- 172.21.15.3:0/795701433 shutdown_connections 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf406b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 --2- 172.21.15.3:0/795701433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf415d4c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- 172.21.15.3:0/795701433 >> 172.21.15.3:0/795701433 conn(0x7facf40d0820 msgr2=0x7facf40b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- 172.21.15.3:0/795701433 shutdown_connections 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.291+0000 7facf93c0700 1 -- 172.21.15.3:0/795701433 wait complete. 2023-10-08T16:06:37.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 Processor -- start 2023-10-08T16:06:37.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 -- start start 2023-10-08T16:06:37.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf4166700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf40b37c0 0x7facf4169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4169a80 con 0x7facf4158c80 2023-10-08T16:06:37.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf416ac10 con 0x7facf40b37c0 2023-10-08T16:06:37.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf93c0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf416a000 con 0x7facf406db60 2023-10-08T16:06:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf4166700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33434/0 (socket says 172.21.15.3:33434) 2023-10-08T16:06:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 -- 172.21.15.3:0/2452005428 learned_addr learned my addr 172.21.15.3:0/2452005428 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf37fe700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf40b37c0 0x7facf4169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 -- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 msgr2=0x7facf4166700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf4166700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 -- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf40b37c0 msgr2=0x7facf4169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.295+0000 7facf8bbf700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf40b37c0 0x7facf4169540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf8bbf700 1 -- 172.21.15.3:0/2452005428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8009420 con 0x7facf4158c80 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf8bbf700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf413ee90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7facec00cc90 tx=0x7facec001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00a8b0 con 0x7facf4158c80 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec00aa10 con 0x7facf4158c80 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00add0 con 0x7facf4158c80 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf416a2e0 con 0x7facf4158c80 2023-10-08T16:06:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf416a8a0 con 0x7facf4158c80 2023-10-08T16:06:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf416ada0 con 0x7facf4158c80 2023-10-08T16:06:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7facec007300 con 0x7facf4158c80 2023-10-08T16:06:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facdbfff700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7face0060580 0x7face0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7facec07c760 con 0x7facf4158c80 2023-10-08T16:06:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf3fff700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7face0060580 0x7face0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.299+0000 7facf3fff700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7face0060580 0x7face0062a30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7face80091e0 tx=0x7face8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.307+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7facec04d120 con 0x7facf4158c80 2023-10-08T16:06:37.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.467+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facf404be40 con 0x7facf4158c80 2023-10-08T16:06:37.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.467+0000 7facdbfff700 1 -- 172.21.15.3:0/2452005428 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7facec050740 con 0x7facf4158c80 2023-10-08T16:06:37.470 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7face0060580 msgr2=0x7face0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7face0060580 0x7face0062a30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7face80091e0 tx=0x7face8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 msgr2=0x7facf413ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf413ee90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7facec00cc90 tx=0x7facec001a80 comp rx=0 tx=0).stop 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 shutdown_connections 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7face0060580 0x7face0062a30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facf4158c80 0x7facf413ee90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf40b37c0 0x7facf4169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 --2- 172.21.15.3:0/2452005428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7facf406db60 0x7facf4166700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 >> 172.21.15.3:0/2452005428 conn(0x7facf40d0820 msgr2=0x7facf41598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:37.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 shutdown_connections 2023-10-08T16:06:37.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.471+0000 7facf93c0700 1 -- 172.21.15.3:0/2452005428 wait complete. 2023-10-08T16:06:37.490 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:06:37.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 Processor -- start 2023-10-08T16:06:37.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 -- start start 2023-10-08T16:06:37.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f01240ade60 0x7f01240cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 0x7f01240cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01241562c0 con 0x7f01240c7660 2023-10-08T16:06:37.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012406b0b0 con 0x7f01240ade60 2023-10-08T16:06:37.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0123fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012406b390 con 0x7f01240ae230 2023-10-08T16:06:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0122ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f01240ade60 0x7f01240cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f01227fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 0x7f01240cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f01227fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 0x7f01240cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:39608/0 (socket says 172.21.15.3:39608) 2023-10-08T16:06:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f01237fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f01240c7660 0x7f01240c7b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:38328/0 (socket says 172.21.15.3:38328) 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f0122ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f01240ade60 0x7f01240cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:46338/0 (socket says 172.21.15.3:46338) 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.591+0000 7f01227fc700 1 -- 172.21.15.3:0/3019386037 learned_addr learned my addr 172.21.15.3:0/3019386037 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f01227fc700 1 -- 172.21.15.3:0/3019386037 >> v2:172.21.15.27:3300/0 conn(0x7f01240ade60 msgr2=0x7f01240cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f01227fc700 1 --2- 172.21.15.3:0/3019386037 >> v2:172.21.15.27:3300/0 conn(0x7f01240ade60 0x7f01240cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f01227fc700 1 -- 172.21.15.3:0/3019386037 >> v1:172.21.15.27:6789/0 conn(0x7f01240c7660 legacy=0x7f01240c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f01227fc700 1 -- 172.21.15.3:0/3019386037 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012406b670 con 0x7f01240ae230 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f01227fc700 1 --2- 172.21.15.3:0/3019386037 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 0x7f01240cb390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f010c009f20 tx=0x7f010c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f024dc304a4407 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0121ffb700 1 -- 172.21.15.3:0/3019386037 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00e070 con 0x7f01240ae230 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0121ffb700 1 -- 172.21.15.3:0/3019386037 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c00b9d0 con 0x7f01240ae230 2023-10-08T16:06:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0121ffb700 1 -- 172.21.15.3:0/3019386037 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c0092e0 con 0x7f01240ae230 2023-10-08T16:06:37.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 -- 172.21.15.3:0/3019386037 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 msgr2=0x7f01240cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 --2- 172.21.15.3:0/3019386037 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 0x7f01240cb390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f010c009f20 tx=0x7f010c009840 comp rx=0 tx=0).stop 2023-10-08T16:06:37.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 -- 172.21.15.3:0/3019386037 shutdown_connections 2023-10-08T16:06:37.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 --2- 172.21.15.3:0/3019386037 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ae230 0x7f01240cb390 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 --2- 172.21.15.3:0/3019386037 >> v2:172.21.15.27:3300/0 conn(0x7f01240ade60 0x7f01240cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 -- 172.21.15.3:0/3019386037 >> 172.21.15.3:0/3019386037 conn(0x7f01240c83d0 msgr2=0x7f01240c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:37.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 -- 172.21.15.3:0/3019386037 shutdown_connections 2023-10-08T16:06:37.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.595+0000 7f0123fff700 1 -- 172.21.15.3:0/3019386037 wait complete. 2023-10-08T16:06:37.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 Processor -- start 2023-10-08T16:06:37.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 -- start start 2023-10-08T16:06:37.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ade60 0x7f0124158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01240ae230 0x7f0124156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 0x7f01241572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01240c5840 con 0x7f01240c7660 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01241568f0 con 0x7f01240ae230 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0123fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01240b0d50 con 0x7f01240ade60 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 0x7f01241572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 0x7f01241572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33436/0 (socket says 172.21.15.3:33436) 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 -- 172.21.15.3:0/3881273629 learned_addr learned my addr 172.21.15.3:0/3881273629 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01227fc700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01240ae230 0x7f0124156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f0122ffd700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ade60 0x7f0124158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 -- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ade60 msgr2=0x7f0124158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ade60 0x7f0124158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 -- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01240ae230 msgr2=0x7f0124156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01240ae230 0x7f0124156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 -- 172.21.15.3:0/3881273629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c009ae0 con 0x7f01240c7660 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.599+0000 7f01237fe700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 0x7f01241572c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c7f0 tx=0x7f011c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c005a70 con 0x7f01240c7660 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c005bf0 con 0x7f01240c7660 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0124158a50 con 0x7f01240c7660 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0070d0 con 0x7f01240c7660 2023-10-08T16:06:37.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01240c5280 con 0x7f01240c7660 2023-10-08T16:06:37.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012404be40 con 0x7f01240c7660 2023-10-08T16:06:37.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f011c007440 con 0x7f01240c7660 2023-10-08T16:06:37.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f011affd700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0104060550 0x7f0104062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.603+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f011c07b8a0 con 0x7f01240c7660 2023-10-08T16:06:37.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.607+0000 7f0122ffd700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0104060550 0x7f0104062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.607+0000 7f0122ffd700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0104060550 0x7f0104062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01240c5a10 tx=0x7f01140091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.615+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f011c04c1e0 con 0x7f01240c7660 2023-10-08T16:06:37.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.779+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f01240c6c40 con 0x7f01240c7660 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f011affd700 1 -- 172.21.15.3:0/3881273629 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f011c04f800 con 0x7f01240c7660 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T16:06:37.785 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:06:37.786 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T16:06:37.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0104060550 msgr2=0x7f0104062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0104060550 0x7f0104062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01240c5a10 tx=0x7f01140091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 msgr2=0x7f01241572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 0x7f01241572c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c7f0 tx=0x7f011c007eb0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 shutdown_connections 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0104060550 0x7f0104062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01240c7660 0x7f01241572c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01240ae230 0x7f0124156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 --2- 172.21.15.3:0/3881273629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01240ade60 0x7f0124158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 >> 172.21.15.3:0/3881273629 conn(0x7f01240c83d0 msgr2=0x7f0124150540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 shutdown_connections 2023-10-08T16:06:37.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.783+0000 7f0123fff700 1 -- 172.21.15.3:0/3881273629 wait complete. 2023-10-08T16:06:37.799 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:06:37.800 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:06:37.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 Processor -- start 2023-10-08T16:06:37.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 -- start start 2023-10-08T16:06:37.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 0x7f755c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0cbed0 0x7f755c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0c8c50 con 0x7f755c0ad0a0 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c156ff0 con 0x7f755c0accd0 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755bfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c06d650 con 0x7f755c0cbed0 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 0x7f755c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f755c0ad0a0 0x7f755c069270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49676/0 (socket says 172.21.15.3:49676) 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755b7fe700 1 -- 172.21.15.3:0/311381363 learned_addr learned my addr 172.21.15.3:0/311381363 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 0x7f755c06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33438/0 (socket says 172.21.15.3:33438) 2023-10-08T16:06:37.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.919+0000 7f755a7fc700 1 --2- 172.21.15.3:0/311381363 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0cbed0 0x7f755c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f7559ffb700 1 -- 172.21.15.3:0/311381363 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320521299 0 0) 0x7f755c0c8c50 con 0x7f755c0ad0a0 2023-10-08T16:06:37.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f7559ffb700 1 -- 172.21.15.3:0/311381363 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7548003570 con 0x7f755c0ad0a0 2023-10-08T16:06:37.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755a7fc700 1 -- 172.21.15.3:0/311381363 >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 msgr2=0x7f755c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755a7fc700 1 --2- 172.21.15.3:0/311381363 >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 0x7f755c06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755a7fc700 1 -- 172.21.15.3:0/311381363 >> v1:172.21.15.3:6789/0 conn(0x7f755c0ad0a0 legacy=0x7f755c069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755a7fc700 1 -- 172.21.15.3:0/311381363 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0cd940 con 0x7f755c0cbed0 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755affd700 1 --2- 172.21.15.3:0/311381363 >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 0x7f755c06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755a7fc700 1 --2- 172.21.15.3:0/311381363 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0cbed0 0x7f755c0cd400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f754c0098e0 tx=0x7f754c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdffa0cb3b2f6d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f7559ffb700 1 -- 172.21.15.3:0/311381363 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c011630 con 0x7f755c0cbed0 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f7559ffb700 1 -- 172.21.15.3:0/311381363 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c011790 con 0x7f755c0cbed0 2023-10-08T16:06:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f7559ffb700 1 -- 172.21.15.3:0/311381363 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c011b30 con 0x7f755c0cbed0 2023-10-08T16:06:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 -- 172.21.15.3:0/311381363 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0cbed0 msgr2=0x7f755c0cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 --2- 172.21.15.3:0/311381363 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0cbed0 0x7f755c0cd400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f754c0098e0 tx=0x7f754c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 -- 172.21.15.3:0/311381363 shutdown_connections 2023-10-08T16:06:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 --2- 172.21.15.3:0/311381363 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0cbed0 0x7f755c0cd400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 --2- 172.21.15.3:0/311381363 >> v2:172.21.15.3:3300/0 conn(0x7f755c0accd0 0x7f755c06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 -- 172.21.15.3:0/311381363 >> 172.21.15.3:0/311381363 conn(0x7f755c0cdb50 msgr2=0x7f755c0cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 -- 172.21.15.3:0/311381363 shutdown_connections 2023-10-08T16:06:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.923+0000 7f755bfff700 1 -- 172.21.15.3:0/311381363 wait complete. 2023-10-08T16:06:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 Processor -- start 2023-10-08T16:06:37.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 -- start start 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0accd0 0x7f755c0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c0ad0a0 0x7f755c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 0x7f755c0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0c5100 con 0x7f755c0cbed0 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0b2d80 con 0x7f755c0ad0a0 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0b3060 con 0x7f755c0accd0 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 0x7f755c0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 0x7f755c0c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33454/0 (socket says 172.21.15.3:33454) 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 -- 172.21.15.3:0/627654521 learned_addr learned my addr 172.21.15.3:0/627654521 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:37.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755affd700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0accd0 0x7f755c0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755a7fc700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c0ad0a0 0x7f755c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 -- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0accd0 msgr2=0x7f755c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0accd0 0x7f755c0b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 -- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c0ad0a0 msgr2=0x7f755c152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c0ad0a0 0x7f755c152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 -- 172.21.15.3:0/627654521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009420 con 0x7f755c0cbed0 2023-10-08T16:06:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755b7fe700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 0x7f755c0c7610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f755400cc40 tx=0x7f7554001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400a9c0 con 0x7f755c0cbed0 2023-10-08T16:06:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755400ab20 con 0x7f755c0cbed0 2023-10-08T16:06:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400aea0 con 0x7f755c0cbed0 2023-10-08T16:06:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c009420 con 0x7f755c0cbed0 2023-10-08T16:06:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.927+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c0b3340 con 0x7f755c0cbed0 2023-10-08T16:06:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.931+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c0c55a0 con 0x7f755c0cbed0 2023-10-08T16:06:37.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.931+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7554007300 con 0x7f755c0cbed0 2023-10-08T16:06:37.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.931+0000 7f7552ffd700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f753c060580 0x7f753c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:37.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.931+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f755407d400 con 0x7f755c0cbed0 2023-10-08T16:06:37.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.931+0000 7f755affd700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f753c060580 0x7f753c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:37.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.935+0000 7f755affd700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f753c060580 0x7f753c062a30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75440093f0 tx=0x7f7544008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:37.939+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f755404dda0 con 0x7f755c0cbed0 2023-10-08T16:06:38.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.099+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f755c04be40 con 0x7f755c0cbed0 2023-10-08T16:06:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.259+0000 7f7552ffd700 1 -- 172.21.15.3:0/627654521 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f75540513c0 con 0x7f755c0cbed0 2023-10-08T16:06:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f753c060580 msgr2=0x7f753c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f753c060580 0x7f753c062a30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75440093f0 tx=0x7f7544008040 comp rx=0 tx=0).stop 2023-10-08T16:06:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 msgr2=0x7f755c0c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 0x7f755c0c7610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f755400cc40 tx=0x7f7554001aa0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 shutdown_connections 2023-10-08T16:06:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f753c060580 0x7f753c062a30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f755c0cbed0 0x7f755c0c7610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c0ad0a0 0x7f755c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 --2- 172.21.15.3:0/627654521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f755c0accd0 0x7f755c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 >> 172.21.15.3:0/627654521 conn(0x7f755c0cdb50 msgr2=0x7f755c156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 shutdown_connections 2023-10-08T16:06:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.267+0000 7f755bfff700 1 -- 172.21.15.3:0/627654521 wait complete. 2023-10-08T16:06:38.273 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T16:06:38.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:06:38.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 Processor -- start 2023-10-08T16:06:38.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 -- start start 2023-10-08T16:06:38.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb880158f00 0x7fb88015d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8800cb400 0x7fb88006a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88015a390 con 0x7fb8801592d0 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8800b2940 con 0x7fb8800cb400 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb887184700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88015db80 con 0x7fb880158f00 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.395+0000 7fb886983700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8800cb400 0x7fb88006a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8800cb400 0x7fb88006a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33458/0 (socket says 172.21.15.3:33458) 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 -- 172.21.15.3:0/3928602959 learned_addr learned my addr 172.21.15.3:0/3928602959 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:38.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886182700 1 --2- 172.21.15.3:0/3928602959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb880158f00 0x7fb88015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 -- 172.21.15.3:0/3928602959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb880158f00 msgr2=0x7fb88015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 --2- 172.21.15.3:0/3928602959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb880158f00 0x7fb88015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 -- 172.21.15.3:0/3928602959 >> v1:172.21.15.27:6789/0 conn(0x7fb8801592d0 legacy=0x7fb8800cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 -- 172.21.15.3:0/3928602959 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8801597c0 con 0x7fb8800cb400 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb886983700 1 --2- 172.21.15.3:0/3928602959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8800cb400 0x7fb88006a3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb878009f20 tx=0x7fb878009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7349ba4a0dd9849 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb885180700 1 -- 172.21.15.3:0/3928602959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800e070 con 0x7fb8800cb400 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb885180700 1 -- 172.21.15.3:0/3928602959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800ba80 con 0x7fb8800cb400 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb885180700 1 -- 172.21.15.3:0/3928602959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780092e0 con 0x7fb8800cb400 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 -- 172.21.15.3:0/3928602959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8800cb400 msgr2=0x7fb88006a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:38.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 --2- 172.21.15.3:0/3928602959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8800cb400 0x7fb88006a3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb878009f20 tx=0x7fb878009840 comp rx=0 tx=0).stop 2023-10-08T16:06:38.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 -- 172.21.15.3:0/3928602959 shutdown_connections 2023-10-08T16:06:38.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 --2- 172.21.15.3:0/3928602959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8800cb400 0x7fb88006a3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 --2- 172.21.15.3:0/3928602959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb880158f00 0x7fb88015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 -- 172.21.15.3:0/3928602959 >> 172.21.15.3:0/3928602959 conn(0x7fb880067ae0 msgr2=0x7fb8800cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:38.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 -- 172.21.15.3:0/3928602959 shutdown_connections 2023-10-08T16:06:38.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.399+0000 7fb887184700 1 -- 172.21.15.3:0/3928602959 wait complete. 2023-10-08T16:06:38.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 Processor -- start 2023-10-08T16:06:38.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 -- start start 2023-10-08T16:06:38.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb8800cb400 0x7fb8800b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:38.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 0x7fb8801480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:38.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8801592d0 0x7fb880169060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:38.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800b0ae0 con 0x7fb880158f00 2023-10-08T16:06:38.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800b5680 con 0x7fb8801592d0 2023-10-08T16:06:38.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88015b890 con 0x7fb8800cb400 2023-10-08T16:06:38.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 0x7fb8801480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:38.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 0x7fb8801480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33468/0 (socket says 172.21.15.3:33468) 2023-10-08T16:06:38.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 -- 172.21.15.3:0/644024694 learned_addr learned my addr 172.21.15.3:0/644024694 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:38.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb886182700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb8800cb400 0x7fb8800b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:38.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb886983700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8801592d0 0x7fb880169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 -- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb8800cb400 msgr2=0x7fb8800b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb8800cb400 0x7fb8800b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 -- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8801592d0 msgr2=0x7fb880169060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8801592d0 0x7fb880169060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 -- 172.21.15.3:0/644024694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878009ae0 con 0x7fb880158f00 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb885981700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 0x7fb8801480f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c540 tx=0x7fb87c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c011590 con 0x7fb880158f00 2023-10-08T16:06:38.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c0116f0 con 0x7fb880158f00 2023-10-08T16:06:38.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8800b5920 con 0x7fb880158f00 2023-10-08T16:06:38.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c011ab0 con 0x7fb880158f00 2023-10-08T16:06:38.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.403+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb880148630 con 0x7fb880158f00 2023-10-08T16:06:38.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.407+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8800b0880 con 0x7fb880158f00 2023-10-08T16:06:38.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.407+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb87c01b3b0 con 0x7fb880158f00 2023-10-08T16:06:38.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.407+0000 7fb8767fc700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb864060580 0x7fb864062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:38.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.407+0000 7fb886182700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb864060580 0x7fb864062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:38.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.407+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fb87c07b890 con 0x7fb880158f00 2023-10-08T16:06:38.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.407+0000 7fb886182700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb864060580 0x7fb864062a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb870006fd0 tx=0x7fb870008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:38.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.419+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb87c04c110 con 0x7fb880158f00 2023-10-08T16:06:38.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:38.579+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb88004be40 con 0x7fb880158f00 2023-10-08T16:06:39.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.275+0000 7fb8767fc700 1 -- 172.21.15.3:0/644024694 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb87c017020 con 0x7fb880158f00 2023-10-08T16:06:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.291+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb864060580 msgr2=0x7fb864062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.291+0000 7fb887184700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb864060580 0x7fb864062a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb870006fd0 tx=0x7fb870008040 comp rx=0 tx=0).stop 2023-10-08T16:06:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.291+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 msgr2=0x7fb8801480f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.291+0000 7fb887184700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 0x7fb8801480f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c540 tx=0x7fb87c001070 comp rx=0 tx=0).stop 2023-10-08T16:06:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 shutdown_connections 2023-10-08T16:06:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb864060580 0x7fb864062a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8801592d0 0x7fb880169060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb880158f00 0x7fb8801480f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 --2- 172.21.15.3:0/644024694 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb8800cb400 0x7fb8800b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 >> 172.21.15.3:0/644024694 conn(0x7fb880067ae0 msgr2=0x7fb8800cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 shutdown_connections 2023-10-08T16:06:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.295+0000 7fb887184700 1 -- 172.21.15.3:0/644024694 wait complete. 2023-10-08T16:06:39.301 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T16:06:39.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:06:39.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 Processor -- start 2023-10-08T16:06:39.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 -- start start 2023-10-08T16:06:39.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fda84158510 0x7fda840afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fda840b0a00 0x7fda84068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda840af9d0 con 0x7fda840b0a00 2023-10-08T16:06:39.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda840b0ef0 con 0x7fda84158510 2023-10-08T16:06:39.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda89193700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda840af0a0 con 0x7fda841588e0 2023-10-08T16:06:39.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda88992700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fda840b0a00 0x7fda84068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda88992700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fda840b0a00 0x7fda84068200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33472/0 (socket says 172.21.15.3:33472) 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda88992700 1 -- 172.21.15.3:0/2364356937 learned_addr learned my addr 172.21.15.3:0/2364356937 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda83fff700 1 --2- 172.21.15.3:0/2364356937 >> v2:172.21.15.27:3300/0 conn(0x7fda84158510 0x7fda840afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.419+0000 7fda7bfff700 1 --2- 172.21.15.3:0/2364356937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda88992700 1 -- 172.21.15.3:0/2364356937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 msgr2=0x7fda840b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda88992700 1 --2- 172.21.15.3:0/2364356937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda88992700 1 -- 172.21.15.3:0/2364356937 >> v2:172.21.15.27:3300/0 conn(0x7fda84158510 msgr2=0x7fda840afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda88992700 1 --2- 172.21.15.3:0/2364356937 >> v2:172.21.15.27:3300/0 conn(0x7fda84158510 0x7fda840afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda88992700 1 -- 172.21.15.3:0/2364356937 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840af380 con 0x7fda840b0a00 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda88992700 1 --2- 172.21.15.3:0/2364356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda840b0a00 0x7fda84068200 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009f20 tx=0x7fda7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819f3ab073115760 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda837fe700 1 -- 172.21.15.3:0/2364356937 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00e070 con 0x7fda840b0a00 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda837fe700 1 -- 172.21.15.3:0/2364356937 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c00b930 con 0x7fda840b0a00 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda837fe700 1 -- 172.21.15.3:0/2364356937 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0092e0 con 0x7fda840b0a00 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- 172.21.15.3:0/2364356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda840b0a00 msgr2=0x7fda84068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- 172.21.15.3:0/2364356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda840b0a00 0x7fda84068200 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009f20 tx=0x7fda7c009840 comp rx=0 tx=0).stop 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- 172.21.15.3:0/2364356937 shutdown_connections 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- 172.21.15.3:0/2364356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda840b0a00 0x7fda84068200 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- 172.21.15.3:0/2364356937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- 172.21.15.3:0/2364356937 >> v2:172.21.15.27:3300/0 conn(0x7fda84158510 0x7fda840afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- 172.21.15.3:0/2364356937 >> 172.21.15.3:0/2364356937 conn(0x7fda84067b30 msgr2=0x7fda840adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- 172.21.15.3:0/2364356937 shutdown_connections 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- 172.21.15.3:0/2364356937 wait complete. 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 Processor -- start 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- start start 2023-10-08T16:06:39.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda840b0a00 0x7fda84169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 0x7fda84143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841446f0 con 0x7fda84158510 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8414b6a0 con 0x7fda840b0a00 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.423+0000 7fda89193700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8414b980 con 0x7fda841588e0 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 0x7fda84143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 0x7fda84143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33478/0 (socket says 172.21.15.3:33478) 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 -- 172.21.15.3:0/3696568000 learned_addr learned my addr 172.21.15.3:0/3696568000 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda83fff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda840b0a00 0x7fda84169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda88992700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 -- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 msgr2=0x7fda840a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 -- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda840b0a00 msgr2=0x7fda84169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda840b0a00 0x7fda84169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 -- 172.21.15.3:0/3696568000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009ae0 con 0x7fda84158510 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda83fff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda840b0a00 0x7fda84169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda7bfff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 0x7fda84143ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00e950 tx=0x7fda6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c013680 con 0x7fda84158510 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c0137e0 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8414bc60 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c013ba0 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda84144400 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.427+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8414c160 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.431+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fda6c0123d0 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.431+0000 7fda80ff9700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fda64060550 0x7fda64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.431+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fda6c07c940 con 0x7fda84158510 2023-10-08T16:06:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.431+0000 7fda83fff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fda64060550 0x7fda64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.431+0000 7fda83fff700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fda64060550 0x7fda64062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fda8414e2a0 tx=0x7fda740091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:39.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.439+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda6c04cef0 con 0x7fda84158510 2023-10-08T16:06:39.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:39.631+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fda8404be40 con 0x7fda84158510 2023-10-08T16:06:40.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.287+0000 7fda80ff9700 1 -- 172.21.15.3:0/3696568000 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fda6c050510 con 0x7fda84158510 2023-10-08T16:06:40.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.291+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fda64060550 msgr2=0x7fda64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.291+0000 7fda89193700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fda64060550 0x7fda64062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fda8414e2a0 tx=0x7fda740091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.291+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 msgr2=0x7fda84143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.291+0000 7fda89193700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 0x7fda84143ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00e950 tx=0x7fda6c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 shutdown_connections 2023-10-08T16:06:40.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fda64060550 0x7fda64062a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fda841588e0 0x7fda840a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda84158510 0x7fda84143ec0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 --2- 172.21.15.3:0/3696568000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda840b0a00 0x7fda84169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 >> 172.21.15.3:0/3696568000 conn(0x7fda84067b30 msgr2=0x7fda84068160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:40.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 shutdown_connections 2023-10-08T16:06:40.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.295+0000 7fda89193700 1 -- 172.21.15.3:0/3696568000 wait complete. 2023-10-08T16:06:40.302 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T16:06:40.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:40.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.407+0000 7f163eb55700 1 Processor -- start 2023-10-08T16:06:40.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.407+0000 7f163eb55700 1 -- start start 2023-10-08T16:06:40.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163eb55700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f163813eed0 0x7f16380c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163eb55700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f16380c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163eb55700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16380c7fb0 con 0x7f16380c7ac0 2023-10-08T16:06:40.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163eb55700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16380c8290 con 0x7f163813eed0 2023-10-08T16:06:40.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163eb55700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380c8570 con 0x7f1638068990 2023-10-08T16:06:40.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163d352700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f16380c7ac0 0x7f1638068280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56816/0 (socket says 172.21.15.3:56816) 2023-10-08T16:06:40.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163d352700 1 -- 172.21.15.3:0/2136549776 learned_addr learned my addr 172.21.15.3:0/2136549776 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:40.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163db53700 1 --2- 172.21.15.3:0/2136549776 >> v2:172.21.15.27:3300/0 conn(0x7f163813eed0 0x7f16380c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163e354700 1 --2- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f16380c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163cb51700 1 -- 172.21.15.3:0/2136549776 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21475460 0 0) 0x7f16380c7fb0 con 0x7f16380c7ac0 2023-10-08T16:06:40.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163cb51700 1 -- 172.21.15.3:0/2136549776 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1624003570 con 0x7f16380c7ac0 2023-10-08T16:06:40.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163cb51700 1 -- 172.21.15.3:0/2136549776 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943911173 0 0) 0x7f1624003570 con 0x7f16380c7ac0 2023-10-08T16:06:40.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163db53700 1 -- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 msgr2=0x7f16380c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163db53700 1 --2- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f16380c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163db53700 1 -- 172.21.15.3:0/2136549776 >> v1:172.21.15.3:6789/0 conn(0x7f16380c7ac0 legacy=0x7f1638068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163db53700 1 -- 172.21.15.3:0/2136549776 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380c8850 con 0x7f163813eed0 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163db53700 1 --2- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f16380c7580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16340098e0 tx=0x7f16340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7f9f77a98258e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163cb51700 1 -- 172.21.15.3:0/2136549776 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628001470 con 0x7f163813eed0 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163cb51700 1 -- 172.21.15.3:0/2136549776 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1634011420 con 0x7f163813eed0 2023-10-08T16:06:40.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.411+0000 7f163cb51700 1 -- 172.21.15.3:0/2136549776 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16340117c0 con 0x7f163813eed0 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 -- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 msgr2=0x7f16380c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 --2- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f16380c7580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16340098e0 tx=0x7f16340091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 -- 172.21.15.3:0/2136549776 shutdown_connections 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 --2- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f16380c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 --2- 172.21.15.3:0/2136549776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f16380c7580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 -- 172.21.15.3:0/2136549776 >> 172.21.15.3:0/2136549776 conn(0x7f16380c8c90 msgr2=0x7f16380c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 -- 172.21.15.3:0/2136549776 shutdown_connections 2023-10-08T16:06:40.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 -- 172.21.15.3:0/2136549776 wait complete. 2023-10-08T16:06:40.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 Processor -- start 2023-10-08T16:06:40.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.415+0000 7f163eb55700 1 -- start start 2023-10-08T16:06:40.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f1638125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 0x7f163813da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f163813cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163813dfb0 con 0x7f16380c7ac0 2023-10-08T16:06:40.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638126820 con 0x7f163813eed0 2023-10-08T16:06:40.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1638125c10 con 0x7f1638068990 2023-10-08T16:06:40.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 0x7f163813da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 0x7f163813da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36530/0 (socket says 172.21.15.3:36530) 2023-10-08T16:06:40.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 -- 172.21.15.3:0/1172797177 learned_addr learned my addr 172.21.15.3:0/1172797177 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:40.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163e354700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f163813cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163db53700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f1638125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 -- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 msgr2=0x7f1638125510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f1638125510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 -- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 msgr2=0x7f163813cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f163813cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 -- 172.21.15.3:0/1172797177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634009420 con 0x7f16380c7ac0 2023-10-08T16:06:40.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163e354700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f163813cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:40.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163db53700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f1638125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:40.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163d352700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 0x7f163813da70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f162800cb90 tx=0x7f1628001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:40.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628001d10 con 0x7f16380c7ac0 2023-10-08T16:06:40.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628007360 con 0x7f16380c7ac0 2023-10-08T16:06:40.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638125ef0 con 0x7f16380c7ac0 2023-10-08T16:06:40.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628007700 con 0x7f16380c7ac0 2023-10-08T16:06:40.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.419+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16381264b0 con 0x7f16380c7ac0 2023-10-08T16:06:40.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.423+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163804be40 con 0x7f16380c7ac0 2023-10-08T16:06:40.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.423+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1628004a40 con 0x7f16380c7ac0 2023-10-08T16:06:40.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.423+0000 7f162dffb700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f161c060550 0x7f161c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.423+0000 7f163db53700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f161c060550 0x7f161c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.423+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f162807c070 con 0x7f16380c7ac0 2023-10-08T16:06:40.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.423+0000 7f163db53700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f161c060550 0x7f161c062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f16340030c0 tx=0x7f1634016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:40.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.431+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f162804c6e0 con 0x7f16380c7ac0 2023-10-08T16:06:40.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.595+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1638126960 con 0x7f16380c7ac0 2023-10-08T16:06:40.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.599+0000 7f162dffb700 1 -- 172.21.15.3:0/1172797177 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f162804fd00 con 0x7f16380c7ac0 2023-10-08T16:06:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:40.603 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:39.635280+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.599+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f161c060550 msgr2=0x7f161c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.599+0000 7f163eb55700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f161c060550 0x7f161c062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f16340030c0 tx=0x7f1634016000 comp rx=0 tx=0).stop 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.599+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 msgr2=0x7f163813da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.599+0000 7f163eb55700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 0x7f163813da70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f162800cb90 tx=0x7f1628001a80 comp rx=0 tx=0).stop 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.599+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 shutdown_connections 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f161c060550 0x7f161c062a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f163813eed0 0x7f163813cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16380c7ac0 0x7f163813da70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 --2- 172.21.15.3:0/1172797177 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1638068990 0x7f1638125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 >> 172.21.15.3:0/1172797177 conn(0x7f16380c8c90 msgr2=0x7f163806cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 shutdown_connections 2023-10-08T16:06:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.603+0000 7f163eb55700 1 -- 172.21.15.3:0/1172797177 wait complete. 2023-10-08T16:06:40.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:40.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.723+0000 7f32c578a700 1 Processor -- start 2023-10-08T16:06:40.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.723+0000 7f32c578a700 1 -- start start 2023-10-08T16:06:40.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f32c00c7d70 0x7f32c00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c01562c0 con 0x7f32c00ae230 2023-10-08T16:06:40.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c006b0b0 con 0x7f32c00c7d70 2023-10-08T16:06:40.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c006b390 con 0x7f32c00ade60 2023-10-08T16:06:40.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32b77fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f32c00ae230 0x7f32c00c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56820/0 (socket says 172.21.15.3:56820) 2023-10-08T16:06:40.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32b77fe700 1 -- 172.21.15.3:0/176035429 learned_addr learned my addr 172.21.15.3:0/176035429 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:40.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c4f89700 1 --2- 172.21.15.3:0/176035429 >> v2:172.21.15.27:3300/0 conn(0x7f32c00c7d70 0x7f32c00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bffff700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bf7fe700 1 -- 172.21.15.3:0/176035429 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400332412 0 0) 0x7f32c01562c0 con 0x7f32c00ae230 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bf7fe700 1 -- 172.21.15.3:0/176035429 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32ac003570 con 0x7f32c00ae230 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c4f89700 1 -- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 msgr2=0x7f32c00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c4f89700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c00cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c4f89700 1 -- 172.21.15.3:0/176035429 >> v1:172.21.15.3:6789/0 conn(0x7f32c00ae230 legacy=0x7f32c00c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bf7fe700 1 -- 172.21.15.3:0/176035429 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 888169744 0 0) 0x7f32ac003570 con 0x7f32c00ae230 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c4f89700 1 -- 172.21.15.3:0/176035429 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c006b670 con 0x7f32c00c7d70 2023-10-08T16:06:40.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bffff700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c00cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:40.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c4f89700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00cb390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009e60 tx=0x7f32b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9427a6cf9dd4c9fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:40.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bf7fe700 1 -- 172.21.15.3:0/176035429 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800e070 con 0x7f32c00c7d70 2023-10-08T16:06:40.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bf7fe700 1 -- 172.21.15.3:0/176035429 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800b7a0 con 0x7f32c00c7d70 2023-10-08T16:06:40.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32bf7fe700 1 -- 172.21.15.3:0/176035429 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8001470 con 0x7f32c00c7d70 2023-10-08T16:06:40.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 msgr2=0x7f32c00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00cb390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009e60 tx=0x7f32b8009780 comp rx=0 tx=0).stop 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- 172.21.15.3:0/176035429 shutdown_connections 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00cb390 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 --2- 172.21.15.3:0/176035429 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c00cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- 172.21.15.3:0/176035429 >> 172.21.15.3:0/176035429 conn(0x7f32c00c83d0 msgr2=0x7f32c00c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- 172.21.15.3:0/176035429 shutdown_connections 2023-10-08T16:06:40.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.727+0000 7f32c578a700 1 -- 172.21.15.3:0/176035429 wait complete. 2023-10-08T16:06:40.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 Processor -- start 2023-10-08T16:06:40.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 -- start start 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 0x7f32c00c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00c31a0 con 0x7f32c00ae230 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01567d0 con 0x7f32c00c7d70 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c578a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c014f050 con 0x7f32c00ade60 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 0x7f32c00c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 0x7f32c00c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36542/0 (socket says 172.21.15.3:36542) 2023-10-08T16:06:40.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32b77fe700 1 -- 172.21.15.3:0/1054914135 learned_addr learned my addr 172.21.15.3:0/1054914135 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:40.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32bffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32c4f89700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32b77fe700 1 -- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 msgr2=0x7f32c014e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32b77fe700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c014e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.731+0000 7f32b77fe700 1 -- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 msgr2=0x7f32c00c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32b77fe700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32b77fe700 1 -- 172.21.15.3:0/1054914135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009420 con 0x7f32c00ae230 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32c4f89700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32b77fe700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 0x7f32c00c3630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32a800cb90 tx=0x7f32a8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:40.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8007150 con 0x7f32c00ae230 2023-10-08T16:06:40.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a80072d0 con 0x7f32c00ae230 2023-10-08T16:06:40.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b8009a20 con 0x7f32c00ae230 2023-10-08T16:06:40.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8007690 con 0x7f32c00ae230 2023-10-08T16:06:40.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c00c2e30 con 0x7f32c00ae230 2023-10-08T16:06:40.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c014f550 con 0x7f32c00ae230 2023-10-08T16:06:40.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.735+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f32a8004a40 con 0x7f32c00ae230 2023-10-08T16:06:40.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.739+0000 7f32bcff9700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f32a0060550 0x7f32a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:40.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.739+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32a807bfa0 con 0x7f32c00ae230 2023-10-08T16:06:40.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.739+0000 7f32bffff700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f32a0060550 0x7f32a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:40.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.739+0000 7f32bffff700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f32a0060550 0x7f32a0062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32c014fbc0 tx=0x7f32b00091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:40.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.747+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f32a804c4f0 con 0x7f32c00ae230 2023-10-08T16:06:40.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32c004be40 con 0x7f32c00ae230 2023-10-08T16:06:40.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32bcff9700 1 -- 172.21.15.3:0/1054914135 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f32a8018020 con 0x7f32c00ae230 2023-10-08T16:06:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:40.907 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:39.635280+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f32a0060550 msgr2=0x7f32a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f32a0060550 0x7f32a0062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32c014fbc0 tx=0x7f32b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 msgr2=0x7f32c00c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 0x7f32c00c3630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32a800cb90 tx=0x7f32a8001a30 comp rx=0 tx=0).stop 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 shutdown_connections 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f32a0060550 0x7f32a0062a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32c00c7d70 0x7f32c00c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32c00ae230 0x7f32c00c3630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 --2- 172.21.15.3:0/1054914135 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32c00ade60 0x7f32c014e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:40.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.903+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 >> 172.21.15.3:0/1054914135 conn(0x7f32c00c83d0 msgr2=0x7f32c00b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:40.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.907+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 shutdown_connections 2023-10-08T16:06:40.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:40.907+0000 7f32c578a700 1 -- 172.21.15.3:0/1054914135 wait complete. 2023-10-08T16:06:40.920 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:06:41.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.035+0000 7fad22af2700 1 Processor -- start 2023-10-08T16:06:41.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.035+0000 7fad22af2700 1 -- start start 2023-10-08T16:06:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad1c0ad120 0x7fad1c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0c8da0 con 0x7fad1c0cc280 2023-10-08T16:06:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0cd530 con 0x7fad1c0ae720 2023-10-08T16:06:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0cd9c0 con 0x7fad1c0ad120 2023-10-08T16:06:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad21af0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad1c0ad120 0x7fad1c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad212ef700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fad1c0cc280 0x7fad1c06c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56828/0 (socket says 172.21.15.3:56828) 2023-10-08T16:06:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad212ef700 1 -- 172.21.15.3:0/3762501851 learned_addr learned my addr 172.21.15.3:0/3762501851 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:41.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad21af0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad1c0ad120 0x7fad1c0cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36546/0 (socket says 172.21.15.3:36546) 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad21af0700 1 -- 172.21.15.3:0/3762501851 >> v1:172.21.15.27:6789/0 conn(0x7fad1c0ae720 legacy=0x7fad1c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad21af0700 1 -- 172.21.15.3:0/3762501851 >> v1:172.21.15.3:6789/0 conn(0x7fad1c0cc280 legacy=0x7fad1c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad21af0700 1 -- 172.21.15.3:0/3762501851 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c06d520 con 0x7fad1c0ad120 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad21af0700 1 --2- 172.21.15.3:0/3762501851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0ad120 0x7fad1c0cbd40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad180098d0 tx=0x7fad18009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aab2a374c2a821 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad20aee700 1 -- 172.21.15.3:0/3762501851 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18009e70 con 0x7fad1c0ad120 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad20aee700 1 -- 172.21.15.3:0/3762501851 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18005c10 con 0x7fad1c0ad120 2023-10-08T16:06:41.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad20aee700 1 -- 172.21.15.3:0/3762501851 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800b650 con 0x7fad1c0ad120 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- 172.21.15.3:0/3762501851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0ad120 msgr2=0x7fad1c0cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 --2- 172.21.15.3:0/3762501851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0ad120 0x7fad1c0cbd40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad180098d0 tx=0x7fad18009120 comp rx=0 tx=0).stop 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- 172.21.15.3:0/3762501851 shutdown_connections 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 --2- 172.21.15.3:0/3762501851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0ad120 0x7fad1c0cbd40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- 172.21.15.3:0/3762501851 >> 172.21.15.3:0/3762501851 conn(0x7fad1c0ca5e0 msgr2=0x7fad1c0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- 172.21.15.3:0/3762501851 shutdown_connections 2023-10-08T16:06:41.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.039+0000 7fad22af2700 1 -- 172.21.15.3:0/3762501851 wait complete. 2023-10-08T16:06:41.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 Processor -- start 2023-10-08T16:06:41.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 -- start start 2023-10-08T16:06:41.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad1c0ad120 0x7fad1c0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad1c0ae720 0x7fad1c0c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 0x7fad1c0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c68d0 con 0x7fad1c0cc280 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c5cc0 con 0x7fad1c0ad120 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad22af2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c5fa0 con 0x7fad1c0ae720 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad222f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 0x7fad1c0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad21af0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad1c0ad120 0x7fad1c0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad222f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 0x7fad1c0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36554/0 (socket says 172.21.15.3:36554) 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.043+0000 7fad222f1700 1 -- 172.21.15.3:0/632603053 learned_addr learned my addr 172.21.15.3:0/632603053 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad212ef700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad1c0ae720 0x7fad1c0c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad222f1700 1 -- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad1c0ae720 msgr2=0x7fad1c0c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad222f1700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad1c0ae720 0x7fad1c0c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad222f1700 1 -- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad1c0ad120 msgr2=0x7fad1c0c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad222f1700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad1c0ad120 0x7fad1c0c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad222f1700 1 -- 172.21.15.3:0/632603053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180093c0 con 0x7fad1c0cc280 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad21af0700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad1c0ad120 0x7fad1c0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad222f1700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 0x7fad1c0c6d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c8e0 tx=0x7fad14001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14012630 con 0x7fad1c0cc280 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c0c6280 con 0x7fad1c0cc280 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14012790 con 0x7fad1c0cc280 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14012b50 con 0x7fad1c0cc280 2023-10-08T16:06:41.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c0c72a0 con 0x7fad1c0cc280 2023-10-08T16:06:41.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.047+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c0c6a80 con 0x7fad1c0cc280 2023-10-08T16:06:41.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.051+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad1401a3a0 con 0x7fad1c0cc280 2023-10-08T16:06:41.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.051+0000 7fad0dffb700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad00060550 0x7fad00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.051+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad1407c990 con 0x7fad1c0cc280 2023-10-08T16:06:41.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.051+0000 7fad21af0700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad00060550 0x7fad00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.051+0000 7fad21af0700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad00060550 0x7fad00062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad18009160 tx=0x7fad18016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:41.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.059+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad1c0c6a80 con 0x7fad1c0cc280 2023-10-08T16:06:41.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.255+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fad1c04be40 con 0x7fad1c0cc280 2023-10-08T16:06:41.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.291+0000 7fad0dffb700 1 -- 172.21.15.3:0/632603053 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fad14050a10 con 0x7fad1c0cc280 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad00060550 msgr2=0x7fad00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad00060550 0x7fad00062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad18009160 tx=0x7fad18016000 comp rx=0 tx=0).stop 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 msgr2=0x7fad1c0c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 0x7fad1c0c6d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c8e0 tx=0x7fad14001710 comp rx=0 tx=0).stop 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 shutdown_connections 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad00060550 0x7fad00062a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad1c0cc280 0x7fad1c0c6d60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad1c0ae720 0x7fad1c0c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 --2- 172.21.15.3:0/632603053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad1c0ad120 0x7fad1c0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 >> 172.21.15.3:0/632603053 conn(0x7fad1c0ca5e0 msgr2=0x7fad1c06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:41.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 shutdown_connections 2023-10-08T16:06:41.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.295+0000 7fad22af2700 1 -- 172.21.15.3:0/632603053 wait complete. 2023-10-08T16:06:41.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:06:41.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.419+0000 7efd29195700 1 Processor -- start 2023-10-08T16:06:41.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.419+0000 7efd29195700 1 -- start start 2023-10-08T16:06:41.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd2406db60 0x7efd2415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2406bb50 con 0x7efd24158c80 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd240b45a0 con 0x7efd240b37c0 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2406a3a0 con 0x7efd2406db60 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd23fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7efd24158c80 0x7efd2406b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56830/0 (socket says 172.21.15.3:56830) 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd23fff700 1 -- 172.21.15.3:0/1903090947 learned_addr learned my addr 172.21.15.3:0/1903090947 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd237fe700 1 --2- 172.21.15.3:0/1903090947 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd2406db60 0x7efd2415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114281524 0 0) 0x7efd2406bb50 con 0x7efd24158c80 2023-10-08T16:06:41.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd0c003570 con 0x7efd24158c80 2023-10-08T16:06:41.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135422551 0 0) 0x7efd240b45a0 con 0x7efd240b37c0 2023-10-08T16:06:41.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd2406bb50 con 0x7efd240b37c0 2023-10-08T16:06:41.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2997940057 0 0) 0x7efd0c003570 con 0x7efd24158c80 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd237fe700 1 -- 172.21.15.3:0/1903090947 >> v1:172.21.15.27:6789/0 conn(0x7efd240b37c0 legacy=0x7efd24159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd237fe700 1 -- 172.21.15.3:0/1903090947 >> v1:172.21.15.3:6789/0 conn(0x7efd24158c80 legacy=0x7efd2406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd237fe700 1 -- 172.21.15.3:0/1903090947 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2406a680 con 0x7efd2406db60 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd237fe700 1 --2- 172.21.15.3:0/1903090947 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd2406db60 0x7efd2415d4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd14009910 tx=0x7efd140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749cf83d0868b87e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18001470 con 0x7efd2406db60 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14011420 con 0x7efd2406db60 2023-10-08T16:06:41.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd22ffd700 1 -- 172.21.15.3:0/1903090947 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140117c0 con 0x7efd2406db60 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- 172.21.15.3:0/1903090947 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd2406db60 msgr2=0x7efd2415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 --2- 172.21.15.3:0/1903090947 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd2406db60 0x7efd2415d4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd14009910 tx=0x7efd140091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- 172.21.15.3:0/1903090947 shutdown_connections 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 --2- 172.21.15.3:0/1903090947 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd2406db60 0x7efd2415d4c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- 172.21.15.3:0/1903090947 >> 172.21.15.3:0/1903090947 conn(0x7efd240d0820 msgr2=0x7efd240b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- 172.21.15.3:0/1903090947 shutdown_connections 2023-10-08T16:06:41.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.423+0000 7efd29195700 1 -- 172.21.15.3:0/1903090947 wait complete. 2023-10-08T16:06:41.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 Processor -- start 2023-10-08T16:06:41.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 -- start start 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd2406db60 0x7efd2415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 0x7efd240c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd24158c80 0x7efd240cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd240ca960 con 0x7efd240b37c0 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd240c8930 con 0x7efd2406db60 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd29195700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd240c9d90 con 0x7efd24158c80 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 0x7efd240c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 0x7efd240c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36564/0 (socket says 172.21.15.3:36564) 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 -- 172.21.15.3:0/4048325900 learned_addr learned my addr 172.21.15.3:0/4048325900 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd23fff700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd2406db60 0x7efd2415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd28994700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd24158c80 0x7efd240cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 -- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd24158c80 msgr2=0x7efd240cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd24158c80 0x7efd240cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 -- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd2406db60 msgr2=0x7efd2415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd2406db60 0x7efd2415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 -- 172.21.15.3:0/4048325900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14009420 con 0x7efd240b37c0 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.427+0000 7efd237fe700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 0x7efd240c7ee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd140091e0 tx=0x7efd14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:41.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1401cc90 con 0x7efd240b37c0 2023-10-08T16:06:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1401cdf0 con 0x7efd240b37c0 2023-10-08T16:06:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd240ca030 con 0x7efd240b37c0 2023-10-08T16:06:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1401a6a0 con 0x7efd240b37c0 2023-10-08T16:06:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd240ca5f0 con 0x7efd240b37c0 2023-10-08T16:06:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd240caad0 con 0x7efd240b37c0 2023-10-08T16:06:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efd1401aa90 con 0x7efd240b37c0 2023-10-08T16:06:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd0bfff700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd10060550 0x7efd10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd1407e5e0 con 0x7efd240b37c0 2023-10-08T16:06:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.431+0000 7efd23fff700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd10060550 0x7efd10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.435+0000 7efd23fff700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd10060550 0x7efd10062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd180011e0 tx=0x7efd180015c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.443+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd1404ebd0 con 0x7efd240b37c0 2023-10-08T16:06:41.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:41.635+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efd2404be40 con 0x7efd240b37c0 2023-10-08T16:06:41.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:41.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:42.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.303+0000 7efd0bfff700 1 -- 172.21.15.3:0/4048325900 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7efd140521f0 con 0x7efd240b37c0 2023-10-08T16:06:42.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd10060550 msgr2=0x7efd10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd10060550 0x7efd10062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd180011e0 tx=0x7efd180015c0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 msgr2=0x7efd240c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 0x7efd240c7ee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd140091e0 tx=0x7efd14016000 comp rx=0 tx=0).stop 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 shutdown_connections 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd10060550 0x7efd10062a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd24158c80 0x7efd240cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd240b37c0 0x7efd240c7ee0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 --2- 172.21.15.3:0/4048325900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd2406db60 0x7efd2415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 >> 172.21.15.3:0/4048325900 conn(0x7efd240d0820 msgr2=0x7efd24157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 shutdown_connections 2023-10-08T16:06:42.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.307+0000 7efd29195700 1 -- 172.21.15.3:0/4048325900 wait complete. 2023-10-08T16:06:42.327 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:42.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 Processor -- start 2023-10-08T16:06:42.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 -- start start 2023-10-08T16:06:42.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f71b4158f60 0x7f71b40cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f71b40cb260 0x7f71b4067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b40ca2d0 con 0x7f71b4158b90 2023-10-08T16:06:42.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b40ca890 con 0x7f71b4158f60 2023-10-08T16:06:42.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b4159890 con 0x7f71b40cb260 2023-10-08T16:06:42.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b259c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f71b4158b90 0x7f71b406a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56846/0 (socket says 172.21.15.3:56846) 2023-10-08T16:06:42.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b259c700 1 -- 172.21.15.3:0/929122231 learned_addr learned my addr 172.21.15.3:0/929122231 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:42.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.435+0000 7f71b1d9b700 1 --2- 172.21.15.3:0/929122231 >> v2:172.21.15.3:3300/0 conn(0x7f71b4158f60 0x7f71b40cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b2d9d700 1 --2- 172.21.15.3:0/929122231 >> v2:172.21.15.27:3300/0 conn(0x7f71b40cb260 0x7f71b4067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b159a700 1 -- 172.21.15.3:0/929122231 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461874588 0 0) 0x7f71b40ca2d0 con 0x7f71b4158b90 2023-10-08T16:06:42.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b1d9b700 1 -- 172.21.15.3:0/929122231 >> v2:172.21.15.27:3300/0 conn(0x7f71b40cb260 msgr2=0x7f71b4067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:42.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b1d9b700 1 --2- 172.21.15.3:0/929122231 >> v2:172.21.15.27:3300/0 conn(0x7f71b40cb260 0x7f71b4067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b1d9b700 1 -- 172.21.15.3:0/929122231 >> v1:172.21.15.3:6789/0 conn(0x7f71b4158b90 legacy=0x7f71b406a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b1d9b700 1 -- 172.21.15.3:0/929122231 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b41593e0 con 0x7f71b4158f60 2023-10-08T16:06:42.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b2d9d700 1 --2- 172.21.15.3:0/929122231 >> v2:172.21.15.27:3300/0 conn(0x7f71b40cb260 0x7f71b4067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:42.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b1d9b700 1 --2- 172.21.15.3:0/929122231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158f60 0x7f71b40cad20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f71b40c6cd0 tx=0x7f71a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625a9407c7f04dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:42.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b159a700 1 -- 172.21.15.3:0/929122231 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400b6b0 con 0x7f71b4158f60 2023-10-08T16:06:42.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b159a700 1 -- 172.21.15.3:0/929122231 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400b810 con 0x7f71b4158f60 2023-10-08T16:06:42.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b159a700 1 -- 172.21.15.3:0/929122231 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400bbb0 con 0x7f71b4158f60 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 -- 172.21.15.3:0/929122231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158f60 msgr2=0x7f71b40cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 --2- 172.21.15.3:0/929122231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158f60 0x7f71b40cad20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f71b40c6cd0 tx=0x7f71a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 -- 172.21.15.3:0/929122231 shutdown_connections 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 --2- 172.21.15.3:0/929122231 >> v2:172.21.15.27:3300/0 conn(0x7f71b40cb260 0x7f71b4067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 --2- 172.21.15.3:0/929122231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158f60 0x7f71b40cad20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 -- 172.21.15.3:0/929122231 >> 172.21.15.3:0/929122231 conn(0x7f71b40cfd30 msgr2=0x7f71b40d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 -- 172.21.15.3:0/929122231 shutdown_connections 2023-10-08T16:06:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.439+0000 7f71b359e700 1 -- 172.21.15.3:0/929122231 wait complete. 2023-10-08T16:06:42.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 Processor -- start 2023-10-08T16:06:42.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 -- start start 2023-10-08T16:06:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71b40cb260 0x7f71b416a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 0x7f71b40c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f71b4158f60 0x7f71b40b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b414ac50 con 0x7f71b4158b90 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c65d0 con 0x7f71b40cb260 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b416ccf0 con 0x7f71b4158f60 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b1d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 0x7f71b40c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b1d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 0x7f71b40c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36596/0 (socket says 172.21.15.3:36596) 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b1d9b700 1 -- 172.21.15.3:0/2485218126 learned_addr learned my addr 172.21.15.3:0/2485218126 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b259c700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71b40cb260 0x7f71b416a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.443+0000 7f71b2d9d700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f71b4158f60 0x7f71b40b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b1d9b700 1 -- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f71b4158f60 msgr2=0x7f71b40b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b1d9b700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f71b4158f60 0x7f71b40b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b1d9b700 1 -- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71b40cb260 msgr2=0x7f71b416a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b1d9b700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71b40cb260 0x7f71b416a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b1d9b700 1 -- 172.21.15.3:0/2485218126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009420 con 0x7f71b4158b90 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b1d9b700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 0x7f71b40c3790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71b4069f10 tx=0x7f71a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4000d10 con 0x7f71b4158b90 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400bb90 con 0x7f71b4158b90 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b40c6020 con 0x7f71b4158b90 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011650 con 0x7f71b4158b90 2023-10-08T16:06:42.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b416cf90 con 0x7f71b4158b90 2023-10-08T16:06:42.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b416d1b0 con 0x7f71b4158b90 2023-10-08T16:06:42.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.447+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f71a4011a40 con 0x7f71b4158b90 2023-10-08T16:06:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.451+0000 7f71aa7fc700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7198060550 0x7f7198062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.451+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71a407da50 con 0x7f71b4158b90 2023-10-08T16:06:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.451+0000 7f71b259c700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7198060550 0x7f7198062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.451+0000 7f71b259c700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7198060550 0x7f7198062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f719c002250 tx=0x7f719c001a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:42.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.459+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f71a404e0c0 con 0x7f71b4158b90 2023-10-08T16:06:42.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.655+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71b404be40 con 0x7f71b4158b90 2023-10-08T16:06:42.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71aa7fc700 1 -- 172.21.15.3:0/2485218126 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f71a40516e0 con 0x7f71b4158b90 2023-10-08T16:06:42.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:42.662 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:06:42.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7198060550 msgr2=0x7f7198062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7198060550 0x7f7198062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f719c002250 tx=0x7f719c001a20 comp rx=0 tx=0).stop 2023-10-08T16:06:42.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 msgr2=0x7f71b40c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 0x7f71b40c3790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71b4069f10 tx=0x7f71a4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 shutdown_connections 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7198060550 0x7f7198062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f71b4158f60 0x7f71b40b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71b4158b90 0x7f71b40c3790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 --2- 172.21.15.3:0/2485218126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71b40cb260 0x7f71b416a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 >> 172.21.15.3:0/2485218126 conn(0x7f71b40cfd30 msgr2=0x7f71b415a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 shutdown_connections 2023-10-08T16:06:42.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.659+0000 7f71b359e700 1 -- 172.21.15.3:0/2485218126 wait complete. 2023-10-08T16:06:42.666 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:06:42.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:42.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 Processor -- start 2023-10-08T16:06:42.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 -- start start 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76001591f0 0x7f76000b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f76000ca5d0 0x7f76000caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760006ce20 con 0x7f7600067060 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76000cb090 con 0x7f76000ca5d0 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.775+0000 7f75fffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76000cb370 con 0x7f76001591f0 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75ff7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7600067060 0x7f760006d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56852/0 (socket says 172.21.15.3:56852) 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75ff7fe700 1 -- 172.21.15.3:0/1295688859 learned_addr learned my addr 172.21.15.3:0/1295688859 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fe7fc700 1 --2- 172.21.15.3:0/1295688859 >> v2:172.21.15.3:3300/0 conn(0x7f76000ca5d0 0x7f76000caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75feffd700 1 --2- 172.21.15.3:0/1295688859 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76001591f0 0x7f76000b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fdffb700 1 -- 172.21.15.3:0/1295688859 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369507404 0 0) 0x7f760006ce20 con 0x7f7600067060 2023-10-08T16:06:42.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fdffb700 1 -- 172.21.15.3:0/1295688859 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec003570 con 0x7f7600067060 2023-10-08T16:06:42.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fe7fc700 1 -- 172.21.15.3:0/1295688859 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76001591f0 msgr2=0x7f76000b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:42.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fdffb700 1 -- 172.21.15.3:0/1295688859 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1465324756 0 0) 0x7f75ec003570 con 0x7f7600067060 2023-10-08T16:06:42.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fe7fc700 1 --2- 172.21.15.3:0/1295688859 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76001591f0 0x7f76000b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fe7fc700 1 -- 172.21.15.3:0/1295688859 >> v1:172.21.15.3:6789/0 conn(0x7f7600067060 legacy=0x7f760006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fe7fc700 1 -- 172.21.15.3:0/1295688859 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000cb650 con 0x7f76000ca5d0 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fe7fc700 1 --2- 172.21.15.3:0/1295688859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76000ca5d0 0x7f76000caa40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75e80098e0 tx=0x7f75e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd22414fb355a052 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fdffb700 1 -- 172.21.15.3:0/1295688859 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0001470 con 0x7f76000ca5d0 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fdffb700 1 -- 172.21.15.3:0/1295688859 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8011420 con 0x7f76000ca5d0 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fdffb700 1 -- 172.21.15.3:0/1295688859 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80117c0 con 0x7f76000ca5d0 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 -- 172.21.15.3:0/1295688859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76000ca5d0 msgr2=0x7f76000caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 --2- 172.21.15.3:0/1295688859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76000ca5d0 0x7f76000caa40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75e80098e0 tx=0x7f75e80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 -- 172.21.15.3:0/1295688859 shutdown_connections 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 --2- 172.21.15.3:0/1295688859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76000ca5d0 0x7f76000caa40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 --2- 172.21.15.3:0/1295688859 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76001591f0 0x7f76000b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 -- 172.21.15.3:0/1295688859 >> 172.21.15.3:0/1295688859 conn(0x7f76000cfd80 msgr2=0x7f76000d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:42.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 -- 172.21.15.3:0/1295688859 shutdown_connections 2023-10-08T16:06:42.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 -- 172.21.15.3:0/1295688859 wait complete. 2023-10-08T16:06:42.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.779+0000 7f75fffff700 1 Processor -- start 2023-10-08T16:06:42.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- start start 2023-10-08T16:06:42.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 0x7f760015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76000ca5d0 0x7f7600157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76001591f0 0x7f76000c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600157900 con 0x7f7600067060 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600156cf0 con 0x7f76001591f0 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7600156fd0 con 0x7f76000ca5d0 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 0x7f760015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 0x7f760015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36610/0 (socket says 172.21.15.3:36610) 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 -- 172.21.15.3:0/1078882929 learned_addr learned my addr 172.21.15.3:0/1078882929 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fe7fc700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76000ca5d0 0x7f7600157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75ff7fe700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76001591f0 0x7f76000c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 -- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76000ca5d0 msgr2=0x7f7600157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76000ca5d0 0x7f7600157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 -- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76001591f0 msgr2=0x7f76000c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76001591f0 0x7f76000c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 -- 172.21.15.3:0/1078882929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8009420 con 0x7f7600067060 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75feffd700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 0x7f760015c140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009e50 tx=0x7f75f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800cb50 con 0x7f7600067060 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800f040 con 0x7f7600067060 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76001572b0 con 0x7f7600067060 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8014480 con 0x7f7600067060 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76001569a0 con 0x7f7600067060 2023-10-08T16:06:42.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.783+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760004be40 con 0x7f7600067060 2023-10-08T16:06:42.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.787+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f75f80147f0 con 0x7f7600067060 2023-10-08T16:06:42.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.787+0000 7f75f6ffd700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f75e0060550 0x7f75e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:42.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.787+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75f807d080 con 0x7f7600067060 2023-10-08T16:06:42.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.787+0000 7f75fe7fc700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f75e0060550 0x7f75e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:42.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.787+0000 7f75fe7fc700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f75e0060550 0x7f75e0062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75e80030c0 tx=0x7f75e8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:42.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.799+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f75f804d670 con 0x7f7600067060 2023-10-08T16:06:42.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.959+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76001589d0 con 0x7f7600067060 2023-10-08T16:06:42.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75f6ffd700 1 -- 172.21.15.3:0/1078882929 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f75f8050c90 con 0x7f7600067060 2023-10-08T16:06:42.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:42.966 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f75e0060550 msgr2=0x7f75e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f75e0060550 0x7f75e0062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75e80030c0 tx=0x7f75e8016000 comp rx=0 tx=0).stop 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 msgr2=0x7f760015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 0x7f760015c140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009e50 tx=0x7f75f800b040 comp rx=0 tx=0).stop 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 shutdown_connections 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f75e0060550 0x7f75e0062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76001591f0 0x7f76000c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76000ca5d0 0x7f7600157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 --2- 172.21.15.3:0/1078882929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7600067060 0x7f760015c140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:42.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 >> 172.21.15.3:0/1078882929 conn(0x7f76000cfd80 msgr2=0x7f7600153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:42.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 shutdown_connections 2023-10-08T16:06:42.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:42.963+0000 7f75fffff700 1 -- 172.21.15.3:0/1078882929 wait complete. 2023-10-08T16:06:42.979 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:06:42.979 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:43.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 Processor -- start 2023-10-08T16:06:43.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 -- start start 2023-10-08T16:06:43.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f51c4154bb0 0x7f51c406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f51c4154f80 0x7f51c40c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c406aba0 con 0x7f51c40c7030 2023-10-08T16:06:43.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c406b720 con 0x7f51c4154f80 2023-10-08T16:06:43.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c8e26700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c406adf0 con 0x7f51c4154bb0 2023-10-08T16:06:43.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f51c4154f80 0x7f51c40c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f51c4154f80 0x7f51c40c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36616/0 (socket says 172.21.15.3:36616) 2023-10-08T16:06:43.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 -- 172.21.15.3:0/3452492170 learned_addr learned my addr 172.21.15.3:0/3452492170 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:43.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51c259c700 1 --2- 172.21.15.3:0/3452492170 >> v2:172.21.15.27:3300/0 conn(0x7f51c4154bb0 0x7f51c406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 -- 172.21.15.3:0/3452492170 >> v2:172.21.15.27:3300/0 conn(0x7f51c4154bb0 msgr2=0x7f51c406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 --2- 172.21.15.3:0/3452492170 >> v2:172.21.15.27:3300/0 conn(0x7f51c4154bb0 0x7f51c406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 -- 172.21.15.3:0/3452492170 >> v1:172.21.15.27:6789/0 conn(0x7f51c40c7030 legacy=0x7f51c406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 -- 172.21.15.3:0/3452492170 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c406b0d0 con 0x7f51c4154f80 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.083+0000 7f51bbfff700 1 --2- 172.21.15.3:0/3452492170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c4154f80 0x7f51c40c6af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51c40cb9f0 tx=0x7f51ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca294e4b930fab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c1d9b700 1 -- 172.21.15.3:0/3452492170 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00b860 con 0x7f51c4154f80 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c1d9b700 1 -- 172.21.15.3:0/3452492170 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00b9c0 con 0x7f51c4154f80 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c1d9b700 1 -- 172.21.15.3:0/3452492170 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00bd60 con 0x7f51c4154f80 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 -- 172.21.15.3:0/3452492170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c4154f80 msgr2=0x7f51c40c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 --2- 172.21.15.3:0/3452492170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c4154f80 0x7f51c40c6af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51c40cb9f0 tx=0x7f51ac009250 comp rx=0 tx=0).stop 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 -- 172.21.15.3:0/3452492170 shutdown_connections 2023-10-08T16:06:43.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 --2- 172.21.15.3:0/3452492170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c4154f80 0x7f51c40c6af0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 --2- 172.21.15.3:0/3452492170 >> v2:172.21.15.27:3300/0 conn(0x7f51c4154bb0 0x7f51c406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 -- 172.21.15.3:0/3452492170 >> 172.21.15.3:0/3452492170 conn(0x7f51c40cc5d0 msgr2=0x7f51c40c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:43.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 -- 172.21.15.3:0/3452492170 shutdown_connections 2023-10-08T16:06:43.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 -- 172.21.15.3:0/3452492170 wait complete. 2023-10-08T16:06:43.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 Processor -- start 2023-10-08T16:06:43.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 -- start start 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.087+0000 7f51c8e26700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 0x7f51c40c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51c4154bb0 0x7f51c4158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51c4154f80 0x7f51c414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4158640 con 0x7f51c40c7030 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40c1900 con 0x7f51c4154f80 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40b1370 con 0x7f51c4154bb0 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 0x7f51c40c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 0x7f51c40c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36632/0 (socket says 172.21.15.3:36632) 2023-10-08T16:06:43.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51c4154f80 0x7f51c414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 -- 172.21.15.3:0/2575782457 learned_addr learned my addr 172.21.15.3:0/2575782457 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:43.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51bbfff700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51c4154bb0 0x7f51c4158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 -- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51c4154bb0 msgr2=0x7f51c4158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51c4154bb0 0x7f51c4158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 -- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51c4154f80 msgr2=0x7f51c414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51c4154f80 0x7f51c414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 -- 172.21.15.3:0/2575782457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0094f0 con 0x7f51c40c7030 2023-10-08T16:06:43.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c2d9d700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51c4154f80 0x7f51c414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c259c700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 0x7f51c40c1d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51b400d890 tx=0x7f51b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40125f0 con 0x7f51c40c7030 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4012750 con 0x7f51c40c7030 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c40b1650 con 0x7f51c40c7030 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4012af0 con 0x7f51c40c7030 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c40c1260 con 0x7f51c40c7030 2023-10-08T16:06:43.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.091+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c404be40 con 0x7f51c40c7030 2023-10-08T16:06:43.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.095+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f51b401e460 con 0x7f51c40c7030 2023-10-08T16:06:43.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.095+0000 7f51ba7fc700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f51a4060550 0x7f51a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.095+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51b407cea0 con 0x7f51c40c7030 2023-10-08T16:06:43.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.095+0000 7f51bbfff700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f51a4060550 0x7f51a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.095+0000 7f51bbfff700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f51a4060550 0x7f51a4062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f51c40cb9f0 tx=0x7f51ac017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.103+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f51b404d3f0 con 0x7f51c40c7030 2023-10-08T16:06:43.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.267+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51c406a6c0 con 0x7f51a4060550 2023-10-08T16:06:43.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.283+0000 7f51ba7fc700 1 -- 172.21.15.3:0/2575782457 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249653 (secure 0 0 0) 0x7f51c406a6c0 con 0x7f51a4060550 2023-10-08T16:06:43.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:43.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f51a4060550 msgr2=0x7f51a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f51a4060550 0x7f51a4062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f51c40cb9f0 tx=0x7f51ac017000 comp rx=0 tx=0).stop 2023-10-08T16:06:43.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 msgr2=0x7f51c40c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 0x7f51c40c1d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51b400d890 tx=0x7f51b4008040 comp rx=0 tx=0).stop 2023-10-08T16:06:43.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 shutdown_connections 2023-10-08T16:06:43.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f51a4060550 0x7f51a4062a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51c4154f80 0x7f51c414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51c4154bb0 0x7f51c4158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 --2- 172.21.15.3:0/2575782457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51c40c7030 0x7f51c40c1d90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 >> 172.21.15.3:0/2575782457 conn(0x7f51c40cc5d0 msgr2=0x7f51c41565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 shutdown_connections 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.287+0000 7f51c8e26700 1 -- 172.21.15.3:0/2575782457 wait complete. 2023-10-08T16:06:43.293 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:43.309 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T16:06:41.819744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2380808,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593912,"statfs":{"total":773094113280,"available":770656165888,"internally_reserved":0,"allocated":2433024,"data_stored":1545016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001150"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T16:06:31.230611+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:31.230611+0000","last_peered":"2023-10-08T16:06:31.230611+0000","last_clean":"2023-10-08T16:06:31.230611+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:31.230611+0000","last_undegraded":"2023-10-08T16:06:31.230611+0000","last_fullsized":"2023-10-08T16:06:31.230611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298020,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073820,"statfs":{"total":96636764160,"available":96331591680,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:43.315 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.415+0000 7f7d2c7f1700 1 Processor -- start 2023-10-08T16:06:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2c7f1700 1 -- start start 2023-10-08T16:06:43.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2c7f1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d2415d1e0 0x7f7d2415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2c7f1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2406c8a0 con 0x7f7d240c6d30 2023-10-08T16:06:43.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2c7f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2406cb80 con 0x7f7d240c68e0 2023-10-08T16:06:43.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2c7f1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2406ce60 con 0x7f7d2415d1e0 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2ad8e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7d240c6d30 0x7f7d2406d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56858/0 (socket says 172.21.15.3:56858) 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2ad8e700 1 -- 172.21.15.3:0/2010095457 learned_addr learned my addr 172.21.15.3:0/2010095457 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2a58d700 1 --2- 172.21.15.3:0/2010095457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d2415d1e0 0x7f7d2415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601561026 0 0) 0x7f7d2406c8a0 con 0x7f7d240c6d30 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d10003570 con 0x7f7d240c6d30 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650634339 0 0) 0x7f7d2406cb80 con 0x7f7d240c68e0 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d2406c8a0 con 0x7f7d240c68e0 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1472358128 0 0) 0x7f7d10003570 con 0x7f7d240c6d30 2023-10-08T16:06:43.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2a58d700 1 -- 172.21.15.3:0/2010095457 >> v1:172.21.15.27:6789/0 conn(0x7f7d240c68e0 legacy=0x7f7d240ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2a58d700 1 -- 172.21.15.3:0/2010095457 >> v1:172.21.15.3:6789/0 conn(0x7f7d240c6d30 legacy=0x7f7d2406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2a58d700 1 -- 172.21.15.3:0/2010095457 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2406d140 con 0x7f7d2415d1e0 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2a58d700 1 --2- 172.21.15.3:0/2010095457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d2415d1e0 0x7f7d2415d5b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009910 tx=0x7f7d200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9878589da85f992 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0017f0 con 0x7f7d2415d1e0 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20011420 con 0x7f7d2415d1e0 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.419+0000 7f7d2958b700 1 -- 172.21.15.3:0/2010095457 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200117a0 con 0x7f7d2415d1e0 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2010095457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d2415d1e0 msgr2=0x7f7d2415d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2010095457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d2415d1e0 0x7f7d2415d5b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009910 tx=0x7f7d200091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2010095457 shutdown_connections 2023-10-08T16:06:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2010095457 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d2415d1e0 0x7f7d2415d5b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2010095457 >> 172.21.15.3:0/2010095457 conn(0x7f7d240cc5d0 msgr2=0x7f7d240c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2010095457 shutdown_connections 2023-10-08T16:06:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2010095457 wait complete. 2023-10-08T16:06:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 Processor -- start 2023-10-08T16:06:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- start start 2023-10-08T16:06:43.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d240c68e0 0x7f7d240b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d240c6d30 0x7f7d240c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 0x7f7d241550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240c5350 con 0x7f7d2415d1e0 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240c5e20 con 0x7f7d240c6d30 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2c7f1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240c5580 con 0x7f7d240c68e0 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2ad8e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 0x7f7d241550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2ad8e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 0x7f7d241550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36644/0 (socket says 172.21.15.3:36644) 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2ad8e700 1 -- 172.21.15.3:0/2448174960 learned_addr learned my addr 172.21.15.3:0/2448174960 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2a58d700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d240c68e0 0x7f7d240b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d29d8c700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d240c6d30 0x7f7d240c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2ad8e700 1 -- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d240c68e0 msgr2=0x7f7d240b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.423+0000 7f7d2ad8e700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d240c68e0 0x7f7d240b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2ad8e700 1 -- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d240c6d30 msgr2=0x7f7d240c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2ad8e700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d240c6d30 0x7f7d240c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2ad8e700 1 -- 172.21.15.3:0/2448174960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20009420 con 0x7f7d2415d1e0 2023-10-08T16:06:43.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2ad8e700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 0x7f7d241550c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c001560 tx=0x7f7d1c007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c004dc0 con 0x7f7d2415d1e0 2023-10-08T16:06:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c00a640 con 0x7f7d2415d1e0 2023-10-08T16:06:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d240c5860 con 0x7f7d2415d1e0 2023-10-08T16:06:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00a9e0 con 0x7f7d2415d1e0 2023-10-08T16:06:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d240aea10 con 0x7f7d2415d1e0 2023-10-08T16:06:43.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d240aec30 con 0x7f7d2415d1e0 2023-10-08T16:06:43.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.427+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7d1c007150 con 0x7f7d2415d1e0 2023-10-08T16:06:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.431+0000 7f7d167fc700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7d08060550 0x7f7d08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.431+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d1c07c2a0 con 0x7f7d2415d1e0 2023-10-08T16:06:43.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.431+0000 7f7d2a58d700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7d08060550 0x7f7d08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.431+0000 7f7d2a58d700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7d08060550 0x7f7d08062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d200091e0 tx=0x7f7d20016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.439+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d1c04c890 con 0x7f7d2415d1e0 2023-10-08T16:06:43.558 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-10-08T16:06:43.555+0000 7f0442a29700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:06:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.599+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d2404be40 con 0x7f7d08060550 2023-10-08T16:06:43.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.615+0000 7f7d167fc700 1 -- 172.21.15.3:0/2448174960 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249653 (secure 0 0 0) 0x7f7d2404be40 con 0x7f7d08060550 2023-10-08T16:06:43.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7d08060550 msgr2=0x7f7d08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7d08060550 0x7f7d08062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d200091e0 tx=0x7f7d20016000 comp rx=0 tx=0).stop 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 msgr2=0x7f7d241550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 0x7f7d241550c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c001560 tx=0x7f7d1c007d20 comp rx=0 tx=0).stop 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 shutdown_connections 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7d08060550 0x7f7d08062a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d2415d1e0 0x7f7d241550c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d240c6d30 0x7f7d240c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 --2- 172.21.15.3:0/2448174960 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7d240c68e0 0x7f7d240b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 >> 172.21.15.3:0/2448174960 conn(0x7f7d240cc5d0 msgr2=0x7f7d240c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:43.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 shutdown_connections 2023-10-08T16:06:43.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.619+0000 7f7d2c7f1700 1 -- 172.21.15.3:0/2448174960 wait complete. 2023-10-08T16:06:43.624 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:43.636 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T16:06:41.819744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2380808,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593912,"statfs":{"total":773094113280,"available":770656165888,"internally_reserved":0,"allocated":2433024,"data_stored":1545016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001150"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T16:06:31.230611+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:31.230611+0000","last_peered":"2023-10-08T16:06:31.230611+0000","last_clean":"2023-10-08T16:06:31.230611+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:31.230611+0000","last_undegraded":"2023-10-08T16:06:31.230611+0000","last_fullsized":"2023-10-08T16:06:31.230611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:39.256831+0000","last_change":"2023-10-08T16:06:39.256831+0000","last_active":"2023-10-08T16:06:39.256831+0000","last_peered":"2023-10-08T16:06:39.256831+0000","last_clean":"2023-10-08T16:06:39.256831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:39.256831+0000","last_undegraded":"2023-10-08T16:06:39.256831+0000","last_fullsized":"2023-10-08T16:06:39.256831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:06:38.245940+0000","last_change":"2023-10-08T16:06:38.245940+0000","last_active":"2023-10-08T16:06:38.245940+0000","last_peered":"2023-10-08T16:06:38.245940+0000","last_clean":"2023-10-08T16:06:38.245940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:06:38.245940+0000","last_undegraded":"2023-10-08T16:06:38.245940+0000","last_fullsized":"2023-10-08T16:06:38.245940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298020,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073820,"statfs":{"total":96636764160,"available":96331591680,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:43.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:43.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 Processor -- start 2023-10-08T16:06:43.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 -- start start 2023-10-08T16:06:43.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6dec158b90 0x7f6dec158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6dec06a400 0x7f6dec06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec0cad20 0x7f6dec0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec1594a0 con 0x7f6dec06a400 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec0ca2d0 con 0x7f6dec158b90 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.743+0000 7f6df29e0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0ca890 con 0x7f6dec0cad20 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6dec06a400 0x7f6dec06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6dec06a400 0x7f6dec06a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36648/0 (socket says 172.21.15.3:36648) 2023-10-08T16:06:43.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 -- 172.21.15.3:0/789515453 learned_addr learned my addr 172.21.15.3:0/789515453 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:43.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df19de700 1 --2- 172.21.15.3:0/789515453 >> v2:172.21.15.27:3300/0 conn(0x7f6dec158b90 0x7f6dec158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df21df700 1 --2- 172.21.15.3:0/789515453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec0cad20 0x7f6dec0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 -- 172.21.15.3:0/789515453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec0cad20 msgr2=0x7f6dec0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:43.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 --2- 172.21.15.3:0/789515453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec0cad20 0x7f6dec0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 -- 172.21.15.3:0/789515453 >> v2:172.21.15.27:3300/0 conn(0x7f6dec158b90 msgr2=0x7f6dec158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:43.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 --2- 172.21.15.3:0/789515453 >> v2:172.21.15.27:3300/0 conn(0x7f6dec158b90 0x7f6dec158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 -- 172.21.15.3:0/789515453 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec159890 con 0x7f6dec06a400 2023-10-08T16:06:43.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df11dd700 1 --2- 172.21.15.3:0/789515453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec06a400 0x7f6dec06a880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6dec069e60 tx=0x7f6de8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4164655146e196a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df09dc700 1 -- 172.21.15.3:0/789515453 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800b860 con 0x7f6dec06a400 2023-10-08T16:06:43.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df09dc700 1 -- 172.21.15.3:0/789515453 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800b9c0 con 0x7f6dec06a400 2023-10-08T16:06:43.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df09dc700 1 -- 172.21.15.3:0/789515453 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800bd60 con 0x7f6dec06a400 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 -- 172.21.15.3:0/789515453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec06a400 msgr2=0x7f6dec06a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 --2- 172.21.15.3:0/789515453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec06a400 0x7f6dec06a880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6dec069e60 tx=0x7f6de8009250 comp rx=0 tx=0).stop 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 -- 172.21.15.3:0/789515453 shutdown_connections 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 --2- 172.21.15.3:0/789515453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec0cad20 0x7f6dec0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 --2- 172.21.15.3:0/789515453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec06a400 0x7f6dec06a880 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 --2- 172.21.15.3:0/789515453 >> v2:172.21.15.27:3300/0 conn(0x7f6dec158b90 0x7f6dec158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 -- 172.21.15.3:0/789515453 >> 172.21.15.3:0/789515453 conn(0x7f6dec0cfd30 msgr2=0x7f6dec0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 -- 172.21.15.3:0/789515453 shutdown_connections 2023-10-08T16:06:43.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.747+0000 7f6df29e0700 1 -- 172.21.15.3:0/789515453 wait complete. 2023-10-08T16:06:43.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 Processor -- start 2023-10-08T16:06:43.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 -- start start 2023-10-08T16:06:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec06a400 0x7f6dec0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 0x7f6dec0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dec158b90 0x7f6dec1693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0c5880 con 0x7f6dec0cad20 2023-10-08T16:06:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0c4c70 con 0x7f6dec158b90 2023-10-08T16:06:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.751+0000 7f6df29e0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0c4f50 con 0x7f6dec06a400 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 0x7f6dec0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df19de700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec06a400 0x7f6dec0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 0x7f6dec0c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36650/0 (socket says 172.21.15.3:36650) 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 -- 172.21.15.3:0/1044573179 learned_addr learned my addr 172.21.15.3:0/1044573179 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df21df700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dec158b90 0x7f6dec1693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 -- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec06a400 msgr2=0x7f6dec0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec06a400 0x7f6dec0c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 -- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dec158b90 msgr2=0x7f6dec1693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dec158b90 0x7f6dec1693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 -- 172.21.15.3:0/1044573179 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de80094f0 con 0x7f6dec0cad20 2023-10-08T16:06:43.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df11dd700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 0x7f6dec0c9a50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6dec069f10 tx=0x7f6de8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8011dc0 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8024440 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec0c5230 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8024800 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec0c9f90 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec0c6250 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6de801a420 con 0x7f6dec0cad20 2023-10-08T16:06:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6de1ffb700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6dd0060550 0x7f6dd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6df19de700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6dd0060550 0x7f6dd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.755+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6de807e5b0 con 0x7f6dec0cad20 2023-10-08T16:06:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.759+0000 7f6df19de700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6dd0060550 0x7f6dd0062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006fd0 tx=0x7f6ddc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:43.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.767+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6de804ec20 con 0x7f6dec0cad20 2023-10-08T16:06:43.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.927+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dec0b23a0 con 0x7f6dd0060550 2023-10-08T16:06:43.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.943+0000 7f6de1ffb700 1 -- 172.21.15.3:0/1044573179 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264424 (secure 0 0 0) 0x7f6dec0b23a0 con 0x7f6dd0060550 2023-10-08T16:06:43.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:43.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.947+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6dd0060550 msgr2=0x7f6dd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.947+0000 7f6df29e0700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6dd0060550 0x7f6dd0062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006fd0 tx=0x7f6ddc008040 comp rx=0 tx=0).stop 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.947+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 msgr2=0x7f6dec0c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.947+0000 7f6df29e0700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 0x7f6dec0c9a50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6dec069f10 tx=0x7f6de8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.947+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 shutdown_connections 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6dd0060550 0x7f6dd0062a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dec158b90 0x7f6dec1693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dec0cad20 0x7f6dec0c9a50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 --2- 172.21.15.3:0/1044573179 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dec06a400 0x7f6dec0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 >> 172.21.15.3:0/1044573179 conn(0x7f6dec0cfd30 msgr2=0x7f6dec15a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 shutdown_connections 2023-10-08T16:06:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:43.951+0000 7f6df29e0700 1 -- 172.21.15.3:0/1044573179 wait complete. 2023-10-08T16:06:43.954 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:43.968 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-08T16:06:43.820356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.563080"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.280053+0000","last_change":"2023-10-08T16:06:40.276055+0000","last_active":"2023-10-08T16:06:40.280053+0000","last_peered":"2023-10-08T16:06:40.280053+0000","last_clean":"2023-10-08T16:06:40.280053+0000","last_became_active":"2023-10-08T16:06:40.275720+0000","last_became_peered":"2023-10-08T16:06:40.275720+0000","last_unstale":"2023-10-08T16:06:40.280053+0000","last_undegraded":"2023-10-08T16:06:40.280053+0000","last_fullsized":"2023-10-08T16:06:40.280053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271636+0000","last_change":"2023-10-08T16:06:40.270216+0000","last_active":"2023-10-08T16:06:40.271636+0000","last_peered":"2023-10-08T16:06:40.271636+0000","last_clean":"2023-10-08T16:06:40.271636+0000","last_became_active":"2023-10-08T16:06:40.269903+0000","last_became_peered":"2023-10-08T16:06:40.269903+0000","last_unstale":"2023-10-08T16:06:40.271636+0000","last_undegraded":"2023-10-08T16:06:40.271636+0000","last_fullsized":"2023-10-08T16:06:40.271636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269395+0000","last_change":"2023-10-08T16:06:40.258935+0000","last_active":"2023-10-08T16:06:40.269395+0000","last_peered":"2023-10-08T16:06:40.269395+0000","last_clean":"2023-10-08T16:06:40.269395+0000","last_became_active":"2023-10-08T16:06:40.256957+0000","last_became_peered":"2023-10-08T16:06:40.256957+0000","last_unstale":"2023-10-08T16:06:40.269395+0000","last_undegraded":"2023-10-08T16:06:40.269395+0000","last_fullsized":"2023-10-08T16:06:40.269395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282471+0000","last_change":"2023-10-08T16:06:40.275472+0000","last_active":"2023-10-08T16:06:40.282471+0000","last_peered":"2023-10-08T16:06:40.282471+0000","last_clean":"2023-10-08T16:06:40.282471+0000","last_became_active":"2023-10-08T16:06:40.275178+0000","last_became_peered":"2023-10-08T16:06:40.275178+0000","last_unstale":"2023-10-08T16:06:40.282471+0000","last_undegraded":"2023-10-08T16:06:40.282471+0000","last_fullsized":"2023-10-08T16:06:40.282471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276523+0000","last_change":"2023-10-08T16:06:40.270577+0000","last_active":"2023-10-08T16:06:40.276523+0000","last_peered":"2023-10-08T16:06:40.276523+0000","last_clean":"2023-10-08T16:06:40.276523+0000","last_became_active":"2023-10-08T16:06:40.270269+0000","last_became_peered":"2023-10-08T16:06:40.270269+0000","last_unstale":"2023-10-08T16:06:40.276523+0000","last_undegraded":"2023-10-08T16:06:40.276523+0000","last_fullsized":"2023-10-08T16:06:40.276523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279700+0000","last_change":"2023-10-08T16:06:40.272575+0000","last_active":"2023-10-08T16:06:40.279700+0000","last_peered":"2023-10-08T16:06:40.279700+0000","last_clean":"2023-10-08T16:06:40.279700+0000","last_became_active":"2023-10-08T16:06:40.272126+0000","last_became_peered":"2023-10-08T16:06:40.272126+0000","last_unstale":"2023-10-08T16:06:40.279700+0000","last_undegraded":"2023-10-08T16:06:40.279700+0000","last_fullsized":"2023-10-08T16:06:40.279700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279736+0000","last_change":"2023-10-08T16:06:40.277232+0000","last_active":"2023-10-08T16:06:40.279736+0000","last_peered":"2023-10-08T16:06:40.279736+0000","last_clean":"2023-10-08T16:06:40.279736+0000","last_became_active":"2023-10-08T16:06:40.276903+0000","last_became_peered":"2023-10-08T16:06:40.276903+0000","last_unstale":"2023-10-08T16:06:40.279736+0000","last_undegraded":"2023-10-08T16:06:40.279736+0000","last_fullsized":"2023-10-08T16:06:40.279736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281289+0000","last_change":"2023-10-08T16:06:40.279113+0000","last_active":"2023-10-08T16:06:40.281289+0000","last_peered":"2023-10-08T16:06:40.281289+0000","last_clean":"2023-10-08T16:06:40.281289+0000","last_became_active":"2023-10-08T16:06:40.278772+0000","last_became_peered":"2023-10-08T16:06:40.278772+0000","last_unstale":"2023-10-08T16:06:40.281289+0000","last_undegraded":"2023-10-08T16:06:40.281289+0000","last_fullsized":"2023-10-08T16:06:40.281289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.284590+0000","last_change":"2023-10-08T16:06:40.280182+0000","last_active":"2023-10-08T16:06:40.284590+0000","last_peered":"2023-10-08T16:06:40.284590+0000","last_clean":"2023-10-08T16:06:40.284590+0000","last_became_active":"2023-10-08T16:06:40.279850+0000","last_became_peered":"2023-10-08T16:06:40.279850+0000","last_unstale":"2023-10-08T16:06:40.284590+0000","last_undegraded":"2023-10-08T16:06:40.284590+0000","last_fullsized":"2023-10-08T16:06:40.284590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:54.574906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279582+0000","last_change":"2023-10-08T16:06:40.275718+0000","last_active":"2023-10-08T16:06:40.279582+0000","last_peered":"2023-10-08T16:06:40.279582+0000","last_clean":"2023-10-08T16:06:40.279582+0000","last_became_active":"2023-10-08T16:06:40.275419+0000","last_became_peered":"2023-10-08T16:06:40.275419+0000","last_unstale":"2023-10-08T16:06:40.279582+0000","last_undegraded":"2023-10-08T16:06:40.279582+0000","last_fullsized":"2023-10-08T16:06:40.279582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281916+0000","last_change":"2023-10-08T16:06:40.276225+0000","last_active":"2023-10-08T16:06:40.281916+0000","last_peered":"2023-10-08T16:06:40.281916+0000","last_clean":"2023-10-08T16:06:40.281916+0000","last_became_active":"2023-10-08T16:06:40.275876+0000","last_became_peered":"2023-10-08T16:06:40.275876+0000","last_unstale":"2023-10-08T16:06:40.281916+0000","last_undegraded":"2023-10-08T16:06:40.281916+0000","last_fullsized":"2023-10-08T16:06:40.281916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270998+0000","last_change":"2023-10-08T16:06:40.264918+0000","last_active":"2023-10-08T16:06:40.270998+0000","last_peered":"2023-10-08T16:06:40.270998+0000","last_clean":"2023-10-08T16:06:40.270998+0000","last_became_active":"2023-10-08T16:06:40.264124+0000","last_became_peered":"2023-10-08T16:06:40.264124+0000","last_unstale":"2023-10-08T16:06:40.270998+0000","last_undegraded":"2023-10-08T16:06:40.270998+0000","last_fullsized":"2023-10-08T16:06:40.270998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273343+0000","last_change":"2023-10-08T16:06:40.269867+0000","last_active":"2023-10-08T16:06:40.273343+0000","last_peered":"2023-10-08T16:06:40.273343+0000","last_clean":"2023-10-08T16:06:40.273343+0000","last_became_active":"2023-10-08T16:06:40.268208+0000","last_became_peered":"2023-10-08T16:06:40.268208+0000","last_unstale":"2023-10-08T16:06:40.273343+0000","last_undegraded":"2023-10-08T16:06:40.273343+0000","last_fullsized":"2023-10-08T16:06:40.273343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275554+0000","last_change":"2023-10-08T16:06:40.264028+0000","last_active":"2023-10-08T16:06:40.275554+0000","last_peered":"2023-10-08T16:06:40.275554+0000","last_clean":"2023-10-08T16:06:40.275554+0000","last_became_active":"2023-10-08T16:06:40.263715+0000","last_became_peered":"2023-10-08T16:06:40.263715+0000","last_unstale":"2023-10-08T16:06:40.275554+0000","last_undegraded":"2023-10-08T16:06:40.275554+0000","last_fullsized":"2023-10-08T16:06:40.275554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:55.266658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271470+0000","last_change":"2023-10-08T16:06:40.269258+0000","last_active":"2023-10-08T16:06:40.271470+0000","last_peered":"2023-10-08T16:06:40.271470+0000","last_clean":"2023-10-08T16:06:40.271470+0000","last_became_active":"2023-10-08T16:06:40.268883+0000","last_became_peered":"2023-10-08T16:06:40.268883+0000","last_unstale":"2023-10-08T16:06:40.271470+0000","last_undegraded":"2023-10-08T16:06:40.271470+0000","last_fullsized":"2023-10-08T16:06:40.271470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282671+0000","last_change":"2023-10-08T16:06:40.278397+0000","last_active":"2023-10-08T16:06:40.282671+0000","last_peered":"2023-10-08T16:06:40.282671+0000","last_clean":"2023-10-08T16:06:40.282671+0000","last_became_active":"2023-10-08T16:06:40.277981+0000","last_became_peered":"2023-10-08T16:06:40.277981+0000","last_unstale":"2023-10-08T16:06:40.282671+0000","last_undegraded":"2023-10-08T16:06:40.282671+0000","last_fullsized":"2023-10-08T16:06:40.282671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282436+0000","last_change":"2023-10-08T16:06:40.276109+0000","last_active":"2023-10-08T16:06:40.282436+0000","last_peered":"2023-10-08T16:06:40.282436+0000","last_clean":"2023-10-08T16:06:40.282436+0000","last_became_active":"2023-10-08T16:06:40.275481+0000","last_became_peered":"2023-10-08T16:06:40.275481+0000","last_unstale":"2023-10-08T16:06:40.282436+0000","last_undegraded":"2023-10-08T16:06:40.282436+0000","last_fullsized":"2023-10-08T16:06:40.282436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267040+0000","last_change":"2023-10-08T16:06:40.261754+0000","last_active":"2023-10-08T16:06:40.267040+0000","last_peered":"2023-10-08T16:06:40.267040+0000","last_clean":"2023-10-08T16:06:40.267040+0000","last_became_active":"2023-10-08T16:06:40.261437+0000","last_became_peered":"2023-10-08T16:06:40.261437+0000","last_unstale":"2023-10-08T16:06:40.267040+0000","last_undegraded":"2023-10-08T16:06:40.267040+0000","last_fullsized":"2023-10-08T16:06:40.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277114+0000","last_change":"2023-10-08T16:06:40.271380+0000","last_active":"2023-10-08T16:06:40.277114+0000","last_peered":"2023-10-08T16:06:40.277114+0000","last_clean":"2023-10-08T16:06:40.277114+0000","last_became_active":"2023-10-08T16:06:40.271014+0000","last_became_peered":"2023-10-08T16:06:40.271014+0000","last_unstale":"2023-10-08T16:06:40.277114+0000","last_undegraded":"2023-10-08T16:06:40.277114+0000","last_fullsized":"2023-10-08T16:06:40.277114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275113+0000","last_change":"2023-10-08T16:06:40.264967+0000","last_active":"2023-10-08T16:06:40.275113+0000","last_peered":"2023-10-08T16:06:40.275113+0000","last_clean":"2023-10-08T16:06:40.275113+0000","last_became_active":"2023-10-08T16:06:40.264522+0000","last_became_peered":"2023-10-08T16:06:40.264522+0000","last_unstale":"2023-10-08T16:06:40.275113+0000","last_undegraded":"2023-10-08T16:06:40.275113+0000","last_fullsized":"2023-10-08T16:06:40.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275758+0000","last_change":"2023-10-08T16:06:40.266852+0000","last_active":"2023-10-08T16:06:40.275758+0000","last_peered":"2023-10-08T16:06:40.275758+0000","last_clean":"2023-10-08T16:06:40.275758+0000","last_became_active":"2023-10-08T16:06:40.266394+0000","last_became_peered":"2023-10-08T16:06:40.266394+0000","last_unstale":"2023-10-08T16:06:40.275758+0000","last_undegraded":"2023-10-08T16:06:40.275758+0000","last_fullsized":"2023-10-08T16:06:40.275758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279658+0000","last_change":"2023-10-08T16:06:40.272299+0000","last_active":"2023-10-08T16:06:40.279658+0000","last_peered":"2023-10-08T16:06:40.279658+0000","last_clean":"2023-10-08T16:06:40.279658+0000","last_became_active":"2023-10-08T16:06:40.271714+0000","last_became_peered":"2023-10-08T16:06:40.271714+0000","last_unstale":"2023-10-08T16:06:40.279658+0000","last_undegraded":"2023-10-08T16:06:40.279658+0000","last_fullsized":"2023-10-08T16:06:40.279658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268225+0000","last_change":"2023-10-08T16:06:40.266098+0000","last_active":"2023-10-08T16:06:40.268225+0000","last_peered":"2023-10-08T16:06:40.268225+0000","last_clean":"2023-10-08T16:06:40.268225+0000","last_became_active":"2023-10-08T16:06:40.265779+0000","last_became_peered":"2023-10-08T16:06:40.265779+0000","last_unstale":"2023-10-08T16:06:40.268225+0000","last_undegraded":"2023-10-08T16:06:40.268225+0000","last_fullsized":"2023-10-08T16:06:40.268225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279321+0000","last_change":"2023-10-08T16:06:40.269099+0000","last_active":"2023-10-08T16:06:40.279321+0000","last_peered":"2023-10-08T16:06:40.279321+0000","last_clean":"2023-10-08T16:06:40.279321+0000","last_became_active":"2023-10-08T16:06:40.268796+0000","last_became_peered":"2023-10-08T16:06:40.268796+0000","last_unstale":"2023-10-08T16:06:40.279321+0000","last_undegraded":"2023-10-08T16:06:40.279321+0000","last_fullsized":"2023-10-08T16:06:40.279321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268296+0000","last_change":"2023-10-08T16:06:40.264696+0000","last_active":"2023-10-08T16:06:40.268296+0000","last_peered":"2023-10-08T16:06:40.268296+0000","last_clean":"2023-10-08T16:06:40.268296+0000","last_became_active":"2023-10-08T16:06:40.264322+0000","last_became_peered":"2023-10-08T16:06:40.264322+0000","last_unstale":"2023-10-08T16:06:40.268296+0000","last_undegraded":"2023-10-08T16:06:40.268296+0000","last_fullsized":"2023-10-08T16:06:40.268296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275189+0000","last_change":"2023-10-08T16:06:40.266542+0000","last_active":"2023-10-08T16:06:40.275189+0000","last_peered":"2023-10-08T16:06:40.275189+0000","last_clean":"2023-10-08T16:06:40.275189+0000","last_became_active":"2023-10-08T16:06:40.266258+0000","last_became_peered":"2023-10-08T16:06:40.266258+0000","last_unstale":"2023-10-08T16:06:40.275189+0000","last_undegraded":"2023-10-08T16:06:40.275189+0000","last_fullsized":"2023-10-08T16:06:40.275189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270627+0000","last_change":"2023-10-08T16:06:40.268954+0000","last_active":"2023-10-08T16:06:40.270627+0000","last_peered":"2023-10-08T16:06:40.270627+0000","last_clean":"2023-10-08T16:06:40.270627+0000","last_became_active":"2023-10-08T16:06:40.268456+0000","last_became_peered":"2023-10-08T16:06:40.268456+0000","last_unstale":"2023-10-08T16:06:40.270627+0000","last_undegraded":"2023-10-08T16:06:40.270627+0000","last_fullsized":"2023-10-08T16:06:40.270627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273146+0000","last_change":"2023-10-08T16:06:40.268821+0000","last_active":"2023-10-08T16:06:40.273146+0000","last_peered":"2023-10-08T16:06:40.273146+0000","last_clean":"2023-10-08T16:06:40.273146+0000","last_became_active":"2023-10-08T16:06:40.268485+0000","last_became_peered":"2023-10-08T16:06:40.268485+0000","last_unstale":"2023-10-08T16:06:40.273146+0000","last_undegraded":"2023-10-08T16:06:40.273146+0000","last_fullsized":"2023-10-08T16:06:40.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275805+0000","last_change":"2023-10-08T16:06:40.267487+0000","last_active":"2023-10-08T16:06:40.275805+0000","last_peered":"2023-10-08T16:06:40.275805+0000","last_clean":"2023-10-08T16:06:40.275805+0000","last_became_active":"2023-10-08T16:06:40.267198+0000","last_became_peered":"2023-10-08T16:06:40.267198+0000","last_unstale":"2023-10-08T16:06:40.275805+0000","last_undegraded":"2023-10-08T16:06:40.275805+0000","last_fullsized":"2023-10-08T16:06:40.275805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279681+0000","last_change":"2023-10-08T16:06:40.272431+0000","last_active":"2023-10-08T16:06:40.279681+0000","last_peered":"2023-10-08T16:06:40.279681+0000","last_clean":"2023-10-08T16:06:40.279681+0000","last_became_active":"2023-10-08T16:06:40.271999+0000","last_became_peered":"2023-10-08T16:06:40.271999+0000","last_unstale":"2023-10-08T16:06:40.279681+0000","last_undegraded":"2023-10-08T16:06:40.279681+0000","last_fullsized":"2023-10-08T16:06:40.279681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278116+0000","last_change":"2023-10-08T16:06:40.273286+0000","last_active":"2023-10-08T16:06:40.278116+0000","last_peered":"2023-10-08T16:06:40.278116+0000","last_clean":"2023-10-08T16:06:40.278116+0000","last_became_active":"2023-10-08T16:06:40.272933+0000","last_became_peered":"2023-10-08T16:06:40.272933+0000","last_unstale":"2023-10-08T16:06:40.278116+0000","last_undegraded":"2023-10-08T16:06:40.278116+0000","last_fullsized":"2023-10-08T16:06:40.278116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275156+0000","last_change":"2023-10-08T16:06:40.265329+0000","last_active":"2023-10-08T16:06:40.275156+0000","last_peered":"2023-10-08T16:06:40.275156+0000","last_clean":"2023-10-08T16:06:40.275156+0000","last_became_active":"2023-10-08T16:06:40.264972+0000","last_became_peered":"2023-10-08T16:06:40.264972+0000","last_unstale":"2023-10-08T16:06:40.275156+0000","last_undegraded":"2023-10-08T16:06:40.275156+0000","last_fullsized":"2023-10-08T16:06:40.275156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268526+0000","last_change":"2023-10-08T16:06:40.263993+0000","last_active":"2023-10-08T16:06:40.268526+0000","last_peered":"2023-10-08T16:06:40.268526+0000","last_clean":"2023-10-08T16:06:40.268526+0000","last_became_active":"2023-10-08T16:06:40.263538+0000","last_became_peered":"2023-10-08T16:06:40.263538+0000","last_unstale":"2023-10-08T16:06:40.268526+0000","last_undegraded":"2023-10-08T16:06:40.268526+0000","last_fullsized":"2023-10-08T16:06:40.268526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:29.217008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301721+0000","last_change":"2023-10-08T16:06:39.297623+0000","last_active":"2023-10-08T16:06:40.301721+0000","last_peered":"2023-10-08T16:06:40.301721+0000","last_clean":"2023-10-08T16:06:40.301721+0000","last_became_active":"2023-10-08T16:06:39.292440+0000","last_became_peered":"2023-10-08T16:06:39.292440+0000","last_unstale":"2023-10-08T16:06:40.301721+0000","last_undegraded":"2023-10-08T16:06:40.301721+0000","last_fullsized":"2023-10-08T16:06:40.301721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269305+0000","last_change":"2023-10-08T16:06:40.258340+0000","last_active":"2023-10-08T16:06:40.269305+0000","last_peered":"2023-10-08T16:06:40.269305+0000","last_clean":"2023-10-08T16:06:40.269305+0000","last_became_active":"2023-10-08T16:06:40.257980+0000","last_became_peered":"2023-10-08T16:06:40.257980+0000","last_unstale":"2023-10-08T16:06:40.269305+0000","last_undegraded":"2023-10-08T16:06:40.269305+0000","last_fullsized":"2023-10-08T16:06:40.269305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301568+0000","last_change":"2023-10-08T16:06:39.291777+0000","last_active":"2023-10-08T16:06:40.301568+0000","last_peered":"2023-10-08T16:06:40.301568+0000","last_clean":"2023-10-08T16:06:40.301568+0000","last_became_active":"2023-10-08T16:06:39.290855+0000","last_became_peered":"2023-10-08T16:06:39.290855+0000","last_unstale":"2023-10-08T16:06:40.301568+0000","last_undegraded":"2023-10-08T16:06:40.301568+0000","last_fullsized":"2023-10-08T16:06:40.301568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.255042+0000","last_change":"2023-10-08T16:06:39.301682+0000","last_active":"2023-10-08T16:06:40.255042+0000","last_peered":"2023-10-08T16:06:40.255042+0000","last_clean":"2023-10-08T16:06:40.255042+0000","last_became_active":"2023-10-08T16:06:39.300996+0000","last_became_peered":"2023-10-08T16:06:39.300996+0000","last_unstale":"2023-10-08T16:06:40.255042+0000","last_undegraded":"2023-10-08T16:06:40.255042+0000","last_fullsized":"2023-10-08T16:06:40.255042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270724+0000","last_change":"2023-10-08T16:06:40.266918+0000","last_active":"2023-10-08T16:06:40.270724+0000","last_peered":"2023-10-08T16:06:40.270724+0000","last_clean":"2023-10-08T16:06:40.270724+0000","last_became_active":"2023-10-08T16:06:40.266574+0000","last_became_peered":"2023-10-08T16:06:40.266574+0000","last_unstale":"2023-10-08T16:06:40.270724+0000","last_undegraded":"2023-10-08T16:06:40.270724+0000","last_fullsized":"2023-10-08T16:06:40.270724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269496+0000","last_change":"2023-10-08T16:06:39.294887+0000","last_active":"2023-10-08T16:06:40.269496+0000","last_peered":"2023-10-08T16:06:40.269496+0000","last_clean":"2023-10-08T16:06:40.269496+0000","last_became_active":"2023-10-08T16:06:39.294362+0000","last_became_peered":"2023-10-08T16:06:39.294362+0000","last_unstale":"2023-10-08T16:06:40.269496+0000","last_undegraded":"2023-10-08T16:06:40.269496+0000","last_fullsized":"2023-10-08T16:06:40.269496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270647+0000","last_change":"2023-10-08T16:06:40.269161+0000","last_active":"2023-10-08T16:06:40.270647+0000","last_peered":"2023-10-08T16:06:40.270647+0000","last_clean":"2023-10-08T16:06:40.270647+0000","last_became_active":"2023-10-08T16:06:40.268258+0000","last_became_peered":"2023-10-08T16:06:40.268258+0000","last_unstale":"2023-10-08T16:06:40.270647+0000","last_undegraded":"2023-10-08T16:06:40.270647+0000","last_fullsized":"2023-10-08T16:06:40.270647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253455+0000","last_change":"2023-10-08T16:06:39.298780+0000","last_active":"2023-10-08T16:06:40.253455+0000","last_peered":"2023-10-08T16:06:40.253455+0000","last_clean":"2023-10-08T16:06:40.253455+0000","last_became_active":"2023-10-08T16:06:39.298461+0000","last_became_peered":"2023-10-08T16:06:39.298461+0000","last_unstale":"2023-10-08T16:06:40.253455+0000","last_undegraded":"2023-10-08T16:06:40.253455+0000","last_fullsized":"2023-10-08T16:06:40.253455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282263+0000","last_change":"2023-10-08T16:06:40.275019+0000","last_active":"2023-10-08T16:06:40.282263+0000","last_peered":"2023-10-08T16:06:40.282263+0000","last_clean":"2023-10-08T16:06:40.282263+0000","last_became_active":"2023-10-08T16:06:40.269866+0000","last_became_peered":"2023-10-08T16:06:40.269866+0000","last_unstale":"2023-10-08T16:06:40.282263+0000","last_undegraded":"2023-10-08T16:06:40.282263+0000","last_fullsized":"2023-10-08T16:06:40.282263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.274887+0000","last_change":"2023-10-08T16:06:39.302453+0000","last_active":"2023-10-08T16:06:40.274887+0000","last_peered":"2023-10-08T16:06:40.274887+0000","last_clean":"2023-10-08T16:06:40.274887+0000","last_became_active":"2023-10-08T16:06:39.302108+0000","last_became_peered":"2023-10-08T16:06:39.302108+0000","last_unstale":"2023-10-08T16:06:40.274887+0000","last_undegraded":"2023-10-08T16:06:40.274887+0000","last_fullsized":"2023-10-08T16:06:40.274887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278252+0000","last_change":"2023-10-08T16:06:40.273266+0000","last_active":"2023-10-08T16:06:40.278252+0000","last_peered":"2023-10-08T16:06:40.278252+0000","last_clean":"2023-10-08T16:06:40.278252+0000","last_became_active":"2023-10-08T16:06:40.272860+0000","last_became_peered":"2023-10-08T16:06:40.272860+0000","last_unstale":"2023-10-08T16:06:40.278252+0000","last_undegraded":"2023-10-08T16:06:40.278252+0000","last_fullsized":"2023-10-08T16:06:40.278252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300737+0000","last_change":"2023-10-08T16:06:39.293871+0000","last_active":"2023-10-08T16:06:40.300737+0000","last_peered":"2023-10-08T16:06:40.300737+0000","last_clean":"2023-10-08T16:06:40.300737+0000","last_became_active":"2023-10-08T16:06:39.293517+0000","last_became_peered":"2023-10-08T16:06:39.293517+0000","last_unstale":"2023-10-08T16:06:40.300737+0000","last_undegraded":"2023-10-08T16:06:40.300737+0000","last_fullsized":"2023-10-08T16:06:40.300737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271405+0000","last_change":"2023-10-08T16:06:40.266413+0000","last_active":"2023-10-08T16:06:40.271405+0000","last_peered":"2023-10-08T16:06:40.271405+0000","last_clean":"2023-10-08T16:06:40.271405+0000","last_became_active":"2023-10-08T16:06:40.266098+0000","last_became_peered":"2023-10-08T16:06:40.266098+0000","last_unstale":"2023-10-08T16:06:40.271405+0000","last_undegraded":"2023-10-08T16:06:40.271405+0000","last_fullsized":"2023-10-08T16:06:40.271405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:25.752461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.307815+0000","last_change":"2023-10-08T16:06:39.296406+0000","last_active":"2023-10-08T16:06:40.307815+0000","last_peered":"2023-10-08T16:06:40.307815+0000","last_clean":"2023-10-08T16:06:40.307815+0000","last_became_active":"2023-10-08T16:06:39.296075+0000","last_became_peered":"2023-10-08T16:06:39.296075+0000","last_unstale":"2023-10-08T16:06:40.307815+0000","last_undegraded":"2023-10-08T16:06:40.307815+0000","last_fullsized":"2023-10-08T16:06:40.307815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275787+0000","last_change":"2023-10-08T16:06:40.270048+0000","last_active":"2023-10-08T16:06:40.275787+0000","last_peered":"2023-10-08T16:06:40.275787+0000","last_clean":"2023-10-08T16:06:40.275787+0000","last_became_active":"2023-10-08T16:06:40.269726+0000","last_became_peered":"2023-10-08T16:06:40.269726+0000","last_unstale":"2023-10-08T16:06:40.275787+0000","last_undegraded":"2023-10-08T16:06:40.275787+0000","last_fullsized":"2023-10-08T16:06:40.275787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301282+0000","last_change":"2023-10-08T16:06:39.294192+0000","last_active":"2023-10-08T16:06:40.301282+0000","last_peered":"2023-10-08T16:06:40.301282+0000","last_clean":"2023-10-08T16:06:40.301282+0000","last_became_active":"2023-10-08T16:06:39.293881+0000","last_became_peered":"2023-10-08T16:06:39.293881+0000","last_unstale":"2023-10-08T16:06:40.301282+0000","last_undegraded":"2023-10-08T16:06:40.301282+0000","last_fullsized":"2023-10-08T16:06:40.301282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:43.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275717+0000","last_change":"2023-10-08T16:06:40.266213+0000","last_active":"2023-10-08T16:06:40.275717+0000","last_peered":"2023-10-08T16:06:40.275717+0000","last_clean":"2023-10-08T16:06:40.275717+0000","last_became_active":"2023-10-08T16:06:40.265860+0000","last_became_peered":"2023-10-08T16:06:40.265860+0000","last_unstale":"2023-10-08T16:06:40.275717+0000","last_undegraded":"2023-10-08T16:06:40.275717+0000","last_fullsized":"2023-10-08T16:06:40.275717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269558+0000","last_change":"2023-10-08T16:06:39.300216+0000","last_active":"2023-10-08T16:06:40.269558+0000","last_peered":"2023-10-08T16:06:40.269558+0000","last_clean":"2023-10-08T16:06:40.269558+0000","last_became_active":"2023-10-08T16:06:39.299914+0000","last_became_peered":"2023-10-08T16:06:39.299914+0000","last_unstale":"2023-10-08T16:06:40.269558+0000","last_undegraded":"2023-10-08T16:06:40.269558+0000","last_fullsized":"2023-10-08T16:06:40.269558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277069+0000","last_change":"2023-10-08T16:06:40.272059+0000","last_active":"2023-10-08T16:06:40.277069+0000","last_peered":"2023-10-08T16:06:40.277069+0000","last_clean":"2023-10-08T16:06:40.277069+0000","last_became_active":"2023-10-08T16:06:40.271730+0000","last_became_peered":"2023-10-08T16:06:40.271730+0000","last_unstale":"2023-10-08T16:06:40.277069+0000","last_undegraded":"2023-10-08T16:06:40.277069+0000","last_fullsized":"2023-10-08T16:06:40.277069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.251622+0000","last_change":"2023-10-08T16:06:39.291194+0000","last_active":"2023-10-08T16:06:40.251622+0000","last_peered":"2023-10-08T16:06:40.251622+0000","last_clean":"2023-10-08T16:06:40.251622+0000","last_became_active":"2023-10-08T16:06:39.290849+0000","last_became_peered":"2023-10-08T16:06:39.290849+0000","last_unstale":"2023-10-08T16:06:40.251622+0000","last_undegraded":"2023-10-08T16:06:40.251622+0000","last_fullsized":"2023-10-08T16:06:40.251622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267696+0000","last_change":"2023-10-08T16:06:40.259709+0000","last_active":"2023-10-08T16:06:40.267696+0000","last_peered":"2023-10-08T16:06:40.267696+0000","last_clean":"2023-10-08T16:06:40.267696+0000","last_became_active":"2023-10-08T16:06:40.259122+0000","last_became_peered":"2023-10-08T16:06:40.259122+0000","last_unstale":"2023-10-08T16:06:40.267696+0000","last_undegraded":"2023-10-08T16:06:40.267696+0000","last_fullsized":"2023-10-08T16:06:40.267696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.306618+0000","last_change":"2023-10-08T16:06:39.291829+0000","last_active":"2023-10-08T16:06:40.306618+0000","last_peered":"2023-10-08T16:06:40.306618+0000","last_clean":"2023-10-08T16:06:40.306618+0000","last_became_active":"2023-10-08T16:06:39.291331+0000","last_became_peered":"2023-10-08T16:06:39.291331+0000","last_unstale":"2023-10-08T16:06:40.306618+0000","last_undegraded":"2023-10-08T16:06:40.306618+0000","last_fullsized":"2023-10-08T16:06:40.306618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277354+0000","last_change":"2023-10-08T16:06:40.270693+0000","last_active":"2023-10-08T16:06:40.277354+0000","last_peered":"2023-10-08T16:06:40.277354+0000","last_clean":"2023-10-08T16:06:40.277354+0000","last_became_active":"2023-10-08T16:06:40.269238+0000","last_became_peered":"2023-10-08T16:06:40.269238+0000","last_unstale":"2023-10-08T16:06:40.277354+0000","last_undegraded":"2023-10-08T16:06:40.277354+0000","last_fullsized":"2023-10-08T16:06:40.277354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.302954+0000","last_change":"2023-10-08T16:06:39.294859+0000","last_active":"2023-10-08T16:06:40.302954+0000","last_peered":"2023-10-08T16:06:40.302954+0000","last_clean":"2023-10-08T16:06:40.302954+0000","last_became_active":"2023-10-08T16:06:39.294549+0000","last_became_peered":"2023-10-08T16:06:39.294549+0000","last_unstale":"2023-10-08T16:06:40.302954+0000","last_undegraded":"2023-10-08T16:06:40.302954+0000","last_fullsized":"2023-10-08T16:06:40.302954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:30.419636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276379+0000","last_change":"2023-10-08T16:06:40.270175+0000","last_active":"2023-10-08T16:06:40.276379+0000","last_peered":"2023-10-08T16:06:40.276379+0000","last_clean":"2023-10-08T16:06:40.276379+0000","last_became_active":"2023-10-08T16:06:40.269029+0000","last_became_peered":"2023-10-08T16:06:40.269029+0000","last_unstale":"2023-10-08T16:06:40.276379+0000","last_undegraded":"2023-10-08T16:06:40.276379+0000","last_fullsized":"2023-10-08T16:06:40.276379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301969+0000","last_change":"2023-10-08T16:06:39.299037+0000","last_active":"2023-10-08T16:06:40.301969+0000","last_peered":"2023-10-08T16:06:40.301969+0000","last_clean":"2023-10-08T16:06:40.301969+0000","last_became_active":"2023-10-08T16:06:39.298664+0000","last_became_peered":"2023-10-08T16:06:39.298664+0000","last_unstale":"2023-10-08T16:06:40.301969+0000","last_undegraded":"2023-10-08T16:06:40.301969+0000","last_fullsized":"2023-10-08T16:06:40.301969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277144+0000","last_change":"2023-10-08T16:06:40.272886+0000","last_active":"2023-10-08T16:06:40.277144+0000","last_peered":"2023-10-08T16:06:40.277144+0000","last_clean":"2023-10-08T16:06:40.277144+0000","last_became_active":"2023-10-08T16:06:40.272556+0000","last_became_peered":"2023-10-08T16:06:40.272556+0000","last_unstale":"2023-10-08T16:06:40.277144+0000","last_undegraded":"2023-10-08T16:06:40.277144+0000","last_fullsized":"2023-10-08T16:06:40.277144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300889+0000","last_change":"2023-10-08T16:06:39.293894+0000","last_active":"2023-10-08T16:06:40.300889+0000","last_peered":"2023-10-08T16:06:40.300889+0000","last_clean":"2023-10-08T16:06:40.300889+0000","last_became_active":"2023-10-08T16:06:39.293562+0000","last_became_peered":"2023-10-08T16:06:39.293562+0000","last_unstale":"2023-10-08T16:06:40.300889+0000","last_undegraded":"2023-10-08T16:06:40.300889+0000","last_fullsized":"2023-10-08T16:06:40.300889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282094+0000","last_change":"2023-10-08T16:06:40.273176+0000","last_active":"2023-10-08T16:06:40.282094+0000","last_peered":"2023-10-08T16:06:40.282094+0000","last_clean":"2023-10-08T16:06:40.282094+0000","last_became_active":"2023-10-08T16:06:40.272791+0000","last_became_peered":"2023-10-08T16:06:40.272791+0000","last_unstale":"2023-10-08T16:06:40.282094+0000","last_undegraded":"2023-10-08T16:06:40.282094+0000","last_fullsized":"2023-10-08T16:06:40.282094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.254116+0000","last_change":"2023-10-08T16:06:39.293390+0000","last_active":"2023-10-08T16:06:40.254116+0000","last_peered":"2023-10-08T16:06:40.254116+0000","last_clean":"2023-10-08T16:06:40.254116+0000","last_became_active":"2023-10-08T16:06:39.293063+0000","last_became_peered":"2023-10-08T16:06:39.293063+0000","last_unstale":"2023-10-08T16:06:40.254116+0000","last_undegraded":"2023-10-08T16:06:40.254116+0000","last_fullsized":"2023-10-08T16:06:40.254116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279769+0000","last_change":"2023-10-08T16:06:40.276714+0000","last_active":"2023-10-08T16:06:40.279769+0000","last_peered":"2023-10-08T16:06:40.279769+0000","last_clean":"2023-10-08T16:06:40.279769+0000","last_became_active":"2023-10-08T16:06:40.276322+0000","last_became_peered":"2023-10-08T16:06:40.276322+0000","last_unstale":"2023-10-08T16:06:40.279769+0000","last_undegraded":"2023-10-08T16:06:40.279769+0000","last_fullsized":"2023-10-08T16:06:40.279769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:28.338803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259410+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:40.259410+0000","last_peered":"2023-10-08T16:06:40.259410+0000","last_clean":"2023-10-08T16:06:40.259410+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:40.259410+0000","last_undegraded":"2023-10-08T16:06:40.259410+0000","last_fullsized":"2023-10-08T16:06:40.259410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269492+0000","last_change":"2023-10-08T16:06:39.293223+0000","last_active":"2023-10-08T16:06:40.269492+0000","last_peered":"2023-10-08T16:06:40.269492+0000","last_clean":"2023-10-08T16:06:40.269492+0000","last_became_active":"2023-10-08T16:06:39.292861+0000","last_became_peered":"2023-10-08T16:06:39.292861+0000","last_unstale":"2023-10-08T16:06:40.269492+0000","last_undegraded":"2023-10-08T16:06:40.269492+0000","last_fullsized":"2023-10-08T16:06:40.269492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281318+0000","last_change":"2023-10-08T16:06:40.279550+0000","last_active":"2023-10-08T16:06:40.281318+0000","last_peered":"2023-10-08T16:06:40.281318+0000","last_clean":"2023-10-08T16:06:40.281318+0000","last_became_active":"2023-10-08T16:06:40.279258+0000","last_became_peered":"2023-10-08T16:06:40.279258+0000","last_unstale":"2023-10-08T16:06:40.281318+0000","last_undegraded":"2023-10-08T16:06:40.281318+0000","last_fullsized":"2023-10-08T16:06:40.281318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259307+0000","last_change":"2023-10-08T16:06:39.303341+0000","last_active":"2023-10-08T16:06:40.259307+0000","last_peered":"2023-10-08T16:06:40.259307+0000","last_clean":"2023-10-08T16:06:40.259307+0000","last_became_active":"2023-10-08T16:06:39.303000+0000","last_became_peered":"2023-10-08T16:06:39.303000+0000","last_unstale":"2023-10-08T16:06:40.259307+0000","last_undegraded":"2023-10-08T16:06:40.259307+0000","last_fullsized":"2023-10-08T16:06:40.259307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:46.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269369+0000","last_change":"2023-10-08T16:06:40.259545+0000","last_active":"2023-10-08T16:06:40.269369+0000","last_peered":"2023-10-08T16:06:40.269369+0000","last_clean":"2023-10-08T16:06:40.269369+0000","last_became_active":"2023-10-08T16:06:40.259191+0000","last_became_peered":"2023-10-08T16:06:40.259191+0000","last_unstale":"2023-10-08T16:06:40.269369+0000","last_undegraded":"2023-10-08T16:06:40.269369+0000","last_fullsized":"2023-10-08T16:06:40.269369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253367+0000","last_change":"2023-10-08T16:06:39.299839+0000","last_active":"2023-10-08T16:06:40.253367+0000","last_peered":"2023-10-08T16:06:40.253367+0000","last_clean":"2023-10-08T16:06:40.253367+0000","last_became_active":"2023-10-08T16:06:39.299351+0000","last_became_peered":"2023-10-08T16:06:39.299351+0000","last_unstale":"2023-10-08T16:06:40.253367+0000","last_undegraded":"2023-10-08T16:06:40.253367+0000","last_fullsized":"2023-10-08T16:06:40.253367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269108+0000","last_change":"2023-10-08T16:06:40.263602+0000","last_active":"2023-10-08T16:06:40.269108+0000","last_peered":"2023-10-08T16:06:40.269108+0000","last_clean":"2023-10-08T16:06:40.269108+0000","last_became_active":"2023-10-08T16:06:40.263275+0000","last_became_peered":"2023-10-08T16:06:40.263275+0000","last_unstale":"2023-10-08T16:06:40.269108+0000","last_undegraded":"2023-10-08T16:06:40.269108+0000","last_fullsized":"2023-10-08T16:06:40.269108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269681+0000","last_change":"2023-10-08T16:06:39.298167+0000","last_active":"2023-10-08T16:06:40.269681+0000","last_peered":"2023-10-08T16:06:40.269681+0000","last_clean":"2023-10-08T16:06:40.269681+0000","last_became_active":"2023-10-08T16:06:39.297678+0000","last_became_peered":"2023-10-08T16:06:39.297678+0000","last_unstale":"2023-10-08T16:06:40.269681+0000","last_undegraded":"2023-10-08T16:06:40.269681+0000","last_fullsized":"2023-10-08T16:06:40.269681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276831+0000","last_change":"2023-10-08T16:06:40.271343+0000","last_active":"2023-10-08T16:06:40.276831+0000","last_peered":"2023-10-08T16:06:40.276831+0000","last_clean":"2023-10-08T16:06:40.276831+0000","last_became_active":"2023-10-08T16:06:40.270882+0000","last_became_peered":"2023-10-08T16:06:40.270882+0000","last_unstale":"2023-10-08T16:06:40.276831+0000","last_undegraded":"2023-10-08T16:06:40.276831+0000","last_fullsized":"2023-10-08T16:06:40.276831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258762+0000","last_change":"2023-10-08T16:06:39.293588+0000","last_active":"2023-10-08T16:06:40.258762+0000","last_peered":"2023-10-08T16:06:40.258762+0000","last_clean":"2023-10-08T16:06:40.258762+0000","last_became_active":"2023-10-08T16:06:39.293209+0000","last_became_peered":"2023-10-08T16:06:39.293209+0000","last_unstale":"2023-10-08T16:06:40.258762+0000","last_undegraded":"2023-10-08T16:06:40.258762+0000","last_fullsized":"2023-10-08T16:06:40.258762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282337+0000","last_change":"2023-10-08T16:06:40.275327+0000","last_active":"2023-10-08T16:06:40.282337+0000","last_peered":"2023-10-08T16:06:40.282337+0000","last_clean":"2023-10-08T16:06:40.282337+0000","last_became_active":"2023-10-08T16:06:40.274778+0000","last_became_peered":"2023-10-08T16:06:40.274778+0000","last_unstale":"2023-10-08T16:06:40.282337+0000","last_undegraded":"2023-10-08T16:06:40.282337+0000","last_fullsized":"2023-10-08T16:06:40.282337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:24.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.262394+0000","last_change":"2023-10-08T16:06:39.303540+0000","last_active":"2023-10-08T16:06:40.262394+0000","last_peered":"2023-10-08T16:06:40.262394+0000","last_clean":"2023-10-08T16:06:40.262394+0000","last_became_active":"2023-10-08T16:06:39.303264+0000","last_became_peered":"2023-10-08T16:06:39.303264+0000","last_unstale":"2023-10-08T16:06:40.262394+0000","last_undegraded":"2023-10-08T16:06:40.262394+0000","last_fullsized":"2023-10-08T16:06:40.262394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269828+0000","last_change":"2023-10-08T16:06:40.263957+0000","last_active":"2023-10-08T16:06:40.269828+0000","last_peered":"2023-10-08T16:06:40.269828+0000","last_clean":"2023-10-08T16:06:40.269828+0000","last_became_active":"2023-10-08T16:06:40.263566+0000","last_became_peered":"2023-10-08T16:06:40.263566+0000","last_unstale":"2023-10-08T16:06:40.269828+0000","last_undegraded":"2023-10-08T16:06:40.269828+0000","last_fullsized":"2023-10-08T16:06:40.269828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260207+0000","last_change":"2023-10-08T16:06:39.301605+0000","last_active":"2023-10-08T16:06:40.260207+0000","last_peered":"2023-10-08T16:06:40.260207+0000","last_clean":"2023-10-08T16:06:40.260207+0000","last_became_active":"2023-10-08T16:06:39.301289+0000","last_became_peered":"2023-10-08T16:06:39.301289+0000","last_unstale":"2023-10-08T16:06:40.260207+0000","last_undegraded":"2023-10-08T16:06:40.260207+0000","last_fullsized":"2023-10-08T16:06:40.260207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273159+0000","last_change":"2023-10-08T16:06:40.268834+0000","last_active":"2023-10-08T16:06:40.273159+0000","last_peered":"2023-10-08T16:06:40.273159+0000","last_clean":"2023-10-08T16:06:40.273159+0000","last_became_active":"2023-10-08T16:06:40.268449+0000","last_became_peered":"2023-10-08T16:06:40.268449+0000","last_unstale":"2023-10-08T16:06:40.273159+0000","last_undegraded":"2023-10-08T16:06:40.273159+0000","last_fullsized":"2023-10-08T16:06:40.273159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300880+0000","last_change":"2023-10-08T16:06:39.300940+0000","last_active":"2023-10-08T16:06:40.300880+0000","last_peered":"2023-10-08T16:06:40.300880+0000","last_clean":"2023-10-08T16:06:40.300880+0000","last_became_active":"2023-10-08T16:06:39.300556+0000","last_became_peered":"2023-10-08T16:06:39.300556+0000","last_unstale":"2023-10-08T16:06:40.300880+0000","last_undegraded":"2023-10-08T16:06:40.300880+0000","last_fullsized":"2023-10-08T16:06:40.300880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275841+0000","last_change":"2023-10-08T16:06:40.267528+0000","last_active":"2023-10-08T16:06:40.275841+0000","last_peered":"2023-10-08T16:06:40.275841+0000","last_clean":"2023-10-08T16:06:40.275841+0000","last_became_active":"2023-10-08T16:06:40.266866+0000","last_became_peered":"2023-10-08T16:06:40.266866+0000","last_unstale":"2023-10-08T16:06:40.275841+0000","last_undegraded":"2023-10-08T16:06:40.275841+0000","last_fullsized":"2023-10-08T16:06:40.275841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:53.878852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258987+0000","last_change":"2023-10-08T16:06:39.302711+0000","last_active":"2023-10-08T16:06:40.258987+0000","last_peered":"2023-10-08T16:06:40.258987+0000","last_clean":"2023-10-08T16:06:40.258987+0000","last_became_active":"2023-10-08T16:06:39.302404+0000","last_became_peered":"2023-10-08T16:06:39.302404+0000","last_unstale":"2023-10-08T16:06:40.258987+0000","last_undegraded":"2023-10-08T16:06:40.258987+0000","last_fullsized":"2023-10-08T16:06:40.258987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268533+0000","last_change":"2023-10-08T16:06:40.263548+0000","last_active":"2023-10-08T16:06:40.268533+0000","last_peered":"2023-10-08T16:06:40.268533+0000","last_clean":"2023-10-08T16:06:40.268533+0000","last_became_active":"2023-10-08T16:06:40.263230+0000","last_became_peered":"2023-10-08T16:06:40.263230+0000","last_unstale":"2023-10-08T16:06:40.268533+0000","last_undegraded":"2023-10-08T16:06:40.268533+0000","last_fullsized":"2023-10-08T16:06:40.268533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:50.492409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258991+0000","last_change":"2023-10-08T16:06:39.299840+0000","last_active":"2023-10-08T16:06:40.258991+0000","last_peered":"2023-10-08T16:06:40.258991+0000","last_clean":"2023-10-08T16:06:40.258991+0000","last_became_active":"2023-10-08T16:06:39.299502+0000","last_became_peered":"2023-10-08T16:06:39.299502+0000","last_unstale":"2023-10-08T16:06:40.258991+0000","last_undegraded":"2023-10-08T16:06:40.258991+0000","last_fullsized":"2023-10-08T16:06:40.258991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268950+0000","last_change":"2023-10-08T16:06:40.263516+0000","last_active":"2023-10-08T16:06:40.268950+0000","last_peered":"2023-10-08T16:06:40.268950+0000","last_clean":"2023-10-08T16:06:40.268950+0000","last_became_active":"2023-10-08T16:06:40.263180+0000","last_became_peered":"2023-10-08T16:06:40.263180+0000","last_unstale":"2023-10-08T16:06:40.268950+0000","last_undegraded":"2023-10-08T16:06:40.268950+0000","last_fullsized":"2023-10-08T16:06:40.268950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260056+0000","last_change":"2023-10-08T16:06:39.302588+0000","last_active":"2023-10-08T16:06:40.260056+0000","last_peered":"2023-10-08T16:06:40.260056+0000","last_clean":"2023-10-08T16:06:40.260056+0000","last_became_active":"2023-10-08T16:06:39.302361+0000","last_became_peered":"2023-10-08T16:06:39.302361+0000","last_unstale":"2023-10-08T16:06:40.260056+0000","last_undegraded":"2023-10-08T16:06:40.260056+0000","last_fullsized":"2023-10-08T16:06:40.260056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267686+0000","last_change":"2023-10-08T16:06:40.262950+0000","last_active":"2023-10-08T16:06:40.267686+0000","last_peered":"2023-10-08T16:06:40.267686+0000","last_clean":"2023-10-08T16:06:40.267686+0000","last_became_active":"2023-10-08T16:06:40.262620+0000","last_became_peered":"2023-10-08T16:06:40.262620+0000","last_unstale":"2023-10-08T16:06:40.267686+0000","last_undegraded":"2023-10-08T16:06:40.267686+0000","last_fullsized":"2023-10-08T16:06:40.267686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301577+0000","last_change":"2023-10-08T16:06:39.304109+0000","last_active":"2023-10-08T16:06:40.301577+0000","last_peered":"2023-10-08T16:06:40.301577+0000","last_clean":"2023-10-08T16:06:40.301577+0000","last_became_active":"2023-10-08T16:06:39.303757+0000","last_became_peered":"2023-10-08T16:06:39.303757+0000","last_unstale":"2023-10-08T16:06:40.301577+0000","last_undegraded":"2023-10-08T16:06:40.301577+0000","last_fullsized":"2023-10-08T16:06:40.301577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267750+0000","last_change":"2023-10-08T16:06:40.259475+0000","last_active":"2023-10-08T16:06:40.267750+0000","last_peered":"2023-10-08T16:06:40.267750+0000","last_clean":"2023-10-08T16:06:40.267750+0000","last_became_active":"2023-10-08T16:06:40.259042+0000","last_became_peered":"2023-10-08T16:06:40.259042+0000","last_unstale":"2023-10-08T16:06:40.267750+0000","last_undegraded":"2023-10-08T16:06:40.267750+0000","last_fullsized":"2023-10-08T16:06:40.267750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282564+0000","last_change":"2023-10-08T16:06:40.276456+0000","last_active":"2023-10-08T16:06:40.282564+0000","last_peered":"2023-10-08T16:06:40.282564+0000","last_clean":"2023-10-08T16:06:40.282564+0000","last_became_active":"2023-10-08T16:06:40.276127+0000","last_became_peered":"2023-10-08T16:06:40.276127+0000","last_unstale":"2023-10-08T16:06:40.282564+0000","last_undegraded":"2023-10-08T16:06:40.282564+0000","last_fullsized":"2023-10-08T16:06:40.282564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.299639+0000","last_change":"2023-10-08T16:06:39.302950+0000","last_active":"2023-10-08T16:06:40.299639+0000","last_peered":"2023-10-08T16:06:40.299639+0000","last_clean":"2023-10-08T16:06:40.299639+0000","last_became_active":"2023-10-08T16:06:39.302504+0000","last_became_peered":"2023-10-08T16:06:39.302504+0000","last_unstale":"2023-10-08T16:06:40.299639+0000","last_undegraded":"2023-10-08T16:06:40.299639+0000","last_fullsized":"2023-10-08T16:06:40.299639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279270+0000","last_change":"2023-10-08T16:06:40.269067+0000","last_active":"2023-10-08T16:06:40.279270+0000","last_peered":"2023-10-08T16:06:40.279270+0000","last_clean":"2023-10-08T16:06:40.279270+0000","last_became_active":"2023-10-08T16:06:40.268755+0000","last_became_peered":"2023-10-08T16:06:40.268755+0000","last_unstale":"2023-10-08T16:06:40.279270+0000","last_undegraded":"2023-10-08T16:06:40.279270+0000","last_fullsized":"2023-10-08T16:06:40.279270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300353+0000","last_change":"2023-10-08T16:06:39.305358+0000","last_active":"2023-10-08T16:06:40.300353+0000","last_peered":"2023-10-08T16:06:40.300353+0000","last_clean":"2023-10-08T16:06:40.300353+0000","last_became_active":"2023-10-08T16:06:39.305022+0000","last_became_peered":"2023-10-08T16:06:39.305022+0000","last_unstale":"2023-10-08T16:06:40.300353+0000","last_undegraded":"2023-10-08T16:06:40.300353+0000","last_fullsized":"2023-10-08T16:06:40.300353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:17.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278272+0000","last_change":"2023-10-08T16:06:40.274826+0000","last_active":"2023-10-08T16:06:40.278272+0000","last_peered":"2023-10-08T16:06:40.278272+0000","last_clean":"2023-10-08T16:06:40.278272+0000","last_became_active":"2023-10-08T16:06:40.274506+0000","last_became_peered":"2023-10-08T16:06:40.274506+0000","last_unstale":"2023-10-08T16:06:40.278272+0000","last_undegraded":"2023-10-08T16:06:40.278272+0000","last_fullsized":"2023-10-08T16:06:40.278272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301960+0000","last_change":"2023-10-08T16:06:39.298025+0000","last_active":"2023-10-08T16:06:40.301960+0000","last_peered":"2023-10-08T16:06:40.301960+0000","last_clean":"2023-10-08T16:06:40.301960+0000","last_became_active":"2023-10-08T16:06:39.297643+0000","last_became_peered":"2023-10-08T16:06:39.297643+0000","last_unstale":"2023-10-08T16:06:40.301960+0000","last_undegraded":"2023-10-08T16:06:40.301960+0000","last_fullsized":"2023-10-08T16:06:40.301960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273032+0000","last_change":"2023-10-08T16:06:40.268521+0000","last_active":"2023-10-08T16:06:40.273032+0000","last_peered":"2023-10-08T16:06:40.273032+0000","last_clean":"2023-10-08T16:06:40.273032+0000","last_became_active":"2023-10-08T16:06:40.267613+0000","last_became_peered":"2023-10-08T16:06:40.267613+0000","last_unstale":"2023-10-08T16:06:40.273032+0000","last_undegraded":"2023-10-08T16:06:40.273032+0000","last_fullsized":"2023-10-08T16:06:40.273032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301633+0000","last_change":"2023-10-08T16:06:39.303632+0000","last_active":"2023-10-08T16:06:40.301633+0000","last_peered":"2023-10-08T16:06:40.301633+0000","last_clean":"2023-10-08T16:06:40.301633+0000","last_became_active":"2023-10-08T16:06:39.303353+0000","last_became_peered":"2023-10-08T16:06:39.303353+0000","last_unstale":"2023-10-08T16:06:40.301633+0000","last_undegraded":"2023-10-08T16:06:40.301633+0000","last_fullsized":"2023-10-08T16:06:40.301633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:43.974 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:06:44.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.075+0000 7f675d832700 1 Processor -- start 2023-10-08T16:06:44.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.075+0000 7f675d832700 1 -- start start 2023-10-08T16:06:44.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6758156b80 0x7f675806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f67580c6fb0 0x7f675806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6758158130 con 0x7f675806de70 2023-10-08T16:06:44.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675815b720 con 0x7f67580c6fb0 2023-10-08T16:06:44.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6758157520 con 0x7f6758156b80 2023-10-08T16:06:44.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f6757fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f675806de70 0x7f67580c68a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56860/0 (socket says 172.21.15.3:56860) 2023-10-08T16:06:44.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f6757fff700 1 -- 172.21.15.3:0/2893225724 learned_addr learned my addr 172.21.15.3:0/2893225724 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:44.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d031700 1 --2- 172.21.15.3:0/2893225724 >> v2:172.21.15.3:3300/0 conn(0x7f67580c6fb0 0x7f675806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675c830700 1 --2- 172.21.15.3:0/2893225724 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6758156b80 0x7f675806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f67577fe700 1 -- 172.21.15.3:0/2893225724 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832302663 0 0) 0x7f6758158130 con 0x7f675806de70 2023-10-08T16:06:44.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f67577fe700 1 -- 172.21.15.3:0/2893225724 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6744003570 con 0x7f675806de70 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675c830700 1 -- 172.21.15.3:0/2893225724 >> v2:172.21.15.3:3300/0 conn(0x7f67580c6fb0 msgr2=0x7f675806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675c830700 1 --2- 172.21.15.3:0/2893225724 >> v2:172.21.15.3:3300/0 conn(0x7f67580c6fb0 0x7f675806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675c830700 1 -- 172.21.15.3:0/2893225724 >> v1:172.21.15.3:6789/0 conn(0x7f675806de70 legacy=0x7f67580c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f67577fe700 1 -- 172.21.15.3:0/2893225724 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176726761 0 0) 0x7f6744003570 con 0x7f675806de70 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675c830700 1 -- 172.21.15.3:0/2893225724 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6758157800 con 0x7f6758156b80 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d031700 1 --2- 172.21.15.3:0/2893225724 >> v2:172.21.15.3:3300/0 conn(0x7f67580c6fb0 0x7f675806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675c830700 1 --2- 172.21.15.3:0/2893225724 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6758156b80 0x7f675806d930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6748009e60 tx=0x7f6748009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5043822b3f213c01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f67577fe700 1 -- 172.21.15.3:0/2893225724 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800e070 con 0x7f6758156b80 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f67577fe700 1 -- 172.21.15.3:0/2893225724 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674800b7a0 con 0x7f6758156b80 2023-10-08T16:06:44.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f67577fe700 1 -- 172.21.15.3:0/2893225724 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740001470 con 0x7f6758156b80 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- 172.21.15.3:0/2893225724 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6758156b80 msgr2=0x7f675806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 --2- 172.21.15.3:0/2893225724 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6758156b80 0x7f675806d930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6748009e60 tx=0x7f6748009780 comp rx=0 tx=0).stop 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- 172.21.15.3:0/2893225724 shutdown_connections 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 --2- 172.21.15.3:0/2893225724 >> v2:172.21.15.3:3300/0 conn(0x7f67580c6fb0 0x7f675806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 --2- 172.21.15.3:0/2893225724 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6758156b80 0x7f675806d930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- 172.21.15.3:0/2893225724 >> 172.21.15.3:0/2893225724 conn(0x7f6758067ad0 msgr2=0x7f67580cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- 172.21.15.3:0/2893225724 shutdown_connections 2023-10-08T16:06:44.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 -- 172.21.15.3:0/2893225724 wait complete. 2023-10-08T16:06:44.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.079+0000 7f675d832700 1 Processor -- start 2023-10-08T16:06:44.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 -- start start 2023-10-08T16:06:44.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675806de70 0x7f67580afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f67580c6fb0 0x7f67581693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 0x7f67580c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580c38b0 con 0x7f6758156b80 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580c2a00 con 0x7f675806de70 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67580c2ca0 con 0x7f67580c6fb0 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 0x7f67580c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 0x7f67580c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36674/0 (socket says 172.21.15.3:36674) 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 -- 172.21.15.3:0/979107627 learned_addr learned my addr 172.21.15.3:0/979107627 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f6757fff700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f67580c6fb0 0x7f67581693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675c830700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675806de70 0x7f67580afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 -- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f67580c6fb0 msgr2=0x7f67581693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f67580c6fb0 0x7f67581693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 -- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675806de70 msgr2=0x7f67580afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675806de70 0x7f67580afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 -- 172.21.15.3:0/979107627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009420 con 0x7f6758156b80 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f6757fff700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f67580c6fb0 0x7f67581693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d031700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 0x7f67580c3d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f675000ec50 tx=0x7f67500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000c9d0 con 0x7f6758156b80 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6748009a20 con 0x7f6758156b80 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675000cb30 con 0x7f6758156b80 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750013470 con 0x7f6758156b80 2023-10-08T16:06:44.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.083+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67580c3260 con 0x7f6758156b80 2023-10-08T16:06:44.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.087+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f67500138a0 con 0x7f6758156b80 2023-10-08T16:06:44.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.087+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6758068630 con 0x7f6758156b80 2023-10-08T16:06:44.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.087+0000 7f6754ff9700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6738060550 0x7f6738062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.087+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f675007cc20 con 0x7f6758156b80 2023-10-08T16:06:44.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.087+0000 7f675c830700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6738060550 0x7f6738062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.087+0000 7f675c830700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6738060550 0x7f6738062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67480099f0 tx=0x7f6748018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.095+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f675004d210 con 0x7f6758156b80 2023-10-08T16:06:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.319+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f675804be40 con 0x7f6758156b80 2023-10-08T16:06:44.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f6754ff9700 1 -- 172.21.15.3:0/979107627 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1013 (secure 0 0 0) 0x7f6750050830 con 0x7f6758156b80 2023-10-08T16:06:44.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:44.325 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781187,"num_in_osds":8,"osd_in_since":1696781177,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2438275072,"bytes_avail":770655838208,"bytes_total":773094113280,"write_bytes_sec":2392,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4278}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-08T16:06:15.493039+0000","services":{}},"progress_events":{}} 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6738060550 msgr2=0x7f6738062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6738060550 0x7f6738062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67480099f0 tx=0x7f6748018000 comp rx=0 tx=0).stop 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 msgr2=0x7f67580c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 0x7f67580c3d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f675000ec50 tx=0x7f67500091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 shutdown_connections 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6738060550 0x7f6738062a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6758156b80 0x7f67580c3d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f67580c6fb0 0x7f67581693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 --2- 172.21.15.3:0/979107627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675806de70 0x7f67580afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 >> 172.21.15.3:0/979107627 conn(0x7f6758067ad0 msgr2=0x7f6758150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 shutdown_connections 2023-10-08T16:06:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.323+0000 7f675d832700 1 -- 172.21.15.3:0/979107627 wait complete. 2023-10-08T16:06:44.340 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:06:44.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:44.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 Processor -- start 2023-10-08T16:06:44.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 -- start start 2023-10-08T16:06:44.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7aa00cb880 0x7f7aa0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0159e80 0x7f7aa0156140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa0068e80 con 0x7f7aa0068ab0 2023-10-08T16:06:44.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa0156680 con 0x7f7aa00cb880 2023-10-08T16:06:44.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7aa663c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0156930 con 0x7f7aa0159e80 2023-10-08T16:06:44.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.439+0000 7f7a977fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7aa00cb880 0x7f7aa0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7aa00cb880 0x7f7aa0155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36676/0 (socket says 172.21.15.3:36676) 2023-10-08T16:06:44.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 -- 172.21.15.3:0/1054100782 learned_addr learned my addr 172.21.15.3:0/1054100782 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa4bd9700 1 --2- 172.21.15.3:0/1054100782 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0159e80 0x7f7aa0156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 -- 172.21.15.3:0/1054100782 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0159e80 msgr2=0x7f7aa0156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 --2- 172.21.15.3:0/1054100782 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0159e80 0x7f7aa0156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 -- 172.21.15.3:0/1054100782 >> v1:172.21.15.3:6789/0 conn(0x7f7aa0068ab0 legacy=0x7f7aa00cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a9f7fe700 1 -- 172.21.15.3:0/1054100782 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209100014 0 0) 0x7f7aa0068e80 con 0x7f7aa0068ab0 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 -- 172.21.15.3:0/1054100782 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa01593a0 con 0x7f7aa00cb880 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a977fe700 1 --2- 172.21.15.3:0/1054100782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa0155c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a880099b0 tx=0x7f7a88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f343ec9093b41eef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a9f7fe700 1 -- 172.21.15.3:0/1054100782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800b860 con 0x7f7aa00cb880 2023-10-08T16:06:44.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a9f7fe700 1 -- 172.21.15.3:0/1054100782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800b9c0 con 0x7f7aa00cb880 2023-10-08T16:06:44.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7a9f7fe700 1 -- 172.21.15.3:0/1054100782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800bd60 con 0x7f7aa00cb880 2023-10-08T16:06:44.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 -- 172.21.15.3:0/1054100782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 msgr2=0x7f7aa0155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1054100782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa0155c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a880099b0 tx=0x7f7a88009250 comp rx=0 tx=0).stop 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 -- 172.21.15.3:0/1054100782 shutdown_connections 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1054100782 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0159e80 0x7f7aa0156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1054100782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa0155c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 -- 172.21.15.3:0/1054100782 >> 172.21.15.3:0/1054100782 conn(0x7f7aa00c8de0 msgr2=0x7f7aa00c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 -- 172.21.15.3:0/1054100782 shutdown_connections 2023-10-08T16:06:44.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 -- 172.21.15.3:0/1054100782 wait complete. 2023-10-08T16:06:44.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.443+0000 7f7aa663c700 1 Processor -- start 2023-10-08T16:06:44.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 -- start start 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0068ab0 0x7f7aa00b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa013ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7aa0159e80 0x7f7aa0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00b1420 con 0x7f7aa00cb880 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00c4e90 con 0x7f7aa0159e80 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00c4280 con 0x7f7aa0068ab0 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa013ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa013ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36688/0 (socket says 172.21.15.3:36688) 2023-10-08T16:06:44.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 -- 172.21.15.3:0/1085245091 learned_addr learned my addr 172.21.15.3:0/1085245091 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:44.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a9ffff700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0068ab0 0x7f7aa00b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa4bd9700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7aa0159e80 0x7f7aa0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 -- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0068ab0 msgr2=0x7f7aa00b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0068ab0 0x7f7aa00b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 -- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7aa0159e80 msgr2=0x7f7aa0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7aa0159e80 0x7f7aa0154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 -- 172.21.15.3:0/1085245091 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880094f0 con 0x7f7aa00cb880 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a977fe700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa013ffc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7aa006aa80 tx=0x7f7a88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88011d70 con 0x7f7aa00cb880 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88024440 con 0x7f7aa00cb880 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88024800 con 0x7f7aa00cb880 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa00c4560 con 0x7f7aa00cb880 2023-10-08T16:06:44.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.447+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa00c4b20 con 0x7f7aa00cb880 2023-10-08T16:06:44.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.451+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7a8801a420 con 0x7f7aa00cb880 2023-10-08T16:06:44.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.451+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa00cd540 con 0x7f7aa00cb880 2023-10-08T16:06:44.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.451+0000 7f7a9cff9700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7a80060550 0x7f7a80062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.451+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a8807dd10 con 0x7f7aa00cb880 2023-10-08T16:06:44.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.451+0000 7f7a9ffff700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7a80060550 0x7f7a80062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.451+0000 7f7a9ffff700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7a80060550 0x7f7a80062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a90007fd0 tx=0x7f7a90007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.459+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7aa00cd540 con 0x7f7aa00cb880 2023-10-08T16:06:44.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.615+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7aa0140860 con 0x7f7a80060550 2023-10-08T16:06:44.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.631+0000 7f7a9cff9700 1 -- 172.21.15.3:0/1085245091 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264424 (secure 0 0 0) 0x7f7aa0140860 con 0x7f7a80060550 2023-10-08T16:06:44.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7a80060550 msgr2=0x7f7a80062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7a80060550 0x7f7a80062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a90007fd0 tx=0x7f7a90007d30 comp rx=0 tx=0).stop 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 msgr2=0x7f7aa013ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa013ffc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7aa006aa80 tx=0x7f7a88017000 comp rx=0 tx=0).stop 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 shutdown_connections 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7a80060550 0x7f7a80062a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7aa0159e80 0x7f7aa0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa00cb880 0x7f7aa013ffc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 --2- 172.21.15.3:0/1085245091 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7aa0068ab0 0x7f7aa00b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 >> 172.21.15.3:0/1085245091 conn(0x7f7aa00c8de0 msgr2=0x7f7aa01559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:44.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 shutdown_connections 2023-10-08T16:06:44.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:44.639+0000 7f7aa663c700 1 -- 172.21.15.3:0/1085245091 wait complete. 2023-10-08T16:06:44.642 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:44.654 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-08T16:06:43.820356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.563080"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.280053+0000","last_change":"2023-10-08T16:06:40.276055+0000","last_active":"2023-10-08T16:06:40.280053+0000","last_peered":"2023-10-08T16:06:40.280053+0000","last_clean":"2023-10-08T16:06:40.280053+0000","last_became_active":"2023-10-08T16:06:40.275720+0000","last_became_peered":"2023-10-08T16:06:40.275720+0000","last_unstale":"2023-10-08T16:06:40.280053+0000","last_undegraded":"2023-10-08T16:06:40.280053+0000","last_fullsized":"2023-10-08T16:06:40.280053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271636+0000","last_change":"2023-10-08T16:06:40.270216+0000","last_active":"2023-10-08T16:06:40.271636+0000","last_peered":"2023-10-08T16:06:40.271636+0000","last_clean":"2023-10-08T16:06:40.271636+0000","last_became_active":"2023-10-08T16:06:40.269903+0000","last_became_peered":"2023-10-08T16:06:40.269903+0000","last_unstale":"2023-10-08T16:06:40.271636+0000","last_undegraded":"2023-10-08T16:06:40.271636+0000","last_fullsized":"2023-10-08T16:06:40.271636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269395+0000","last_change":"2023-10-08T16:06:40.258935+0000","last_active":"2023-10-08T16:06:40.269395+0000","last_peered":"2023-10-08T16:06:40.269395+0000","last_clean":"2023-10-08T16:06:40.269395+0000","last_became_active":"2023-10-08T16:06:40.256957+0000","last_became_peered":"2023-10-08T16:06:40.256957+0000","last_unstale":"2023-10-08T16:06:40.269395+0000","last_undegraded":"2023-10-08T16:06:40.269395+0000","last_fullsized":"2023-10-08T16:06:40.269395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282471+0000","last_change":"2023-10-08T16:06:40.275472+0000","last_active":"2023-10-08T16:06:40.282471+0000","last_peered":"2023-10-08T16:06:40.282471+0000","last_clean":"2023-10-08T16:06:40.282471+0000","last_became_active":"2023-10-08T16:06:40.275178+0000","last_became_peered":"2023-10-08T16:06:40.275178+0000","last_unstale":"2023-10-08T16:06:40.282471+0000","last_undegraded":"2023-10-08T16:06:40.282471+0000","last_fullsized":"2023-10-08T16:06:40.282471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276523+0000","last_change":"2023-10-08T16:06:40.270577+0000","last_active":"2023-10-08T16:06:40.276523+0000","last_peered":"2023-10-08T16:06:40.276523+0000","last_clean":"2023-10-08T16:06:40.276523+0000","last_became_active":"2023-10-08T16:06:40.270269+0000","last_became_peered":"2023-10-08T16:06:40.270269+0000","last_unstale":"2023-10-08T16:06:40.276523+0000","last_undegraded":"2023-10-08T16:06:40.276523+0000","last_fullsized":"2023-10-08T16:06:40.276523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279700+0000","last_change":"2023-10-08T16:06:40.272575+0000","last_active":"2023-10-08T16:06:40.279700+0000","last_peered":"2023-10-08T16:06:40.279700+0000","last_clean":"2023-10-08T16:06:40.279700+0000","last_became_active":"2023-10-08T16:06:40.272126+0000","last_became_peered":"2023-10-08T16:06:40.272126+0000","last_unstale":"2023-10-08T16:06:40.279700+0000","last_undegraded":"2023-10-08T16:06:40.279700+0000","last_fullsized":"2023-10-08T16:06:40.279700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279736+0000","last_change":"2023-10-08T16:06:40.277232+0000","last_active":"2023-10-08T16:06:40.279736+0000","last_peered":"2023-10-08T16:06:40.279736+0000","last_clean":"2023-10-08T16:06:40.279736+0000","last_became_active":"2023-10-08T16:06:40.276903+0000","last_became_peered":"2023-10-08T16:06:40.276903+0000","last_unstale":"2023-10-08T16:06:40.279736+0000","last_undegraded":"2023-10-08T16:06:40.279736+0000","last_fullsized":"2023-10-08T16:06:40.279736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281289+0000","last_change":"2023-10-08T16:06:40.279113+0000","last_active":"2023-10-08T16:06:40.281289+0000","last_peered":"2023-10-08T16:06:40.281289+0000","last_clean":"2023-10-08T16:06:40.281289+0000","last_became_active":"2023-10-08T16:06:40.278772+0000","last_became_peered":"2023-10-08T16:06:40.278772+0000","last_unstale":"2023-10-08T16:06:40.281289+0000","last_undegraded":"2023-10-08T16:06:40.281289+0000","last_fullsized":"2023-10-08T16:06:40.281289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.284590+0000","last_change":"2023-10-08T16:06:40.280182+0000","last_active":"2023-10-08T16:06:40.284590+0000","last_peered":"2023-10-08T16:06:40.284590+0000","last_clean":"2023-10-08T16:06:40.284590+0000","last_became_active":"2023-10-08T16:06:40.279850+0000","last_became_peered":"2023-10-08T16:06:40.279850+0000","last_unstale":"2023-10-08T16:06:40.284590+0000","last_undegraded":"2023-10-08T16:06:40.284590+0000","last_fullsized":"2023-10-08T16:06:40.284590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:54.574906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279582+0000","last_change":"2023-10-08T16:06:40.275718+0000","last_active":"2023-10-08T16:06:40.279582+0000","last_peered":"2023-10-08T16:06:40.279582+0000","last_clean":"2023-10-08T16:06:40.279582+0000","last_became_active":"2023-10-08T16:06:40.275419+0000","last_became_peered":"2023-10-08T16:06:40.275419+0000","last_unstale":"2023-10-08T16:06:40.279582+0000","last_undegraded":"2023-10-08T16:06:40.279582+0000","last_fullsized":"2023-10-08T16:06:40.279582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281916+0000","last_change":"2023-10-08T16:06:40.276225+0000","last_active":"2023-10-08T16:06:40.281916+0000","last_peered":"2023-10-08T16:06:40.281916+0000","last_clean":"2023-10-08T16:06:40.281916+0000","last_became_active":"2023-10-08T16:06:40.275876+0000","last_became_peered":"2023-10-08T16:06:40.275876+0000","last_unstale":"2023-10-08T16:06:40.281916+0000","last_undegraded":"2023-10-08T16:06:40.281916+0000","last_fullsized":"2023-10-08T16:06:40.281916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270998+0000","last_change":"2023-10-08T16:06:40.264918+0000","last_active":"2023-10-08T16:06:40.270998+0000","last_peered":"2023-10-08T16:06:40.270998+0000","last_clean":"2023-10-08T16:06:40.270998+0000","last_became_active":"2023-10-08T16:06:40.264124+0000","last_became_peered":"2023-10-08T16:06:40.264124+0000","last_unstale":"2023-10-08T16:06:40.270998+0000","last_undegraded":"2023-10-08T16:06:40.270998+0000","last_fullsized":"2023-10-08T16:06:40.270998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273343+0000","last_change":"2023-10-08T16:06:40.269867+0000","last_active":"2023-10-08T16:06:40.273343+0000","last_peered":"2023-10-08T16:06:40.273343+0000","last_clean":"2023-10-08T16:06:40.273343+0000","last_became_active":"2023-10-08T16:06:40.268208+0000","last_became_peered":"2023-10-08T16:06:40.268208+0000","last_unstale":"2023-10-08T16:06:40.273343+0000","last_undegraded":"2023-10-08T16:06:40.273343+0000","last_fullsized":"2023-10-08T16:06:40.273343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275554+0000","last_change":"2023-10-08T16:06:40.264028+0000","last_active":"2023-10-08T16:06:40.275554+0000","last_peered":"2023-10-08T16:06:40.275554+0000","last_clean":"2023-10-08T16:06:40.275554+0000","last_became_active":"2023-10-08T16:06:40.263715+0000","last_became_peered":"2023-10-08T16:06:40.263715+0000","last_unstale":"2023-10-08T16:06:40.275554+0000","last_undegraded":"2023-10-08T16:06:40.275554+0000","last_fullsized":"2023-10-08T16:06:40.275554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:55.266658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271470+0000","last_change":"2023-10-08T16:06:40.269258+0000","last_active":"2023-10-08T16:06:40.271470+0000","last_peered":"2023-10-08T16:06:40.271470+0000","last_clean":"2023-10-08T16:06:40.271470+0000","last_became_active":"2023-10-08T16:06:40.268883+0000","last_became_peered":"2023-10-08T16:06:40.268883+0000","last_unstale":"2023-10-08T16:06:40.271470+0000","last_undegraded":"2023-10-08T16:06:40.271470+0000","last_fullsized":"2023-10-08T16:06:40.271470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282671+0000","last_change":"2023-10-08T16:06:40.278397+0000","last_active":"2023-10-08T16:06:40.282671+0000","last_peered":"2023-10-08T16:06:40.282671+0000","last_clean":"2023-10-08T16:06:40.282671+0000","last_became_active":"2023-10-08T16:06:40.277981+0000","last_became_peered":"2023-10-08T16:06:40.277981+0000","last_unstale":"2023-10-08T16:06:40.282671+0000","last_undegraded":"2023-10-08T16:06:40.282671+0000","last_fullsized":"2023-10-08T16:06:40.282671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282436+0000","last_change":"2023-10-08T16:06:40.276109+0000","last_active":"2023-10-08T16:06:40.282436+0000","last_peered":"2023-10-08T16:06:40.282436+0000","last_clean":"2023-10-08T16:06:40.282436+0000","last_became_active":"2023-10-08T16:06:40.275481+0000","last_became_peered":"2023-10-08T16:06:40.275481+0000","last_unstale":"2023-10-08T16:06:40.282436+0000","last_undegraded":"2023-10-08T16:06:40.282436+0000","last_fullsized":"2023-10-08T16:06:40.282436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267040+0000","last_change":"2023-10-08T16:06:40.261754+0000","last_active":"2023-10-08T16:06:40.267040+0000","last_peered":"2023-10-08T16:06:40.267040+0000","last_clean":"2023-10-08T16:06:40.267040+0000","last_became_active":"2023-10-08T16:06:40.261437+0000","last_became_peered":"2023-10-08T16:06:40.261437+0000","last_unstale":"2023-10-08T16:06:40.267040+0000","last_undegraded":"2023-10-08T16:06:40.267040+0000","last_fullsized":"2023-10-08T16:06:40.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277114+0000","last_change":"2023-10-08T16:06:40.271380+0000","last_active":"2023-10-08T16:06:40.277114+0000","last_peered":"2023-10-08T16:06:40.277114+0000","last_clean":"2023-10-08T16:06:40.277114+0000","last_became_active":"2023-10-08T16:06:40.271014+0000","last_became_peered":"2023-10-08T16:06:40.271014+0000","last_unstale":"2023-10-08T16:06:40.277114+0000","last_undegraded":"2023-10-08T16:06:40.277114+0000","last_fullsized":"2023-10-08T16:06:40.277114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275113+0000","last_change":"2023-10-08T16:06:40.264967+0000","last_active":"2023-10-08T16:06:40.275113+0000","last_peered":"2023-10-08T16:06:40.275113+0000","last_clean":"2023-10-08T16:06:40.275113+0000","last_became_active":"2023-10-08T16:06:40.264522+0000","last_became_peered":"2023-10-08T16:06:40.264522+0000","last_unstale":"2023-10-08T16:06:40.275113+0000","last_undegraded":"2023-10-08T16:06:40.275113+0000","last_fullsized":"2023-10-08T16:06:40.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275758+0000","last_change":"2023-10-08T16:06:40.266852+0000","last_active":"2023-10-08T16:06:40.275758+0000","last_peered":"2023-10-08T16:06:40.275758+0000","last_clean":"2023-10-08T16:06:40.275758+0000","last_became_active":"2023-10-08T16:06:40.266394+0000","last_became_peered":"2023-10-08T16:06:40.266394+0000","last_unstale":"2023-10-08T16:06:40.275758+0000","last_undegraded":"2023-10-08T16:06:40.275758+0000","last_fullsized":"2023-10-08T16:06:40.275758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279658+0000","last_change":"2023-10-08T16:06:40.272299+0000","last_active":"2023-10-08T16:06:40.279658+0000","last_peered":"2023-10-08T16:06:40.279658+0000","last_clean":"2023-10-08T16:06:40.279658+0000","last_became_active":"2023-10-08T16:06:40.271714+0000","last_became_peered":"2023-10-08T16:06:40.271714+0000","last_unstale":"2023-10-08T16:06:40.279658+0000","last_undegraded":"2023-10-08T16:06:40.279658+0000","last_fullsized":"2023-10-08T16:06:40.279658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268225+0000","last_change":"2023-10-08T16:06:40.266098+0000","last_active":"2023-10-08T16:06:40.268225+0000","last_peered":"2023-10-08T16:06:40.268225+0000","last_clean":"2023-10-08T16:06:40.268225+0000","last_became_active":"2023-10-08T16:06:40.265779+0000","last_became_peered":"2023-10-08T16:06:40.265779+0000","last_unstale":"2023-10-08T16:06:40.268225+0000","last_undegraded":"2023-10-08T16:06:40.268225+0000","last_fullsized":"2023-10-08T16:06:40.268225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279321+0000","last_change":"2023-10-08T16:06:40.269099+0000","last_active":"2023-10-08T16:06:40.279321+0000","last_peered":"2023-10-08T16:06:40.279321+0000","last_clean":"2023-10-08T16:06:40.279321+0000","last_became_active":"2023-10-08T16:06:40.268796+0000","last_became_peered":"2023-10-08T16:06:40.268796+0000","last_unstale":"2023-10-08T16:06:40.279321+0000","last_undegraded":"2023-10-08T16:06:40.279321+0000","last_fullsized":"2023-10-08T16:06:40.279321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268296+0000","last_change":"2023-10-08T16:06:40.264696+0000","last_active":"2023-10-08T16:06:40.268296+0000","last_peered":"2023-10-08T16:06:40.268296+0000","last_clean":"2023-10-08T16:06:40.268296+0000","last_became_active":"2023-10-08T16:06:40.264322+0000","last_became_peered":"2023-10-08T16:06:40.264322+0000","last_unstale":"2023-10-08T16:06:40.268296+0000","last_undegraded":"2023-10-08T16:06:40.268296+0000","last_fullsized":"2023-10-08T16:06:40.268296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275189+0000","last_change":"2023-10-08T16:06:40.266542+0000","last_active":"2023-10-08T16:06:40.275189+0000","last_peered":"2023-10-08T16:06:40.275189+0000","last_clean":"2023-10-08T16:06:40.275189+0000","last_became_active":"2023-10-08T16:06:40.266258+0000","last_became_peered":"2023-10-08T16:06:40.266258+0000","last_unstale":"2023-10-08T16:06:40.275189+0000","last_undegraded":"2023-10-08T16:06:40.275189+0000","last_fullsized":"2023-10-08T16:06:40.275189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270627+0000","last_change":"2023-10-08T16:06:40.268954+0000","last_active":"2023-10-08T16:06:40.270627+0000","last_peered":"2023-10-08T16:06:40.270627+0000","last_clean":"2023-10-08T16:06:40.270627+0000","last_became_active":"2023-10-08T16:06:40.268456+0000","last_became_peered":"2023-10-08T16:06:40.268456+0000","last_unstale":"2023-10-08T16:06:40.270627+0000","last_undegraded":"2023-10-08T16:06:40.270627+0000","last_fullsized":"2023-10-08T16:06:40.270627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273146+0000","last_change":"2023-10-08T16:06:40.268821+0000","last_active":"2023-10-08T16:06:40.273146+0000","last_peered":"2023-10-08T16:06:40.273146+0000","last_clean":"2023-10-08T16:06:40.273146+0000","last_became_active":"2023-10-08T16:06:40.268485+0000","last_became_peered":"2023-10-08T16:06:40.268485+0000","last_unstale":"2023-10-08T16:06:40.273146+0000","last_undegraded":"2023-10-08T16:06:40.273146+0000","last_fullsized":"2023-10-08T16:06:40.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275805+0000","last_change":"2023-10-08T16:06:40.267487+0000","last_active":"2023-10-08T16:06:40.275805+0000","last_peered":"2023-10-08T16:06:40.275805+0000","last_clean":"2023-10-08T16:06:40.275805+0000","last_became_active":"2023-10-08T16:06:40.267198+0000","last_became_peered":"2023-10-08T16:06:40.267198+0000","last_unstale":"2023-10-08T16:06:40.275805+0000","last_undegraded":"2023-10-08T16:06:40.275805+0000","last_fullsized":"2023-10-08T16:06:40.275805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279681+0000","last_change":"2023-10-08T16:06:40.272431+0000","last_active":"2023-10-08T16:06:40.279681+0000","last_peered":"2023-10-08T16:06:40.279681+0000","last_clean":"2023-10-08T16:06:40.279681+0000","last_became_active":"2023-10-08T16:06:40.271999+0000","last_became_peered":"2023-10-08T16:06:40.271999+0000","last_unstale":"2023-10-08T16:06:40.279681+0000","last_undegraded":"2023-10-08T16:06:40.279681+0000","last_fullsized":"2023-10-08T16:06:40.279681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278116+0000","last_change":"2023-10-08T16:06:40.273286+0000","last_active":"2023-10-08T16:06:40.278116+0000","last_peered":"2023-10-08T16:06:40.278116+0000","last_clean":"2023-10-08T16:06:40.278116+0000","last_became_active":"2023-10-08T16:06:40.272933+0000","last_became_peered":"2023-10-08T16:06:40.272933+0000","last_unstale":"2023-10-08T16:06:40.278116+0000","last_undegraded":"2023-10-08T16:06:40.278116+0000","last_fullsized":"2023-10-08T16:06:40.278116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275156+0000","last_change":"2023-10-08T16:06:40.265329+0000","last_active":"2023-10-08T16:06:40.275156+0000","last_peered":"2023-10-08T16:06:40.275156+0000","last_clean":"2023-10-08T16:06:40.275156+0000","last_became_active":"2023-10-08T16:06:40.264972+0000","last_became_peered":"2023-10-08T16:06:40.264972+0000","last_unstale":"2023-10-08T16:06:40.275156+0000","last_undegraded":"2023-10-08T16:06:40.275156+0000","last_fullsized":"2023-10-08T16:06:40.275156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268526+0000","last_change":"2023-10-08T16:06:40.263993+0000","last_active":"2023-10-08T16:06:40.268526+0000","last_peered":"2023-10-08T16:06:40.268526+0000","last_clean":"2023-10-08T16:06:40.268526+0000","last_became_active":"2023-10-08T16:06:40.263538+0000","last_became_peered":"2023-10-08T16:06:40.263538+0000","last_unstale":"2023-10-08T16:06:40.268526+0000","last_undegraded":"2023-10-08T16:06:40.268526+0000","last_fullsized":"2023-10-08T16:06:40.268526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:29.217008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301721+0000","last_change":"2023-10-08T16:06:39.297623+0000","last_active":"2023-10-08T16:06:40.301721+0000","last_peered":"2023-10-08T16:06:40.301721+0000","last_clean":"2023-10-08T16:06:40.301721+0000","last_became_active":"2023-10-08T16:06:39.292440+0000","last_became_peered":"2023-10-08T16:06:39.292440+0000","last_unstale":"2023-10-08T16:06:40.301721+0000","last_undegraded":"2023-10-08T16:06:40.301721+0000","last_fullsized":"2023-10-08T16:06:40.301721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269305+0000","last_change":"2023-10-08T16:06:40.258340+0000","last_active":"2023-10-08T16:06:40.269305+0000","last_peered":"2023-10-08T16:06:40.269305+0000","last_clean":"2023-10-08T16:06:40.269305+0000","last_became_active":"2023-10-08T16:06:40.257980+0000","last_became_peered":"2023-10-08T16:06:40.257980+0000","last_unstale":"2023-10-08T16:06:40.269305+0000","last_undegraded":"2023-10-08T16:06:40.269305+0000","last_fullsized":"2023-10-08T16:06:40.269305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301568+0000","last_change":"2023-10-08T16:06:39.291777+0000","last_active":"2023-10-08T16:06:40.301568+0000","last_peered":"2023-10-08T16:06:40.301568+0000","last_clean":"2023-10-08T16:06:40.301568+0000","last_became_active":"2023-10-08T16:06:39.290855+0000","last_became_peered":"2023-10-08T16:06:39.290855+0000","last_unstale":"2023-10-08T16:06:40.301568+0000","last_undegraded":"2023-10-08T16:06:40.301568+0000","last_fullsized":"2023-10-08T16:06:40.301568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.255042+0000","last_change":"2023-10-08T16:06:39.301682+0000","last_active":"2023-10-08T16:06:40.255042+0000","last_peered":"2023-10-08T16:06:40.255042+0000","last_clean":"2023-10-08T16:06:40.255042+0000","last_became_active":"2023-10-08T16:06:39.300996+0000","last_became_peered":"2023-10-08T16:06:39.300996+0000","last_unstale":"2023-10-08T16:06:40.255042+0000","last_undegraded":"2023-10-08T16:06:40.255042+0000","last_fullsized":"2023-10-08T16:06:40.255042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270724+0000","last_change":"2023-10-08T16:06:40.266918+0000","last_active":"2023-10-08T16:06:40.270724+0000","last_peered":"2023-10-08T16:06:40.270724+0000","last_clean":"2023-10-08T16:06:40.270724+0000","last_became_active":"2023-10-08T16:06:40.266574+0000","last_became_peered":"2023-10-08T16:06:40.266574+0000","last_unstale":"2023-10-08T16:06:40.270724+0000","last_undegraded":"2023-10-08T16:06:40.270724+0000","last_fullsized":"2023-10-08T16:06:40.270724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269496+0000","last_change":"2023-10-08T16:06:39.294887+0000","last_active":"2023-10-08T16:06:40.269496+0000","last_peered":"2023-10-08T16:06:40.269496+0000","last_clean":"2023-10-08T16:06:40.269496+0000","last_became_active":"2023-10-08T16:06:39.294362+0000","last_became_peered":"2023-10-08T16:06:39.294362+0000","last_unstale":"2023-10-08T16:06:40.269496+0000","last_undegraded":"2023-10-08T16:06:40.269496+0000","last_fullsized":"2023-10-08T16:06:40.269496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270647+0000","last_change":"2023-10-08T16:06:40.269161+0000","last_active":"2023-10-08T16:06:40.270647+0000","last_peered":"2023-10-08T16:06:40.270647+0000","last_clean":"2023-10-08T16:06:40.270647+0000","last_became_active":"2023-10-08T16:06:40.268258+0000","last_became_peered":"2023-10-08T16:06:40.268258+0000","last_unstale":"2023-10-08T16:06:40.270647+0000","last_undegraded":"2023-10-08T16:06:40.270647+0000","last_fullsized":"2023-10-08T16:06:40.270647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253455+0000","last_change":"2023-10-08T16:06:39.298780+0000","last_active":"2023-10-08T16:06:40.253455+0000","last_peered":"2023-10-08T16:06:40.253455+0000","last_clean":"2023-10-08T16:06:40.253455+0000","last_became_active":"2023-10-08T16:06:39.298461+0000","last_became_peered":"2023-10-08T16:06:39.298461+0000","last_unstale":"2023-10-08T16:06:40.253455+0000","last_undegraded":"2023-10-08T16:06:40.253455+0000","last_fullsized":"2023-10-08T16:06:40.253455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282263+0000","last_change":"2023-10-08T16:06:40.275019+0000","last_active":"2023-10-08T16:06:40.282263+0000","last_peered":"2023-10-08T16:06:40.282263+0000","last_clean":"2023-10-08T16:06:40.282263+0000","last_became_active":"2023-10-08T16:06:40.269866+0000","last_became_peered":"2023-10-08T16:06:40.269866+0000","last_unstale":"2023-10-08T16:06:40.282263+0000","last_undegraded":"2023-10-08T16:06:40.282263+0000","last_fullsized":"2023-10-08T16:06:40.282263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.274887+0000","last_change":"2023-10-08T16:06:39.302453+0000","last_active":"2023-10-08T16:06:40.274887+0000","last_peered":"2023-10-08T16:06:40.274887+0000","last_clean":"2023-10-08T16:06:40.274887+0000","last_became_active":"2023-10-08T16:06:39.302108+0000","last_became_peered":"2023-10-08T16:06:39.302108+0000","last_unstale":"2023-10-08T16:06:40.274887+0000","last_undegraded":"2023-10-08T16:06:40.274887+0000","last_fullsized":"2023-10-08T16:06:40.274887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278252+0000","last_change":"2023-10-08T16:06:40.273266+0000","last_active":"2023-10-08T16:06:40.278252+0000","last_peered":"2023-10-08T16:06:40.278252+0000","last_clean":"2023-10-08T16:06:40.278252+0000","last_became_active":"2023-10-08T16:06:40.272860+0000","last_became_peered":"2023-10-08T16:06:40.272860+0000","last_unstale":"2023-10-08T16:06:40.278252+0000","last_undegraded":"2023-10-08T16:06:40.278252+0000","last_fullsized":"2023-10-08T16:06:40.278252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300737+0000","last_change":"2023-10-08T16:06:39.293871+0000","last_active":"2023-10-08T16:06:40.300737+0000","last_peered":"2023-10-08T16:06:40.300737+0000","last_clean":"2023-10-08T16:06:40.300737+0000","last_became_active":"2023-10-08T16:06:39.293517+0000","last_became_peered":"2023-10-08T16:06:39.293517+0000","last_unstale":"2023-10-08T16:06:40.300737+0000","last_undegraded":"2023-10-08T16:06:40.300737+0000","last_fullsized":"2023-10-08T16:06:40.300737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271405+0000","last_change":"2023-10-08T16:06:40.266413+0000","last_active":"2023-10-08T16:06:40.271405+0000","last_peered":"2023-10-08T16:06:40.271405+0000","last_clean":"2023-10-08T16:06:40.271405+0000","last_became_active":"2023-10-08T16:06:40.266098+0000","last_became_peered":"2023-10-08T16:06:40.266098+0000","last_unstale":"2023-10-08T16:06:40.271405+0000","last_undegraded":"2023-10-08T16:06:40.271405+0000","last_fullsized":"2023-10-08T16:06:40.271405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:25.752461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.307815+0000","last_change":"2023-10-08T16:06:39.296406+0000","last_active":"2023-10-08T16:06:40.307815+0000","last_peered":"2023-10-08T16:06:40.307815+0000","last_clean":"2023-10-08T16:06:40.307815+0000","last_became_active":"2023-10-08T16:06:39.296075+0000","last_became_peered":"2023-10-08T16:06:39.296075+0000","last_unstale":"2023-10-08T16:06:40.307815+0000","last_undegraded":"2023-10-08T16:06:40.307815+0000","last_fullsized":"2023-10-08T16:06:40.307815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275787+0000","last_change":"2023-10-08T16:06:40.270048+0000","last_active":"2023-10-08T16:06:40.275787+0000","last_peered":"2023-10-08T16:06:40.275787+0000","last_clean":"2023-10-08T16:06:40.275787+0000","last_became_active":"2023-10-08T16:06:40.269726+0000","last_became_peered":"2023-10-08T16:06:40.269726+0000","last_unstale":"2023-10-08T16:06:40.275787+0000","last_undegraded":"2023-10-08T16:06:40.275787+0000","last_fullsized":"2023-10-08T16:06:40.275787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301282+0000","last_change":"2023-10-08T16:06:39.294192+0000","last_active":"2023-10-08T16:06:40.301282+0000","last_peered":"2023-10-08T16:06:40.301282+0000","last_clean":"2023-10-08T16:06:40.301282+0000","last_became_active":"2023-10-08T16:06:39.293881+0000","last_became_peered":"2023-10-08T16:06:39.293881+0000","last_unstale":"2023-10-08T16:06:40.301282+0000","last_undegraded":"2023-10-08T16:06:40.301282+0000","last_fullsized":"2023-10-08T16:06:40.301282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:43.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275717+0000","last_change":"2023-10-08T16:06:40.266213+0000","last_active":"2023-10-08T16:06:40.275717+0000","last_peered":"2023-10-08T16:06:40.275717+0000","last_clean":"2023-10-08T16:06:40.275717+0000","last_became_active":"2023-10-08T16:06:40.265860+0000","last_became_peered":"2023-10-08T16:06:40.265860+0000","last_unstale":"2023-10-08T16:06:40.275717+0000","last_undegraded":"2023-10-08T16:06:40.275717+0000","last_fullsized":"2023-10-08T16:06:40.275717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269558+0000","last_change":"2023-10-08T16:06:39.300216+0000","last_active":"2023-10-08T16:06:40.269558+0000","last_peered":"2023-10-08T16:06:40.269558+0000","last_clean":"2023-10-08T16:06:40.269558+0000","last_became_active":"2023-10-08T16:06:39.299914+0000","last_became_peered":"2023-10-08T16:06:39.299914+0000","last_unstale":"2023-10-08T16:06:40.269558+0000","last_undegraded":"2023-10-08T16:06:40.269558+0000","last_fullsized":"2023-10-08T16:06:40.269558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277069+0000","last_change":"2023-10-08T16:06:40.272059+0000","last_active":"2023-10-08T16:06:40.277069+0000","last_peered":"2023-10-08T16:06:40.277069+0000","last_clean":"2023-10-08T16:06:40.277069+0000","last_became_active":"2023-10-08T16:06:40.271730+0000","last_became_peered":"2023-10-08T16:06:40.271730+0000","last_unstale":"2023-10-08T16:06:40.277069+0000","last_undegraded":"2023-10-08T16:06:40.277069+0000","last_fullsized":"2023-10-08T16:06:40.277069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.251622+0000","last_change":"2023-10-08T16:06:39.291194+0000","last_active":"2023-10-08T16:06:40.251622+0000","last_peered":"2023-10-08T16:06:40.251622+0000","last_clean":"2023-10-08T16:06:40.251622+0000","last_became_active":"2023-10-08T16:06:39.290849+0000","last_became_peered":"2023-10-08T16:06:39.290849+0000","last_unstale":"2023-10-08T16:06:40.251622+0000","last_undegraded":"2023-10-08T16:06:40.251622+0000","last_fullsized":"2023-10-08T16:06:40.251622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267696+0000","last_change":"2023-10-08T16:06:40.259709+0000","last_active":"2023-10-08T16:06:40.267696+0000","last_peered":"2023-10-08T16:06:40.267696+0000","last_clean":"2023-10-08T16:06:40.267696+0000","last_became_active":"2023-10-08T16:06:40.259122+0000","last_became_peered":"2023-10-08T16:06:40.259122+0000","last_unstale":"2023-10-08T16:06:40.267696+0000","last_undegraded":"2023-10-08T16:06:40.267696+0000","last_fullsized":"2023-10-08T16:06:40.267696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.306618+0000","last_change":"2023-10-08T16:06:39.291829+0000","last_active":"2023-10-08T16:06:40.306618+0000","last_peered":"2023-10-08T16:06:40.306618+0000","last_clean":"2023-10-08T16:06:40.306618+0000","last_became_active":"2023-10-08T16:06:39.291331+0000","last_became_peered":"2023-10-08T16:06:39.291331+0000","last_unstale":"2023-10-08T16:06:40.306618+0000","last_undegraded":"2023-10-08T16:06:40.306618+0000","last_fullsized":"2023-10-08T16:06:40.306618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277354+0000","last_change":"2023-10-08T16:06:40.270693+0000","last_active":"2023-10-08T16:06:40.277354+0000","last_peered":"2023-10-08T16:06:40.277354+0000","last_clean":"2023-10-08T16:06:40.277354+0000","last_became_active":"2023-10-08T16:06:40.269238+0000","last_became_peered":"2023-10-08T16:06:40.269238+0000","last_unstale":"2023-10-08T16:06:40.277354+0000","last_undegraded":"2023-10-08T16:06:40.277354+0000","last_fullsized":"2023-10-08T16:06:40.277354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.302954+0000","last_change":"2023-10-08T16:06:39.294859+0000","last_active":"2023-10-08T16:06:40.302954+0000","last_peered":"2023-10-08T16:06:40.302954+0000","last_clean":"2023-10-08T16:06:40.302954+0000","last_became_active":"2023-10-08T16:06:39.294549+0000","last_became_peered":"2023-10-08T16:06:39.294549+0000","last_unstale":"2023-10-08T16:06:40.302954+0000","last_undegraded":"2023-10-08T16:06:40.302954+0000","last_fullsized":"2023-10-08T16:06:40.302954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:30.419636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276379+0000","last_change":"2023-10-08T16:06:40.270175+0000","last_active":"2023-10-08T16:06:40.276379+0000","last_peered":"2023-10-08T16:06:40.276379+0000","last_clean":"2023-10-08T16:06:40.276379+0000","last_became_active":"2023-10-08T16:06:40.269029+0000","last_became_peered":"2023-10-08T16:06:40.269029+0000","last_unstale":"2023-10-08T16:06:40.276379+0000","last_undegraded":"2023-10-08T16:06:40.276379+0000","last_fullsized":"2023-10-08T16:06:40.276379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301969+0000","last_change":"2023-10-08T16:06:39.299037+0000","last_active":"2023-10-08T16:06:40.301969+0000","last_peered":"2023-10-08T16:06:40.301969+0000","last_clean":"2023-10-08T16:06:40.301969+0000","last_became_active":"2023-10-08T16:06:39.298664+0000","last_became_peered":"2023-10-08T16:06:39.298664+0000","last_unstale":"2023-10-08T16:06:40.301969+0000","last_undegraded":"2023-10-08T16:06:40.301969+0000","last_fullsized":"2023-10-08T16:06:40.301969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277144+0000","last_change":"2023-10-08T16:06:40.272886+0000","last_active":"2023-10-08T16:06:40.277144+0000","last_peered":"2023-10-08T16:06:40.277144+0000","last_clean":"2023-10-08T16:06:40.277144+0000","last_became_active":"2023-10-08T16:06:40.272556+0000","last_became_peered":"2023-10-08T16:06:40.272556+0000","last_unstale":"2023-10-08T16:06:40.277144+0000","last_undegraded":"2023-10-08T16:06:40.277144+0000","last_fullsized":"2023-10-08T16:06:40.277144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300889+0000","last_change":"2023-10-08T16:06:39.293894+0000","last_active":"2023-10-08T16:06:40.300889+0000","last_peered":"2023-10-08T16:06:40.300889+0000","last_clean":"2023-10-08T16:06:40.300889+0000","last_became_active":"2023-10-08T16:06:39.293562+0000","last_became_peered":"2023-10-08T16:06:39.293562+0000","last_unstale":"2023-10-08T16:06:40.300889+0000","last_undegraded":"2023-10-08T16:06:40.300889+0000","last_fullsized":"2023-10-08T16:06:40.300889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282094+0000","last_change":"2023-10-08T16:06:40.273176+0000","last_active":"2023-10-08T16:06:40.282094+0000","last_peered":"2023-10-08T16:06:40.282094+0000","last_clean":"2023-10-08T16:06:40.282094+0000","last_became_active":"2023-10-08T16:06:40.272791+0000","last_became_peered":"2023-10-08T16:06:40.272791+0000","last_unstale":"2023-10-08T16:06:40.282094+0000","last_undegraded":"2023-10-08T16:06:40.282094+0000","last_fullsized":"2023-10-08T16:06:40.282094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.254116+0000","last_change":"2023-10-08T16:06:39.293390+0000","last_active":"2023-10-08T16:06:40.254116+0000","last_peered":"2023-10-08T16:06:40.254116+0000","last_clean":"2023-10-08T16:06:40.254116+0000","last_became_active":"2023-10-08T16:06:39.293063+0000","last_became_peered":"2023-10-08T16:06:39.293063+0000","last_unstale":"2023-10-08T16:06:40.254116+0000","last_undegraded":"2023-10-08T16:06:40.254116+0000","last_fullsized":"2023-10-08T16:06:40.254116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279769+0000","last_change":"2023-10-08T16:06:40.276714+0000","last_active":"2023-10-08T16:06:40.279769+0000","last_peered":"2023-10-08T16:06:40.279769+0000","last_clean":"2023-10-08T16:06:40.279769+0000","last_became_active":"2023-10-08T16:06:40.276322+0000","last_became_peered":"2023-10-08T16:06:40.276322+0000","last_unstale":"2023-10-08T16:06:40.279769+0000","last_undegraded":"2023-10-08T16:06:40.279769+0000","last_fullsized":"2023-10-08T16:06:40.279769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:28.338803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259410+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:40.259410+0000","last_peered":"2023-10-08T16:06:40.259410+0000","last_clean":"2023-10-08T16:06:40.259410+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:40.259410+0000","last_undegraded":"2023-10-08T16:06:40.259410+0000","last_fullsized":"2023-10-08T16:06:40.259410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269492+0000","last_change":"2023-10-08T16:06:39.293223+0000","last_active":"2023-10-08T16:06:40.269492+0000","last_peered":"2023-10-08T16:06:40.269492+0000","last_clean":"2023-10-08T16:06:40.269492+0000","last_became_active":"2023-10-08T16:06:39.292861+0000","last_became_peered":"2023-10-08T16:06:39.292861+0000","last_unstale":"2023-10-08T16:06:40.269492+0000","last_undegraded":"2023-10-08T16:06:40.269492+0000","last_fullsized":"2023-10-08T16:06:40.269492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281318+0000","last_change":"2023-10-08T16:06:40.279550+0000","last_active":"2023-10-08T16:06:40.281318+0000","last_peered":"2023-10-08T16:06:40.281318+0000","last_clean":"2023-10-08T16:06:40.281318+0000","last_became_active":"2023-10-08T16:06:40.279258+0000","last_became_peered":"2023-10-08T16:06:40.279258+0000","last_unstale":"2023-10-08T16:06:40.281318+0000","last_undegraded":"2023-10-08T16:06:40.281318+0000","last_fullsized":"2023-10-08T16:06:40.281318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259307+0000","last_change":"2023-10-08T16:06:39.303341+0000","last_active":"2023-10-08T16:06:40.259307+0000","last_peered":"2023-10-08T16:06:40.259307+0000","last_clean":"2023-10-08T16:06:40.259307+0000","last_became_active":"2023-10-08T16:06:39.303000+0000","last_became_peered":"2023-10-08T16:06:39.303000+0000","last_unstale":"2023-10-08T16:06:40.259307+0000","last_undegraded":"2023-10-08T16:06:40.259307+0000","last_fullsized":"2023-10-08T16:06:40.259307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:46.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269369+0000","last_change":"2023-10-08T16:06:40.259545+0000","last_active":"2023-10-08T16:06:40.269369+0000","last_peered":"2023-10-08T16:06:40.269369+0000","last_clean":"2023-10-08T16:06:40.269369+0000","last_became_active":"2023-10-08T16:06:40.259191+0000","last_became_peered":"2023-10-08T16:06:40.259191+0000","last_unstale":"2023-10-08T16:06:40.269369+0000","last_undegraded":"2023-10-08T16:06:40.269369+0000","last_fullsized":"2023-10-08T16:06:40.269369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253367+0000","last_change":"2023-10-08T16:06:39.299839+0000","last_active":"2023-10-08T16:06:40.253367+0000","last_peered":"2023-10-08T16:06:40.253367+0000","last_clean":"2023-10-08T16:06:40.253367+0000","last_became_active":"2023-10-08T16:06:39.299351+0000","last_became_peered":"2023-10-08T16:06:39.299351+0000","last_unstale":"2023-10-08T16:06:40.253367+0000","last_undegraded":"2023-10-08T16:06:40.253367+0000","last_fullsized":"2023-10-08T16:06:40.253367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269108+0000","last_change":"2023-10-08T16:06:40.263602+0000","last_active":"2023-10-08T16:06:40.269108+0000","last_peered":"2023-10-08T16:06:40.269108+0000","last_clean":"2023-10-08T16:06:40.269108+0000","last_became_active":"2023-10-08T16:06:40.263275+0000","last_became_peered":"2023-10-08T16:06:40.263275+0000","last_unstale":"2023-10-08T16:06:40.269108+0000","last_undegraded":"2023-10-08T16:06:40.269108+0000","last_fullsized":"2023-10-08T16:06:40.269108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269681+0000","last_change":"2023-10-08T16:06:39.298167+0000","last_active":"2023-10-08T16:06:40.269681+0000","last_peered":"2023-10-08T16:06:40.269681+0000","last_clean":"2023-10-08T16:06:40.269681+0000","last_became_active":"2023-10-08T16:06:39.297678+0000","last_became_peered":"2023-10-08T16:06:39.297678+0000","last_unstale":"2023-10-08T16:06:40.269681+0000","last_undegraded":"2023-10-08T16:06:40.269681+0000","last_fullsized":"2023-10-08T16:06:40.269681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276831+0000","last_change":"2023-10-08T16:06:40.271343+0000","last_active":"2023-10-08T16:06:40.276831+0000","last_peered":"2023-10-08T16:06:40.276831+0000","last_clean":"2023-10-08T16:06:40.276831+0000","last_became_active":"2023-10-08T16:06:40.270882+0000","last_became_peered":"2023-10-08T16:06:40.270882+0000","last_unstale":"2023-10-08T16:06:40.276831+0000","last_undegraded":"2023-10-08T16:06:40.276831+0000","last_fullsized":"2023-10-08T16:06:40.276831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258762+0000","last_change":"2023-10-08T16:06:39.293588+0000","last_active":"2023-10-08T16:06:40.258762+0000","last_peered":"2023-10-08T16:06:40.258762+0000","last_clean":"2023-10-08T16:06:40.258762+0000","last_became_active":"2023-10-08T16:06:39.293209+0000","last_became_peered":"2023-10-08T16:06:39.293209+0000","last_unstale":"2023-10-08T16:06:40.258762+0000","last_undegraded":"2023-10-08T16:06:40.258762+0000","last_fullsized":"2023-10-08T16:06:40.258762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282337+0000","last_change":"2023-10-08T16:06:40.275327+0000","last_active":"2023-10-08T16:06:40.282337+0000","last_peered":"2023-10-08T16:06:40.282337+0000","last_clean":"2023-10-08T16:06:40.282337+0000","last_became_active":"2023-10-08T16:06:40.274778+0000","last_became_peered":"2023-10-08T16:06:40.274778+0000","last_unstale":"2023-10-08T16:06:40.282337+0000","last_undegraded":"2023-10-08T16:06:40.282337+0000","last_fullsized":"2023-10-08T16:06:40.282337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:24.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.262394+0000","last_change":"2023-10-08T16:06:39.303540+0000","last_active":"2023-10-08T16:06:40.262394+0000","last_peered":"2023-10-08T16:06:40.262394+0000","last_clean":"2023-10-08T16:06:40.262394+0000","last_became_active":"2023-10-08T16:06:39.303264+0000","last_became_peered":"2023-10-08T16:06:39.303264+0000","last_unstale":"2023-10-08T16:06:40.262394+0000","last_undegraded":"2023-10-08T16:06:40.262394+0000","last_fullsized":"2023-10-08T16:06:40.262394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269828+0000","last_change":"2023-10-08T16:06:40.263957+0000","last_active":"2023-10-08T16:06:40.269828+0000","last_peered":"2023-10-08T16:06:40.269828+0000","last_clean":"2023-10-08T16:06:40.269828+0000","last_became_active":"2023-10-08T16:06:40.263566+0000","last_became_peered":"2023-10-08T16:06:40.263566+0000","last_unstale":"2023-10-08T16:06:40.269828+0000","last_undegraded":"2023-10-08T16:06:40.269828+0000","last_fullsized":"2023-10-08T16:06:40.269828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260207+0000","last_change":"2023-10-08T16:06:39.301605+0000","last_active":"2023-10-08T16:06:40.260207+0000","last_peered":"2023-10-08T16:06:40.260207+0000","last_clean":"2023-10-08T16:06:40.260207+0000","last_became_active":"2023-10-08T16:06:39.301289+0000","last_became_peered":"2023-10-08T16:06:39.301289+0000","last_unstale":"2023-10-08T16:06:40.260207+0000","last_undegraded":"2023-10-08T16:06:40.260207+0000","last_fullsized":"2023-10-08T16:06:40.260207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273159+0000","last_change":"2023-10-08T16:06:40.268834+0000","last_active":"2023-10-08T16:06:40.273159+0000","last_peered":"2023-10-08T16:06:40.273159+0000","last_clean":"2023-10-08T16:06:40.273159+0000","last_became_active":"2023-10-08T16:06:40.268449+0000","last_became_peered":"2023-10-08T16:06:40.268449+0000","last_unstale":"2023-10-08T16:06:40.273159+0000","last_undegraded":"2023-10-08T16:06:40.273159+0000","last_fullsized":"2023-10-08T16:06:40.273159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300880+0000","last_change":"2023-10-08T16:06:39.300940+0000","last_active":"2023-10-08T16:06:40.300880+0000","last_peered":"2023-10-08T16:06:40.300880+0000","last_clean":"2023-10-08T16:06:40.300880+0000","last_became_active":"2023-10-08T16:06:39.300556+0000","last_became_peered":"2023-10-08T16:06:39.300556+0000","last_unstale":"2023-10-08T16:06:40.300880+0000","last_undegraded":"2023-10-08T16:06:40.300880+0000","last_fullsized":"2023-10-08T16:06:40.300880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275841+0000","last_change":"2023-10-08T16:06:40.267528+0000","last_active":"2023-10-08T16:06:40.275841+0000","last_peered":"2023-10-08T16:06:40.275841+0000","last_clean":"2023-10-08T16:06:40.275841+0000","last_became_active":"2023-10-08T16:06:40.266866+0000","last_became_peered":"2023-10-08T16:06:40.266866+0000","last_unstale":"2023-10-08T16:06:40.275841+0000","last_undegraded":"2023-10-08T16:06:40.275841+0000","last_fullsized":"2023-10-08T16:06:40.275841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:53.878852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258987+0000","last_change":"2023-10-08T16:06:39.302711+0000","last_active":"2023-10-08T16:06:40.258987+0000","last_peered":"2023-10-08T16:06:40.258987+0000","last_clean":"2023-10-08T16:06:40.258987+0000","last_became_active":"2023-10-08T16:06:39.302404+0000","last_became_peered":"2023-10-08T16:06:39.302404+0000","last_unstale":"2023-10-08T16:06:40.258987+0000","last_undegraded":"2023-10-08T16:06:40.258987+0000","last_fullsized":"2023-10-08T16:06:40.258987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268533+0000","last_change":"2023-10-08T16:06:40.263548+0000","last_active":"2023-10-08T16:06:40.268533+0000","last_peered":"2023-10-08T16:06:40.268533+0000","last_clean":"2023-10-08T16:06:40.268533+0000","last_became_active":"2023-10-08T16:06:40.263230+0000","last_became_peered":"2023-10-08T16:06:40.263230+0000","last_unstale":"2023-10-08T16:06:40.268533+0000","last_undegraded":"2023-10-08T16:06:40.268533+0000","last_fullsized":"2023-10-08T16:06:40.268533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:50.492409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258991+0000","last_change":"2023-10-08T16:06:39.299840+0000","last_active":"2023-10-08T16:06:40.258991+0000","last_peered":"2023-10-08T16:06:40.258991+0000","last_clean":"2023-10-08T16:06:40.258991+0000","last_became_active":"2023-10-08T16:06:39.299502+0000","last_became_peered":"2023-10-08T16:06:39.299502+0000","last_unstale":"2023-10-08T16:06:40.258991+0000","last_undegraded":"2023-10-08T16:06:40.258991+0000","last_fullsized":"2023-10-08T16:06:40.258991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268950+0000","last_change":"2023-10-08T16:06:40.263516+0000","last_active":"2023-10-08T16:06:40.268950+0000","last_peered":"2023-10-08T16:06:40.268950+0000","last_clean":"2023-10-08T16:06:40.268950+0000","last_became_active":"2023-10-08T16:06:40.263180+0000","last_became_peered":"2023-10-08T16:06:40.263180+0000","last_unstale":"2023-10-08T16:06:40.268950+0000","last_undegraded":"2023-10-08T16:06:40.268950+0000","last_fullsized":"2023-10-08T16:06:40.268950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260056+0000","last_change":"2023-10-08T16:06:39.302588+0000","last_active":"2023-10-08T16:06:40.260056+0000","last_peered":"2023-10-08T16:06:40.260056+0000","last_clean":"2023-10-08T16:06:40.260056+0000","last_became_active":"2023-10-08T16:06:39.302361+0000","last_became_peered":"2023-10-08T16:06:39.302361+0000","last_unstale":"2023-10-08T16:06:40.260056+0000","last_undegraded":"2023-10-08T16:06:40.260056+0000","last_fullsized":"2023-10-08T16:06:40.260056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267686+0000","last_change":"2023-10-08T16:06:40.262950+0000","last_active":"2023-10-08T16:06:40.267686+0000","last_peered":"2023-10-08T16:06:40.267686+0000","last_clean":"2023-10-08T16:06:40.267686+0000","last_became_active":"2023-10-08T16:06:40.262620+0000","last_became_peered":"2023-10-08T16:06:40.262620+0000","last_unstale":"2023-10-08T16:06:40.267686+0000","last_undegraded":"2023-10-08T16:06:40.267686+0000","last_fullsized":"2023-10-08T16:06:40.267686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301577+0000","last_change":"2023-10-08T16:06:39.304109+0000","last_active":"2023-10-08T16:06:40.301577+0000","last_peered":"2023-10-08T16:06:40.301577+0000","last_clean":"2023-10-08T16:06:40.301577+0000","last_became_active":"2023-10-08T16:06:39.303757+0000","last_became_peered":"2023-10-08T16:06:39.303757+0000","last_unstale":"2023-10-08T16:06:40.301577+0000","last_undegraded":"2023-10-08T16:06:40.301577+0000","last_fullsized":"2023-10-08T16:06:40.301577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267750+0000","last_change":"2023-10-08T16:06:40.259475+0000","last_active":"2023-10-08T16:06:40.267750+0000","last_peered":"2023-10-08T16:06:40.267750+0000","last_clean":"2023-10-08T16:06:40.267750+0000","last_became_active":"2023-10-08T16:06:40.259042+0000","last_became_peered":"2023-10-08T16:06:40.259042+0000","last_unstale":"2023-10-08T16:06:40.267750+0000","last_undegraded":"2023-10-08T16:06:40.267750+0000","last_fullsized":"2023-10-08T16:06:40.267750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282564+0000","last_change":"2023-10-08T16:06:40.276456+0000","last_active":"2023-10-08T16:06:40.282564+0000","last_peered":"2023-10-08T16:06:40.282564+0000","last_clean":"2023-10-08T16:06:40.282564+0000","last_became_active":"2023-10-08T16:06:40.276127+0000","last_became_peered":"2023-10-08T16:06:40.276127+0000","last_unstale":"2023-10-08T16:06:40.282564+0000","last_undegraded":"2023-10-08T16:06:40.282564+0000","last_fullsized":"2023-10-08T16:06:40.282564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.299639+0000","last_change":"2023-10-08T16:06:39.302950+0000","last_active":"2023-10-08T16:06:40.299639+0000","last_peered":"2023-10-08T16:06:40.299639+0000","last_clean":"2023-10-08T16:06:40.299639+0000","last_became_active":"2023-10-08T16:06:39.302504+0000","last_became_peered":"2023-10-08T16:06:39.302504+0000","last_unstale":"2023-10-08T16:06:40.299639+0000","last_undegraded":"2023-10-08T16:06:40.299639+0000","last_fullsized":"2023-10-08T16:06:40.299639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279270+0000","last_change":"2023-10-08T16:06:40.269067+0000","last_active":"2023-10-08T16:06:40.279270+0000","last_peered":"2023-10-08T16:06:40.279270+0000","last_clean":"2023-10-08T16:06:40.279270+0000","last_became_active":"2023-10-08T16:06:40.268755+0000","last_became_peered":"2023-10-08T16:06:40.268755+0000","last_unstale":"2023-10-08T16:06:40.279270+0000","last_undegraded":"2023-10-08T16:06:40.279270+0000","last_fullsized":"2023-10-08T16:06:40.279270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300353+0000","last_change":"2023-10-08T16:06:39.305358+0000","last_active":"2023-10-08T16:06:40.300353+0000","last_peered":"2023-10-08T16:06:40.300353+0000","last_clean":"2023-10-08T16:06:40.300353+0000","last_became_active":"2023-10-08T16:06:39.305022+0000","last_became_peered":"2023-10-08T16:06:39.305022+0000","last_unstale":"2023-10-08T16:06:40.300353+0000","last_undegraded":"2023-10-08T16:06:40.300353+0000","last_fullsized":"2023-10-08T16:06:40.300353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:17.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278272+0000","last_change":"2023-10-08T16:06:40.274826+0000","last_active":"2023-10-08T16:06:40.278272+0000","last_peered":"2023-10-08T16:06:40.278272+0000","last_clean":"2023-10-08T16:06:40.278272+0000","last_became_active":"2023-10-08T16:06:40.274506+0000","last_became_peered":"2023-10-08T16:06:40.274506+0000","last_unstale":"2023-10-08T16:06:40.278272+0000","last_undegraded":"2023-10-08T16:06:40.278272+0000","last_fullsized":"2023-10-08T16:06:40.278272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301960+0000","last_change":"2023-10-08T16:06:39.298025+0000","last_active":"2023-10-08T16:06:40.301960+0000","last_peered":"2023-10-08T16:06:40.301960+0000","last_clean":"2023-10-08T16:06:40.301960+0000","last_became_active":"2023-10-08T16:06:39.297643+0000","last_became_peered":"2023-10-08T16:06:39.297643+0000","last_unstale":"2023-10-08T16:06:40.301960+0000","last_undegraded":"2023-10-08T16:06:40.301960+0000","last_fullsized":"2023-10-08T16:06:40.301960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273032+0000","last_change":"2023-10-08T16:06:40.268521+0000","last_active":"2023-10-08T16:06:40.273032+0000","last_peered":"2023-10-08T16:06:40.273032+0000","last_clean":"2023-10-08T16:06:40.273032+0000","last_became_active":"2023-10-08T16:06:40.267613+0000","last_became_peered":"2023-10-08T16:06:40.267613+0000","last_unstale":"2023-10-08T16:06:40.273032+0000","last_undegraded":"2023-10-08T16:06:40.273032+0000","last_fullsized":"2023-10-08T16:06:40.273032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301633+0000","last_change":"2023-10-08T16:06:39.303632+0000","last_active":"2023-10-08T16:06:40.301633+0000","last_peered":"2023-10-08T16:06:40.301633+0000","last_clean":"2023-10-08T16:06:40.301633+0000","last_became_active":"2023-10-08T16:06:39.303353+0000","last_became_peered":"2023-10-08T16:06:39.303353+0000","last_unstale":"2023-10-08T16:06:40.301633+0000","last_undegraded":"2023-10-08T16:06:40.301633+0000","last_fullsized":"2023-10-08T16:06:40.301633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:47.660 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:47.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 Processor -- start 2023-10-08T16:06:47.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 -- start start 2023-10-08T16:06:47.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29c4155e00 0x7f29c40c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:47.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c40c64e0 0x7f29c40ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:47.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c40c8b90 con 0x7f29c41561d0 2023-10-08T16:06:47.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c415aa50 con 0x7f29c4155e00 2023-10-08T16:06:47.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29caf96700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40cbdb0 con 0x7f29c40c64e0 2023-10-08T16:06:47.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.771+0000 7f29c3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f29c41561d0 0x7f29c406ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56872/0 (socket says 172.21.15.3:56872) 2023-10-08T16:06:47.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c3fff700 1 -- 172.21.15.3:0/3800000332 learned_addr learned my addr 172.21.15.3:0/3800000332 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:47.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c8d32700 1 --2- 172.21.15.3:0/3800000332 >> v2:172.21.15.27:3300/0 conn(0x7f29c4155e00 0x7f29c40c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:47.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c9533700 1 --2- 172.21.15.3:0/3800000332 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c40c64e0 0x7f29c40ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:47.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c37fe700 1 -- 172.21.15.3:0/3800000332 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020732340 0 0) 0x7f29c40c8b90 con 0x7f29c41561d0 2023-10-08T16:06:47.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c37fe700 1 -- 172.21.15.3:0/3800000332 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29ac003570 con 0x7f29c41561d0 2023-10-08T16:06:47.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c9533700 1 -- 172.21.15.3:0/3800000332 >> v2:172.21.15.27:3300/0 conn(0x7f29c4155e00 msgr2=0x7f29c40c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:47.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c9533700 1 --2- 172.21.15.3:0/3800000332 >> v2:172.21.15.27:3300/0 conn(0x7f29c4155e00 0x7f29c40c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c9533700 1 -- 172.21.15.3:0/3800000332 >> v1:172.21.15.3:6789/0 conn(0x7f29c41561d0 legacy=0x7f29c406ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:47.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c9533700 1 -- 172.21.15.3:0/3800000332 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c415a4c0 con 0x7f29c40c64e0 2023-10-08T16:06:47.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c9533700 1 --2- 172.21.15.3:0/3800000332 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c40c64e0 0x7f29c40ca180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009e60 tx=0x7f29bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e45e24de303b207 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:47.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c37fe700 1 -- 172.21.15.3:0/3800000332 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00e070 con 0x7f29c40c64e0 2023-10-08T16:06:47.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c37fe700 1 -- 172.21.15.3:0/3800000332 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00bab0 con 0x7f29c40c64e0 2023-10-08T16:06:47.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29c37fe700 1 -- 172.21.15.3:0/3800000332 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00be70 con 0x7f29c40c64e0 2023-10-08T16:06:47.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 -- 172.21.15.3:0/3800000332 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c40c64e0 msgr2=0x7f29c40ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 --2- 172.21.15.3:0/3800000332 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c40c64e0 0x7f29c40ca180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009e60 tx=0x7f29bc009780 comp rx=0 tx=0).stop 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 -- 172.21.15.3:0/3800000332 shutdown_connections 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 --2- 172.21.15.3:0/3800000332 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c40c64e0 0x7f29c40ca180 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 --2- 172.21.15.3:0/3800000332 >> v2:172.21.15.27:3300/0 conn(0x7f29c4155e00 0x7f29c40c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 -- 172.21.15.3:0/3800000332 >> 172.21.15.3:0/3800000332 conn(0x7f29c40c8de0 msgr2=0x7f29c40c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 -- 172.21.15.3:0/3800000332 shutdown_connections 2023-10-08T16:06:47.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.775+0000 7f29caf96700 1 -- 172.21.15.3:0/3800000332 wait complete. 2023-10-08T16:06:47.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 Processor -- start 2023-10-08T16:06:47.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 -- start start 2023-10-08T16:06:47.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 0x7f29c414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:47.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c4155e00 0x7f29c40af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:47.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c41561d0 0x7f29c40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c4bc0 con 0x7f29c40c64e0 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c414e4c0 con 0x7f29c4155e00 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4154d60 con 0x7f29c41561d0 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 0x7f29c414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 0x7f29c414df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36690/0 (socket says 172.21.15.3:36690) 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 -- 172.21.15.3:0/1538390894 learned_addr learned my addr 172.21.15.3:0/1538390894 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c3fff700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c4155e00 0x7f29c40af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c9533700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c41561d0 0x7f29c40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 -- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c41561d0 msgr2=0x7f29c40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c41561d0 0x7f29c40afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 -- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c4155e00 msgr2=0x7f29c40af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:47.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c4155e00 0x7f29c40af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 -- 172.21.15.3:0/1538390894 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009a20 con 0x7f29c40c64e0 2023-10-08T16:06:47.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c9533700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c41561d0 0x7f29c40afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:47.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c8d32700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 0x7f29c414df80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29b4010e90 tx=0x7f29b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:47.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400edf0 con 0x7f29c40c64e0 2023-10-08T16:06:47.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4011450 con 0x7f29c40c64e0 2023-10-08T16:06:47.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40c4570 con 0x7f29c40c64e0 2023-10-08T16:06:47.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40117f0 con 0x7f29c40c64e0 2023-10-08T16:06:47.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.779+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c4156600 con 0x7f29c40c64e0 2023-10-08T16:06:47.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.783+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c40c43d0 con 0x7f29c40c64e0 2023-10-08T16:06:47.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.783+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f29b4011b60 con 0x7f29c40c64e0 2023-10-08T16:06:47.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.783+0000 7f29c0ff9700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f29b0060550 0x7f29b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:47.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.783+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29b407ec90 con 0x7f29c40c64e0 2023-10-08T16:06:47.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.783+0000 7f29c3fff700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f29b0060550 0x7f29b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:47.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.783+0000 7f29c3fff700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f29b0060550 0x7f29b0062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f29c41554f0 tx=0x7f29b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:47.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.791+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f29c40c43d0 con 0x7f29c40c64e0 2023-10-08T16:06:47.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.951+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29c40c4d00 con 0x7f29b0060550 2023-10-08T16:06:47.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.967+0000 7f29c0ff9700 1 -- 172.21.15.3:0/1538390894 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264424 (secure 0 0 0) 0x7f29b800f620 con 0x7f29b0060550 2023-10-08T16:06:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:47.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f29b0060550 msgr2=0x7f29b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f29b0060550 0x7f29b0062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f29c41554f0 tx=0x7f29b8009040 comp rx=0 tx=0).stop 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 msgr2=0x7f29c414df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 0x7f29c414df80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29b4010e90 tx=0x7f29b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 shutdown_connections 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f29b0060550 0x7f29b0062a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f29c41561d0 0x7f29c40afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c4155e00 0x7f29c40af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 --2- 172.21.15.3:0/1538390894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29c40c64e0 0x7f29c414df80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.971+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 >> 172.21.15.3:0/1538390894 conn(0x7f29c40c8de0 msgr2=0x7f29c40c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.975+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 shutdown_connections 2023-10-08T16:06:47.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:47.975+0000 7f29caf96700 1 -- 172.21.15.3:0/1538390894 wait complete. 2023-10-08T16:06:47.978 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:47.990 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:06:47.821819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002699"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.280053+0000","last_change":"2023-10-08T16:06:40.276055+0000","last_active":"2023-10-08T16:06:40.280053+0000","last_peered":"2023-10-08T16:06:40.280053+0000","last_clean":"2023-10-08T16:06:40.280053+0000","last_became_active":"2023-10-08T16:06:40.275720+0000","last_became_peered":"2023-10-08T16:06:40.275720+0000","last_unstale":"2023-10-08T16:06:40.280053+0000","last_undegraded":"2023-10-08T16:06:40.280053+0000","last_fullsized":"2023-10-08T16:06:40.280053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271636+0000","last_change":"2023-10-08T16:06:40.270216+0000","last_active":"2023-10-08T16:06:40.271636+0000","last_peered":"2023-10-08T16:06:40.271636+0000","last_clean":"2023-10-08T16:06:40.271636+0000","last_became_active":"2023-10-08T16:06:40.269903+0000","last_became_peered":"2023-10-08T16:06:40.269903+0000","last_unstale":"2023-10-08T16:06:40.271636+0000","last_undegraded":"2023-10-08T16:06:40.271636+0000","last_fullsized":"2023-10-08T16:06:40.271636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269395+0000","last_change":"2023-10-08T16:06:40.258935+0000","last_active":"2023-10-08T16:06:40.269395+0000","last_peered":"2023-10-08T16:06:40.269395+0000","last_clean":"2023-10-08T16:06:40.269395+0000","last_became_active":"2023-10-08T16:06:40.256957+0000","last_became_peered":"2023-10-08T16:06:40.256957+0000","last_unstale":"2023-10-08T16:06:40.269395+0000","last_undegraded":"2023-10-08T16:06:40.269395+0000","last_fullsized":"2023-10-08T16:06:40.269395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282471+0000","last_change":"2023-10-08T16:06:40.275472+0000","last_active":"2023-10-08T16:06:40.282471+0000","last_peered":"2023-10-08T16:06:40.282471+0000","last_clean":"2023-10-08T16:06:40.282471+0000","last_became_active":"2023-10-08T16:06:40.275178+0000","last_became_peered":"2023-10-08T16:06:40.275178+0000","last_unstale":"2023-10-08T16:06:40.282471+0000","last_undegraded":"2023-10-08T16:06:40.282471+0000","last_fullsized":"2023-10-08T16:06:40.282471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276523+0000","last_change":"2023-10-08T16:06:40.270577+0000","last_active":"2023-10-08T16:06:40.276523+0000","last_peered":"2023-10-08T16:06:40.276523+0000","last_clean":"2023-10-08T16:06:40.276523+0000","last_became_active":"2023-10-08T16:06:40.270269+0000","last_became_peered":"2023-10-08T16:06:40.270269+0000","last_unstale":"2023-10-08T16:06:40.276523+0000","last_undegraded":"2023-10-08T16:06:40.276523+0000","last_fullsized":"2023-10-08T16:06:40.276523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279700+0000","last_change":"2023-10-08T16:06:40.272575+0000","last_active":"2023-10-08T16:06:40.279700+0000","last_peered":"2023-10-08T16:06:40.279700+0000","last_clean":"2023-10-08T16:06:40.279700+0000","last_became_active":"2023-10-08T16:06:40.272126+0000","last_became_peered":"2023-10-08T16:06:40.272126+0000","last_unstale":"2023-10-08T16:06:40.279700+0000","last_undegraded":"2023-10-08T16:06:40.279700+0000","last_fullsized":"2023-10-08T16:06:40.279700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279736+0000","last_change":"2023-10-08T16:06:40.277232+0000","last_active":"2023-10-08T16:06:40.279736+0000","last_peered":"2023-10-08T16:06:40.279736+0000","last_clean":"2023-10-08T16:06:40.279736+0000","last_became_active":"2023-10-08T16:06:40.276903+0000","last_became_peered":"2023-10-08T16:06:40.276903+0000","last_unstale":"2023-10-08T16:06:40.279736+0000","last_undegraded":"2023-10-08T16:06:40.279736+0000","last_fullsized":"2023-10-08T16:06:40.279736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281289+0000","last_change":"2023-10-08T16:06:40.279113+0000","last_active":"2023-10-08T16:06:40.281289+0000","last_peered":"2023-10-08T16:06:40.281289+0000","last_clean":"2023-10-08T16:06:40.281289+0000","last_became_active":"2023-10-08T16:06:40.278772+0000","last_became_peered":"2023-10-08T16:06:40.278772+0000","last_unstale":"2023-10-08T16:06:40.281289+0000","last_undegraded":"2023-10-08T16:06:40.281289+0000","last_fullsized":"2023-10-08T16:06:40.281289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.284590+0000","last_change":"2023-10-08T16:06:40.280182+0000","last_active":"2023-10-08T16:06:40.284590+0000","last_peered":"2023-10-08T16:06:40.284590+0000","last_clean":"2023-10-08T16:06:40.284590+0000","last_became_active":"2023-10-08T16:06:40.279850+0000","last_became_peered":"2023-10-08T16:06:40.279850+0000","last_unstale":"2023-10-08T16:06:40.284590+0000","last_undegraded":"2023-10-08T16:06:40.284590+0000","last_fullsized":"2023-10-08T16:06:40.284590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:54.574906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279582+0000","last_change":"2023-10-08T16:06:40.275718+0000","last_active":"2023-10-08T16:06:40.279582+0000","last_peered":"2023-10-08T16:06:40.279582+0000","last_clean":"2023-10-08T16:06:40.279582+0000","last_became_active":"2023-10-08T16:06:40.275419+0000","last_became_peered":"2023-10-08T16:06:40.275419+0000","last_unstale":"2023-10-08T16:06:40.279582+0000","last_undegraded":"2023-10-08T16:06:40.279582+0000","last_fullsized":"2023-10-08T16:06:40.279582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281916+0000","last_change":"2023-10-08T16:06:40.276225+0000","last_active":"2023-10-08T16:06:40.281916+0000","last_peered":"2023-10-08T16:06:40.281916+0000","last_clean":"2023-10-08T16:06:40.281916+0000","last_became_active":"2023-10-08T16:06:40.275876+0000","last_became_peered":"2023-10-08T16:06:40.275876+0000","last_unstale":"2023-10-08T16:06:40.281916+0000","last_undegraded":"2023-10-08T16:06:40.281916+0000","last_fullsized":"2023-10-08T16:06:40.281916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270998+0000","last_change":"2023-10-08T16:06:40.264918+0000","last_active":"2023-10-08T16:06:40.270998+0000","last_peered":"2023-10-08T16:06:40.270998+0000","last_clean":"2023-10-08T16:06:40.270998+0000","last_became_active":"2023-10-08T16:06:40.264124+0000","last_became_peered":"2023-10-08T16:06:40.264124+0000","last_unstale":"2023-10-08T16:06:40.270998+0000","last_undegraded":"2023-10-08T16:06:40.270998+0000","last_fullsized":"2023-10-08T16:06:40.270998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273343+0000","last_change":"2023-10-08T16:06:40.269867+0000","last_active":"2023-10-08T16:06:40.273343+0000","last_peered":"2023-10-08T16:06:40.273343+0000","last_clean":"2023-10-08T16:06:40.273343+0000","last_became_active":"2023-10-08T16:06:40.268208+0000","last_became_peered":"2023-10-08T16:06:40.268208+0000","last_unstale":"2023-10-08T16:06:40.273343+0000","last_undegraded":"2023-10-08T16:06:40.273343+0000","last_fullsized":"2023-10-08T16:06:40.273343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275554+0000","last_change":"2023-10-08T16:06:40.264028+0000","last_active":"2023-10-08T16:06:40.275554+0000","last_peered":"2023-10-08T16:06:40.275554+0000","last_clean":"2023-10-08T16:06:40.275554+0000","last_became_active":"2023-10-08T16:06:40.263715+0000","last_became_peered":"2023-10-08T16:06:40.263715+0000","last_unstale":"2023-10-08T16:06:40.275554+0000","last_undegraded":"2023-10-08T16:06:40.275554+0000","last_fullsized":"2023-10-08T16:06:40.275554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:55.266658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271470+0000","last_change":"2023-10-08T16:06:40.269258+0000","last_active":"2023-10-08T16:06:40.271470+0000","last_peered":"2023-10-08T16:06:40.271470+0000","last_clean":"2023-10-08T16:06:40.271470+0000","last_became_active":"2023-10-08T16:06:40.268883+0000","last_became_peered":"2023-10-08T16:06:40.268883+0000","last_unstale":"2023-10-08T16:06:40.271470+0000","last_undegraded":"2023-10-08T16:06:40.271470+0000","last_fullsized":"2023-10-08T16:06:40.271470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282671+0000","last_change":"2023-10-08T16:06:40.278397+0000","last_active":"2023-10-08T16:06:40.282671+0000","last_peered":"2023-10-08T16:06:40.282671+0000","last_clean":"2023-10-08T16:06:40.282671+0000","last_became_active":"2023-10-08T16:06:40.277981+0000","last_became_peered":"2023-10-08T16:06:40.277981+0000","last_unstale":"2023-10-08T16:06:40.282671+0000","last_undegraded":"2023-10-08T16:06:40.282671+0000","last_fullsized":"2023-10-08T16:06:40.282671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282436+0000","last_change":"2023-10-08T16:06:40.276109+0000","last_active":"2023-10-08T16:06:40.282436+0000","last_peered":"2023-10-08T16:06:40.282436+0000","last_clean":"2023-10-08T16:06:40.282436+0000","last_became_active":"2023-10-08T16:06:40.275481+0000","last_became_peered":"2023-10-08T16:06:40.275481+0000","last_unstale":"2023-10-08T16:06:40.282436+0000","last_undegraded":"2023-10-08T16:06:40.282436+0000","last_fullsized":"2023-10-08T16:06:40.282436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267040+0000","last_change":"2023-10-08T16:06:40.261754+0000","last_active":"2023-10-08T16:06:40.267040+0000","last_peered":"2023-10-08T16:06:40.267040+0000","last_clean":"2023-10-08T16:06:40.267040+0000","last_became_active":"2023-10-08T16:06:40.261437+0000","last_became_peered":"2023-10-08T16:06:40.261437+0000","last_unstale":"2023-10-08T16:06:40.267040+0000","last_undegraded":"2023-10-08T16:06:40.267040+0000","last_fullsized":"2023-10-08T16:06:40.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277114+0000","last_change":"2023-10-08T16:06:40.271380+0000","last_active":"2023-10-08T16:06:40.277114+0000","last_peered":"2023-10-08T16:06:40.277114+0000","last_clean":"2023-10-08T16:06:40.277114+0000","last_became_active":"2023-10-08T16:06:40.271014+0000","last_became_peered":"2023-10-08T16:06:40.271014+0000","last_unstale":"2023-10-08T16:06:40.277114+0000","last_undegraded":"2023-10-08T16:06:40.277114+0000","last_fullsized":"2023-10-08T16:06:40.277114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275113+0000","last_change":"2023-10-08T16:06:40.264967+0000","last_active":"2023-10-08T16:06:40.275113+0000","last_peered":"2023-10-08T16:06:40.275113+0000","last_clean":"2023-10-08T16:06:40.275113+0000","last_became_active":"2023-10-08T16:06:40.264522+0000","last_became_peered":"2023-10-08T16:06:40.264522+0000","last_unstale":"2023-10-08T16:06:40.275113+0000","last_undegraded":"2023-10-08T16:06:40.275113+0000","last_fullsized":"2023-10-08T16:06:40.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275758+0000","last_change":"2023-10-08T16:06:40.266852+0000","last_active":"2023-10-08T16:06:40.275758+0000","last_peered":"2023-10-08T16:06:40.275758+0000","last_clean":"2023-10-08T16:06:40.275758+0000","last_became_active":"2023-10-08T16:06:40.266394+0000","last_became_peered":"2023-10-08T16:06:40.266394+0000","last_unstale":"2023-10-08T16:06:40.275758+0000","last_undegraded":"2023-10-08T16:06:40.275758+0000","last_fullsized":"2023-10-08T16:06:40.275758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279658+0000","last_change":"2023-10-08T16:06:40.272299+0000","last_active":"2023-10-08T16:06:40.279658+0000","last_peered":"2023-10-08T16:06:40.279658+0000","last_clean":"2023-10-08T16:06:40.279658+0000","last_became_active":"2023-10-08T16:06:40.271714+0000","last_became_peered":"2023-10-08T16:06:40.271714+0000","last_unstale":"2023-10-08T16:06:40.279658+0000","last_undegraded":"2023-10-08T16:06:40.279658+0000","last_fullsized":"2023-10-08T16:06:40.279658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268225+0000","last_change":"2023-10-08T16:06:40.266098+0000","last_active":"2023-10-08T16:06:40.268225+0000","last_peered":"2023-10-08T16:06:40.268225+0000","last_clean":"2023-10-08T16:06:40.268225+0000","last_became_active":"2023-10-08T16:06:40.265779+0000","last_became_peered":"2023-10-08T16:06:40.265779+0000","last_unstale":"2023-10-08T16:06:40.268225+0000","last_undegraded":"2023-10-08T16:06:40.268225+0000","last_fullsized":"2023-10-08T16:06:40.268225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279321+0000","last_change":"2023-10-08T16:06:40.269099+0000","last_active":"2023-10-08T16:06:40.279321+0000","last_peered":"2023-10-08T16:06:40.279321+0000","last_clean":"2023-10-08T16:06:40.279321+0000","last_became_active":"2023-10-08T16:06:40.268796+0000","last_became_peered":"2023-10-08T16:06:40.268796+0000","last_unstale":"2023-10-08T16:06:40.279321+0000","last_undegraded":"2023-10-08T16:06:40.279321+0000","last_fullsized":"2023-10-08T16:06:40.279321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268296+0000","last_change":"2023-10-08T16:06:40.264696+0000","last_active":"2023-10-08T16:06:40.268296+0000","last_peered":"2023-10-08T16:06:40.268296+0000","last_clean":"2023-10-08T16:06:40.268296+0000","last_became_active":"2023-10-08T16:06:40.264322+0000","last_became_peered":"2023-10-08T16:06:40.264322+0000","last_unstale":"2023-10-08T16:06:40.268296+0000","last_undegraded":"2023-10-08T16:06:40.268296+0000","last_fullsized":"2023-10-08T16:06:40.268296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275189+0000","last_change":"2023-10-08T16:06:40.266542+0000","last_active":"2023-10-08T16:06:40.275189+0000","last_peered":"2023-10-08T16:06:40.275189+0000","last_clean":"2023-10-08T16:06:40.275189+0000","last_became_active":"2023-10-08T16:06:40.266258+0000","last_became_peered":"2023-10-08T16:06:40.266258+0000","last_unstale":"2023-10-08T16:06:40.275189+0000","last_undegraded":"2023-10-08T16:06:40.275189+0000","last_fullsized":"2023-10-08T16:06:40.275189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270627+0000","last_change":"2023-10-08T16:06:40.268954+0000","last_active":"2023-10-08T16:06:40.270627+0000","last_peered":"2023-10-08T16:06:40.270627+0000","last_clean":"2023-10-08T16:06:40.270627+0000","last_became_active":"2023-10-08T16:06:40.268456+0000","last_became_peered":"2023-10-08T16:06:40.268456+0000","last_unstale":"2023-10-08T16:06:40.270627+0000","last_undegraded":"2023-10-08T16:06:40.270627+0000","last_fullsized":"2023-10-08T16:06:40.270627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273146+0000","last_change":"2023-10-08T16:06:40.268821+0000","last_active":"2023-10-08T16:06:40.273146+0000","last_peered":"2023-10-08T16:06:40.273146+0000","last_clean":"2023-10-08T16:06:40.273146+0000","last_became_active":"2023-10-08T16:06:40.268485+0000","last_became_peered":"2023-10-08T16:06:40.268485+0000","last_unstale":"2023-10-08T16:06:40.273146+0000","last_undegraded":"2023-10-08T16:06:40.273146+0000","last_fullsized":"2023-10-08T16:06:40.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275805+0000","last_change":"2023-10-08T16:06:40.267487+0000","last_active":"2023-10-08T16:06:40.275805+0000","last_peered":"2023-10-08T16:06:40.275805+0000","last_clean":"2023-10-08T16:06:40.275805+0000","last_became_active":"2023-10-08T16:06:40.267198+0000","last_became_peered":"2023-10-08T16:06:40.267198+0000","last_unstale":"2023-10-08T16:06:40.275805+0000","last_undegraded":"2023-10-08T16:06:40.275805+0000","last_fullsized":"2023-10-08T16:06:40.275805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279681+0000","last_change":"2023-10-08T16:06:40.272431+0000","last_active":"2023-10-08T16:06:40.279681+0000","last_peered":"2023-10-08T16:06:40.279681+0000","last_clean":"2023-10-08T16:06:40.279681+0000","last_became_active":"2023-10-08T16:06:40.271999+0000","last_became_peered":"2023-10-08T16:06:40.271999+0000","last_unstale":"2023-10-08T16:06:40.279681+0000","last_undegraded":"2023-10-08T16:06:40.279681+0000","last_fullsized":"2023-10-08T16:06:40.279681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278116+0000","last_change":"2023-10-08T16:06:40.273286+0000","last_active":"2023-10-08T16:06:40.278116+0000","last_peered":"2023-10-08T16:06:40.278116+0000","last_clean":"2023-10-08T16:06:40.278116+0000","last_became_active":"2023-10-08T16:06:40.272933+0000","last_became_peered":"2023-10-08T16:06:40.272933+0000","last_unstale":"2023-10-08T16:06:40.278116+0000","last_undegraded":"2023-10-08T16:06:40.278116+0000","last_fullsized":"2023-10-08T16:06:40.278116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275156+0000","last_change":"2023-10-08T16:06:40.265329+0000","last_active":"2023-10-08T16:06:40.275156+0000","last_peered":"2023-10-08T16:06:40.275156+0000","last_clean":"2023-10-08T16:06:40.275156+0000","last_became_active":"2023-10-08T16:06:40.264972+0000","last_became_peered":"2023-10-08T16:06:40.264972+0000","last_unstale":"2023-10-08T16:06:40.275156+0000","last_undegraded":"2023-10-08T16:06:40.275156+0000","last_fullsized":"2023-10-08T16:06:40.275156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268526+0000","last_change":"2023-10-08T16:06:40.263993+0000","last_active":"2023-10-08T16:06:40.268526+0000","last_peered":"2023-10-08T16:06:40.268526+0000","last_clean":"2023-10-08T16:06:40.268526+0000","last_became_active":"2023-10-08T16:06:40.263538+0000","last_became_peered":"2023-10-08T16:06:40.263538+0000","last_unstale":"2023-10-08T16:06:40.268526+0000","last_undegraded":"2023-10-08T16:06:40.268526+0000","last_fullsized":"2023-10-08T16:06:40.268526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:29.217008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301721+0000","last_change":"2023-10-08T16:06:39.297623+0000","last_active":"2023-10-08T16:06:40.301721+0000","last_peered":"2023-10-08T16:06:40.301721+0000","last_clean":"2023-10-08T16:06:40.301721+0000","last_became_active":"2023-10-08T16:06:39.292440+0000","last_became_peered":"2023-10-08T16:06:39.292440+0000","last_unstale":"2023-10-08T16:06:40.301721+0000","last_undegraded":"2023-10-08T16:06:40.301721+0000","last_fullsized":"2023-10-08T16:06:40.301721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269305+0000","last_change":"2023-10-08T16:06:40.258340+0000","last_active":"2023-10-08T16:06:40.269305+0000","last_peered":"2023-10-08T16:06:40.269305+0000","last_clean":"2023-10-08T16:06:40.269305+0000","last_became_active":"2023-10-08T16:06:40.257980+0000","last_became_peered":"2023-10-08T16:06:40.257980+0000","last_unstale":"2023-10-08T16:06:40.269305+0000","last_undegraded":"2023-10-08T16:06:40.269305+0000","last_fullsized":"2023-10-08T16:06:40.269305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301568+0000","last_change":"2023-10-08T16:06:39.291777+0000","last_active":"2023-10-08T16:06:40.301568+0000","last_peered":"2023-10-08T16:06:40.301568+0000","last_clean":"2023-10-08T16:06:40.301568+0000","last_became_active":"2023-10-08T16:06:39.290855+0000","last_became_peered":"2023-10-08T16:06:39.290855+0000","last_unstale":"2023-10-08T16:06:40.301568+0000","last_undegraded":"2023-10-08T16:06:40.301568+0000","last_fullsized":"2023-10-08T16:06:40.301568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.255042+0000","last_change":"2023-10-08T16:06:39.301682+0000","last_active":"2023-10-08T16:06:40.255042+0000","last_peered":"2023-10-08T16:06:40.255042+0000","last_clean":"2023-10-08T16:06:40.255042+0000","last_became_active":"2023-10-08T16:06:39.300996+0000","last_became_peered":"2023-10-08T16:06:39.300996+0000","last_unstale":"2023-10-08T16:06:40.255042+0000","last_undegraded":"2023-10-08T16:06:40.255042+0000","last_fullsized":"2023-10-08T16:06:40.255042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270724+0000","last_change":"2023-10-08T16:06:40.266918+0000","last_active":"2023-10-08T16:06:40.270724+0000","last_peered":"2023-10-08T16:06:40.270724+0000","last_clean":"2023-10-08T16:06:40.270724+0000","last_became_active":"2023-10-08T16:06:40.266574+0000","last_became_peered":"2023-10-08T16:06:40.266574+0000","last_unstale":"2023-10-08T16:06:40.270724+0000","last_undegraded":"2023-10-08T16:06:40.270724+0000","last_fullsized":"2023-10-08T16:06:40.270724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269496+0000","last_change":"2023-10-08T16:06:39.294887+0000","last_active":"2023-10-08T16:06:40.269496+0000","last_peered":"2023-10-08T16:06:40.269496+0000","last_clean":"2023-10-08T16:06:40.269496+0000","last_became_active":"2023-10-08T16:06:39.294362+0000","last_became_peered":"2023-10-08T16:06:39.294362+0000","last_unstale":"2023-10-08T16:06:40.269496+0000","last_undegraded":"2023-10-08T16:06:40.269496+0000","last_fullsized":"2023-10-08T16:06:40.269496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270647+0000","last_change":"2023-10-08T16:06:40.269161+0000","last_active":"2023-10-08T16:06:40.270647+0000","last_peered":"2023-10-08T16:06:40.270647+0000","last_clean":"2023-10-08T16:06:40.270647+0000","last_became_active":"2023-10-08T16:06:40.268258+0000","last_became_peered":"2023-10-08T16:06:40.268258+0000","last_unstale":"2023-10-08T16:06:40.270647+0000","last_undegraded":"2023-10-08T16:06:40.270647+0000","last_fullsized":"2023-10-08T16:06:40.270647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253455+0000","last_change":"2023-10-08T16:06:39.298780+0000","last_active":"2023-10-08T16:06:40.253455+0000","last_peered":"2023-10-08T16:06:40.253455+0000","last_clean":"2023-10-08T16:06:40.253455+0000","last_became_active":"2023-10-08T16:06:39.298461+0000","last_became_peered":"2023-10-08T16:06:39.298461+0000","last_unstale":"2023-10-08T16:06:40.253455+0000","last_undegraded":"2023-10-08T16:06:40.253455+0000","last_fullsized":"2023-10-08T16:06:40.253455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282263+0000","last_change":"2023-10-08T16:06:40.275019+0000","last_active":"2023-10-08T16:06:40.282263+0000","last_peered":"2023-10-08T16:06:40.282263+0000","last_clean":"2023-10-08T16:06:40.282263+0000","last_became_active":"2023-10-08T16:06:40.269866+0000","last_became_peered":"2023-10-08T16:06:40.269866+0000","last_unstale":"2023-10-08T16:06:40.282263+0000","last_undegraded":"2023-10-08T16:06:40.282263+0000","last_fullsized":"2023-10-08T16:06:40.282263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.274887+0000","last_change":"2023-10-08T16:06:39.302453+0000","last_active":"2023-10-08T16:06:40.274887+0000","last_peered":"2023-10-08T16:06:40.274887+0000","last_clean":"2023-10-08T16:06:40.274887+0000","last_became_active":"2023-10-08T16:06:39.302108+0000","last_became_peered":"2023-10-08T16:06:39.302108+0000","last_unstale":"2023-10-08T16:06:40.274887+0000","last_undegraded":"2023-10-08T16:06:40.274887+0000","last_fullsized":"2023-10-08T16:06:40.274887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278252+0000","last_change":"2023-10-08T16:06:40.273266+0000","last_active":"2023-10-08T16:06:40.278252+0000","last_peered":"2023-10-08T16:06:40.278252+0000","last_clean":"2023-10-08T16:06:40.278252+0000","last_became_active":"2023-10-08T16:06:40.272860+0000","last_became_peered":"2023-10-08T16:06:40.272860+0000","last_unstale":"2023-10-08T16:06:40.278252+0000","last_undegraded":"2023-10-08T16:06:40.278252+0000","last_fullsized":"2023-10-08T16:06:40.278252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300737+0000","last_change":"2023-10-08T16:06:39.293871+0000","last_active":"2023-10-08T16:06:40.300737+0000","last_peered":"2023-10-08T16:06:40.300737+0000","last_clean":"2023-10-08T16:06:40.300737+0000","last_became_active":"2023-10-08T16:06:39.293517+0000","last_became_peered":"2023-10-08T16:06:39.293517+0000","last_unstale":"2023-10-08T16:06:40.300737+0000","last_undegraded":"2023-10-08T16:06:40.300737+0000","last_fullsized":"2023-10-08T16:06:40.300737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271405+0000","last_change":"2023-10-08T16:06:40.266413+0000","last_active":"2023-10-08T16:06:40.271405+0000","last_peered":"2023-10-08T16:06:40.271405+0000","last_clean":"2023-10-08T16:06:40.271405+0000","last_became_active":"2023-10-08T16:06:40.266098+0000","last_became_peered":"2023-10-08T16:06:40.266098+0000","last_unstale":"2023-10-08T16:06:40.271405+0000","last_undegraded":"2023-10-08T16:06:40.271405+0000","last_fullsized":"2023-10-08T16:06:40.271405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:25.752461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.307815+0000","last_change":"2023-10-08T16:06:39.296406+0000","last_active":"2023-10-08T16:06:40.307815+0000","last_peered":"2023-10-08T16:06:40.307815+0000","last_clean":"2023-10-08T16:06:40.307815+0000","last_became_active":"2023-10-08T16:06:39.296075+0000","last_became_peered":"2023-10-08T16:06:39.296075+0000","last_unstale":"2023-10-08T16:06:40.307815+0000","last_undegraded":"2023-10-08T16:06:40.307815+0000","last_fullsized":"2023-10-08T16:06:40.307815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275787+0000","last_change":"2023-10-08T16:06:40.270048+0000","last_active":"2023-10-08T16:06:40.275787+0000","last_peered":"2023-10-08T16:06:40.275787+0000","last_clean":"2023-10-08T16:06:40.275787+0000","last_became_active":"2023-10-08T16:06:40.269726+0000","last_became_peered":"2023-10-08T16:06:40.269726+0000","last_unstale":"2023-10-08T16:06:40.275787+0000","last_undegraded":"2023-10-08T16:06:40.275787+0000","last_fullsized":"2023-10-08T16:06:40.275787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301282+0000","last_change":"2023-10-08T16:06:39.294192+0000","last_active":"2023-10-08T16:06:40.301282+0000","last_peered":"2023-10-08T16:06:40.301282+0000","last_clean":"2023-10-08T16:06:40.301282+0000","last_became_active":"2023-10-08T16:06:39.293881+0000","last_became_peered":"2023-10-08T16:06:39.293881+0000","last_unstale":"2023-10-08T16:06:40.301282+0000","last_undegraded":"2023-10-08T16:06:40.301282+0000","last_fullsized":"2023-10-08T16:06:40.301282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:43.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275717+0000","last_change":"2023-10-08T16:06:40.266213+0000","last_active":"2023-10-08T16:06:40.275717+0000","last_peered":"2023-10-08T16:06:40.275717+0000","last_clean":"2023-10-08T16:06:40.275717+0000","last_became_active":"2023-10-08T16:06:40.265860+0000","last_became_peered":"2023-10-08T16:06:40.265860+0000","last_unstale":"2023-10-08T16:06:40.275717+0000","last_undegraded":"2023-10-08T16:06:40.275717+0000","last_fullsized":"2023-10-08T16:06:40.275717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269558+0000","last_change":"2023-10-08T16:06:39.300216+0000","last_active":"2023-10-08T16:06:40.269558+0000","last_peered":"2023-10-08T16:06:40.269558+0000","last_clean":"2023-10-08T16:06:40.269558+0000","last_became_active":"2023-10-08T16:06:39.299914+0000","last_became_peered":"2023-10-08T16:06:39.299914+0000","last_unstale":"2023-10-08T16:06:40.269558+0000","last_undegraded":"2023-10-08T16:06:40.269558+0000","last_fullsized":"2023-10-08T16:06:40.269558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277069+0000","last_change":"2023-10-08T16:06:40.272059+0000","last_active":"2023-10-08T16:06:40.277069+0000","last_peered":"2023-10-08T16:06:40.277069+0000","last_clean":"2023-10-08T16:06:40.277069+0000","last_became_active":"2023-10-08T16:06:40.271730+0000","last_became_peered":"2023-10-08T16:06:40.271730+0000","last_unstale":"2023-10-08T16:06:40.277069+0000","last_undegraded":"2023-10-08T16:06:40.277069+0000","last_fullsized":"2023-10-08T16:06:40.277069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.251622+0000","last_change":"2023-10-08T16:06:39.291194+0000","last_active":"2023-10-08T16:06:40.251622+0000","last_peered":"2023-10-08T16:06:40.251622+0000","last_clean":"2023-10-08T16:06:40.251622+0000","last_became_active":"2023-10-08T16:06:39.290849+0000","last_became_peered":"2023-10-08T16:06:39.290849+0000","last_unstale":"2023-10-08T16:06:40.251622+0000","last_undegraded":"2023-10-08T16:06:40.251622+0000","last_fullsized":"2023-10-08T16:06:40.251622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267696+0000","last_change":"2023-10-08T16:06:40.259709+0000","last_active":"2023-10-08T16:06:40.267696+0000","last_peered":"2023-10-08T16:06:40.267696+0000","last_clean":"2023-10-08T16:06:40.267696+0000","last_became_active":"2023-10-08T16:06:40.259122+0000","last_became_peered":"2023-10-08T16:06:40.259122+0000","last_unstale":"2023-10-08T16:06:40.267696+0000","last_undegraded":"2023-10-08T16:06:40.267696+0000","last_fullsized":"2023-10-08T16:06:40.267696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.306618+0000","last_change":"2023-10-08T16:06:39.291829+0000","last_active":"2023-10-08T16:06:40.306618+0000","last_peered":"2023-10-08T16:06:40.306618+0000","last_clean":"2023-10-08T16:06:40.306618+0000","last_became_active":"2023-10-08T16:06:39.291331+0000","last_became_peered":"2023-10-08T16:06:39.291331+0000","last_unstale":"2023-10-08T16:06:40.306618+0000","last_undegraded":"2023-10-08T16:06:40.306618+0000","last_fullsized":"2023-10-08T16:06:40.306618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277354+0000","last_change":"2023-10-08T16:06:40.270693+0000","last_active":"2023-10-08T16:06:40.277354+0000","last_peered":"2023-10-08T16:06:40.277354+0000","last_clean":"2023-10-08T16:06:40.277354+0000","last_became_active":"2023-10-08T16:06:40.269238+0000","last_became_peered":"2023-10-08T16:06:40.269238+0000","last_unstale":"2023-10-08T16:06:40.277354+0000","last_undegraded":"2023-10-08T16:06:40.277354+0000","last_fullsized":"2023-10-08T16:06:40.277354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.302954+0000","last_change":"2023-10-08T16:06:39.294859+0000","last_active":"2023-10-08T16:06:40.302954+0000","last_peered":"2023-10-08T16:06:40.302954+0000","last_clean":"2023-10-08T16:06:40.302954+0000","last_became_active":"2023-10-08T16:06:39.294549+0000","last_became_peered":"2023-10-08T16:06:39.294549+0000","last_unstale":"2023-10-08T16:06:40.302954+0000","last_undegraded":"2023-10-08T16:06:40.302954+0000","last_fullsized":"2023-10-08T16:06:40.302954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:30.419636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276379+0000","last_change":"2023-10-08T16:06:40.270175+0000","last_active":"2023-10-08T16:06:40.276379+0000","last_peered":"2023-10-08T16:06:40.276379+0000","last_clean":"2023-10-08T16:06:40.276379+0000","last_became_active":"2023-10-08T16:06:40.269029+0000","last_became_peered":"2023-10-08T16:06:40.269029+0000","last_unstale":"2023-10-08T16:06:40.276379+0000","last_undegraded":"2023-10-08T16:06:40.276379+0000","last_fullsized":"2023-10-08T16:06:40.276379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301969+0000","last_change":"2023-10-08T16:06:39.299037+0000","last_active":"2023-10-08T16:06:40.301969+0000","last_peered":"2023-10-08T16:06:40.301969+0000","last_clean":"2023-10-08T16:06:40.301969+0000","last_became_active":"2023-10-08T16:06:39.298664+0000","last_became_peered":"2023-10-08T16:06:39.298664+0000","last_unstale":"2023-10-08T16:06:40.301969+0000","last_undegraded":"2023-10-08T16:06:40.301969+0000","last_fullsized":"2023-10-08T16:06:40.301969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277144+0000","last_change":"2023-10-08T16:06:40.272886+0000","last_active":"2023-10-08T16:06:40.277144+0000","last_peered":"2023-10-08T16:06:40.277144+0000","last_clean":"2023-10-08T16:06:40.277144+0000","last_became_active":"2023-10-08T16:06:40.272556+0000","last_became_peered":"2023-10-08T16:06:40.272556+0000","last_unstale":"2023-10-08T16:06:40.277144+0000","last_undegraded":"2023-10-08T16:06:40.277144+0000","last_fullsized":"2023-10-08T16:06:40.277144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300889+0000","last_change":"2023-10-08T16:06:39.293894+0000","last_active":"2023-10-08T16:06:40.300889+0000","last_peered":"2023-10-08T16:06:40.300889+0000","last_clean":"2023-10-08T16:06:40.300889+0000","last_became_active":"2023-10-08T16:06:39.293562+0000","last_became_peered":"2023-10-08T16:06:39.293562+0000","last_unstale":"2023-10-08T16:06:40.300889+0000","last_undegraded":"2023-10-08T16:06:40.300889+0000","last_fullsized":"2023-10-08T16:06:40.300889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282094+0000","last_change":"2023-10-08T16:06:40.273176+0000","last_active":"2023-10-08T16:06:40.282094+0000","last_peered":"2023-10-08T16:06:40.282094+0000","last_clean":"2023-10-08T16:06:40.282094+0000","last_became_active":"2023-10-08T16:06:40.272791+0000","last_became_peered":"2023-10-08T16:06:40.272791+0000","last_unstale":"2023-10-08T16:06:40.282094+0000","last_undegraded":"2023-10-08T16:06:40.282094+0000","last_fullsized":"2023-10-08T16:06:40.282094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.254116+0000","last_change":"2023-10-08T16:06:39.293390+0000","last_active":"2023-10-08T16:06:40.254116+0000","last_peered":"2023-10-08T16:06:40.254116+0000","last_clean":"2023-10-08T16:06:40.254116+0000","last_became_active":"2023-10-08T16:06:39.293063+0000","last_became_peered":"2023-10-08T16:06:39.293063+0000","last_unstale":"2023-10-08T16:06:40.254116+0000","last_undegraded":"2023-10-08T16:06:40.254116+0000","last_fullsized":"2023-10-08T16:06:40.254116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279769+0000","last_change":"2023-10-08T16:06:40.276714+0000","last_active":"2023-10-08T16:06:40.279769+0000","last_peered":"2023-10-08T16:06:40.279769+0000","last_clean":"2023-10-08T16:06:40.279769+0000","last_became_active":"2023-10-08T16:06:40.276322+0000","last_became_peered":"2023-10-08T16:06:40.276322+0000","last_unstale":"2023-10-08T16:06:40.279769+0000","last_undegraded":"2023-10-08T16:06:40.279769+0000","last_fullsized":"2023-10-08T16:06:40.279769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:28.338803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259410+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:40.259410+0000","last_peered":"2023-10-08T16:06:40.259410+0000","last_clean":"2023-10-08T16:06:40.259410+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:40.259410+0000","last_undegraded":"2023-10-08T16:06:40.259410+0000","last_fullsized":"2023-10-08T16:06:40.259410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269492+0000","last_change":"2023-10-08T16:06:39.293223+0000","last_active":"2023-10-08T16:06:40.269492+0000","last_peered":"2023-10-08T16:06:40.269492+0000","last_clean":"2023-10-08T16:06:40.269492+0000","last_became_active":"2023-10-08T16:06:39.292861+0000","last_became_peered":"2023-10-08T16:06:39.292861+0000","last_unstale":"2023-10-08T16:06:40.269492+0000","last_undegraded":"2023-10-08T16:06:40.269492+0000","last_fullsized":"2023-10-08T16:06:40.269492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281318+0000","last_change":"2023-10-08T16:06:40.279550+0000","last_active":"2023-10-08T16:06:40.281318+0000","last_peered":"2023-10-08T16:06:40.281318+0000","last_clean":"2023-10-08T16:06:40.281318+0000","last_became_active":"2023-10-08T16:06:40.279258+0000","last_became_peered":"2023-10-08T16:06:40.279258+0000","last_unstale":"2023-10-08T16:06:40.281318+0000","last_undegraded":"2023-10-08T16:06:40.281318+0000","last_fullsized":"2023-10-08T16:06:40.281318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259307+0000","last_change":"2023-10-08T16:06:39.303341+0000","last_active":"2023-10-08T16:06:40.259307+0000","last_peered":"2023-10-08T16:06:40.259307+0000","last_clean":"2023-10-08T16:06:40.259307+0000","last_became_active":"2023-10-08T16:06:39.303000+0000","last_became_peered":"2023-10-08T16:06:39.303000+0000","last_unstale":"2023-10-08T16:06:40.259307+0000","last_undegraded":"2023-10-08T16:06:40.259307+0000","last_fullsized":"2023-10-08T16:06:40.259307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:46.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269369+0000","last_change":"2023-10-08T16:06:40.259545+0000","last_active":"2023-10-08T16:06:40.269369+0000","last_peered":"2023-10-08T16:06:40.269369+0000","last_clean":"2023-10-08T16:06:40.269369+0000","last_became_active":"2023-10-08T16:06:40.259191+0000","last_became_peered":"2023-10-08T16:06:40.259191+0000","last_unstale":"2023-10-08T16:06:40.269369+0000","last_undegraded":"2023-10-08T16:06:40.269369+0000","last_fullsized":"2023-10-08T16:06:40.269369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253367+0000","last_change":"2023-10-08T16:06:39.299839+0000","last_active":"2023-10-08T16:06:40.253367+0000","last_peered":"2023-10-08T16:06:40.253367+0000","last_clean":"2023-10-08T16:06:40.253367+0000","last_became_active":"2023-10-08T16:06:39.299351+0000","last_became_peered":"2023-10-08T16:06:39.299351+0000","last_unstale":"2023-10-08T16:06:40.253367+0000","last_undegraded":"2023-10-08T16:06:40.253367+0000","last_fullsized":"2023-10-08T16:06:40.253367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269108+0000","last_change":"2023-10-08T16:06:40.263602+0000","last_active":"2023-10-08T16:06:40.269108+0000","last_peered":"2023-10-08T16:06:40.269108+0000","last_clean":"2023-10-08T16:06:40.269108+0000","last_became_active":"2023-10-08T16:06:40.263275+0000","last_became_peered":"2023-10-08T16:06:40.263275+0000","last_unstale":"2023-10-08T16:06:40.269108+0000","last_undegraded":"2023-10-08T16:06:40.269108+0000","last_fullsized":"2023-10-08T16:06:40.269108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269681+0000","last_change":"2023-10-08T16:06:39.298167+0000","last_active":"2023-10-08T16:06:40.269681+0000","last_peered":"2023-10-08T16:06:40.269681+0000","last_clean":"2023-10-08T16:06:40.269681+0000","last_became_active":"2023-10-08T16:06:39.297678+0000","last_became_peered":"2023-10-08T16:06:39.297678+0000","last_unstale":"2023-10-08T16:06:40.269681+0000","last_undegraded":"2023-10-08T16:06:40.269681+0000","last_fullsized":"2023-10-08T16:06:40.269681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276831+0000","last_change":"2023-10-08T16:06:40.271343+0000","last_active":"2023-10-08T16:06:40.276831+0000","last_peered":"2023-10-08T16:06:40.276831+0000","last_clean":"2023-10-08T16:06:40.276831+0000","last_became_active":"2023-10-08T16:06:40.270882+0000","last_became_peered":"2023-10-08T16:06:40.270882+0000","last_unstale":"2023-10-08T16:06:40.276831+0000","last_undegraded":"2023-10-08T16:06:40.276831+0000","last_fullsized":"2023-10-08T16:06:40.276831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258762+0000","last_change":"2023-10-08T16:06:39.293588+0000","last_active":"2023-10-08T16:06:40.258762+0000","last_peered":"2023-10-08T16:06:40.258762+0000","last_clean":"2023-10-08T16:06:40.258762+0000","last_became_active":"2023-10-08T16:06:39.293209+0000","last_became_peered":"2023-10-08T16:06:39.293209+0000","last_unstale":"2023-10-08T16:06:40.258762+0000","last_undegraded":"2023-10-08T16:06:40.258762+0000","last_fullsized":"2023-10-08T16:06:40.258762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282337+0000","last_change":"2023-10-08T16:06:40.275327+0000","last_active":"2023-10-08T16:06:40.282337+0000","last_peered":"2023-10-08T16:06:40.282337+0000","last_clean":"2023-10-08T16:06:40.282337+0000","last_became_active":"2023-10-08T16:06:40.274778+0000","last_became_peered":"2023-10-08T16:06:40.274778+0000","last_unstale":"2023-10-08T16:06:40.282337+0000","last_undegraded":"2023-10-08T16:06:40.282337+0000","last_fullsized":"2023-10-08T16:06:40.282337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:24.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.262394+0000","last_change":"2023-10-08T16:06:39.303540+0000","last_active":"2023-10-08T16:06:40.262394+0000","last_peered":"2023-10-08T16:06:40.262394+0000","last_clean":"2023-10-08T16:06:40.262394+0000","last_became_active":"2023-10-08T16:06:39.303264+0000","last_became_peered":"2023-10-08T16:06:39.303264+0000","last_unstale":"2023-10-08T16:06:40.262394+0000","last_undegraded":"2023-10-08T16:06:40.262394+0000","last_fullsized":"2023-10-08T16:06:40.262394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269828+0000","last_change":"2023-10-08T16:06:40.263957+0000","last_active":"2023-10-08T16:06:40.269828+0000","last_peered":"2023-10-08T16:06:40.269828+0000","last_clean":"2023-10-08T16:06:40.269828+0000","last_became_active":"2023-10-08T16:06:40.263566+0000","last_became_peered":"2023-10-08T16:06:40.263566+0000","last_unstale":"2023-10-08T16:06:40.269828+0000","last_undegraded":"2023-10-08T16:06:40.269828+0000","last_fullsized":"2023-10-08T16:06:40.269828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260207+0000","last_change":"2023-10-08T16:06:39.301605+0000","last_active":"2023-10-08T16:06:40.260207+0000","last_peered":"2023-10-08T16:06:40.260207+0000","last_clean":"2023-10-08T16:06:40.260207+0000","last_became_active":"2023-10-08T16:06:39.301289+0000","last_became_peered":"2023-10-08T16:06:39.301289+0000","last_unstale":"2023-10-08T16:06:40.260207+0000","last_undegraded":"2023-10-08T16:06:40.260207+0000","last_fullsized":"2023-10-08T16:06:40.260207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273159+0000","last_change":"2023-10-08T16:06:40.268834+0000","last_active":"2023-10-08T16:06:40.273159+0000","last_peered":"2023-10-08T16:06:40.273159+0000","last_clean":"2023-10-08T16:06:40.273159+0000","last_became_active":"2023-10-08T16:06:40.268449+0000","last_became_peered":"2023-10-08T16:06:40.268449+0000","last_unstale":"2023-10-08T16:06:40.273159+0000","last_undegraded":"2023-10-08T16:06:40.273159+0000","last_fullsized":"2023-10-08T16:06:40.273159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300880+0000","last_change":"2023-10-08T16:06:39.300940+0000","last_active":"2023-10-08T16:06:40.300880+0000","last_peered":"2023-10-08T16:06:40.300880+0000","last_clean":"2023-10-08T16:06:40.300880+0000","last_became_active":"2023-10-08T16:06:39.300556+0000","last_became_peered":"2023-10-08T16:06:39.300556+0000","last_unstale":"2023-10-08T16:06:40.300880+0000","last_undegraded":"2023-10-08T16:06:40.300880+0000","last_fullsized":"2023-10-08T16:06:40.300880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275841+0000","last_change":"2023-10-08T16:06:40.267528+0000","last_active":"2023-10-08T16:06:40.275841+0000","last_peered":"2023-10-08T16:06:40.275841+0000","last_clean":"2023-10-08T16:06:40.275841+0000","last_became_active":"2023-10-08T16:06:40.266866+0000","last_became_peered":"2023-10-08T16:06:40.266866+0000","last_unstale":"2023-10-08T16:06:40.275841+0000","last_undegraded":"2023-10-08T16:06:40.275841+0000","last_fullsized":"2023-10-08T16:06:40.275841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:53.878852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258987+0000","last_change":"2023-10-08T16:06:39.302711+0000","last_active":"2023-10-08T16:06:40.258987+0000","last_peered":"2023-10-08T16:06:40.258987+0000","last_clean":"2023-10-08T16:06:40.258987+0000","last_became_active":"2023-10-08T16:06:39.302404+0000","last_became_peered":"2023-10-08T16:06:39.302404+0000","last_unstale":"2023-10-08T16:06:40.258987+0000","last_undegraded":"2023-10-08T16:06:40.258987+0000","last_fullsized":"2023-10-08T16:06:40.258987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268533+0000","last_change":"2023-10-08T16:06:40.263548+0000","last_active":"2023-10-08T16:06:40.268533+0000","last_peered":"2023-10-08T16:06:40.268533+0000","last_clean":"2023-10-08T16:06:40.268533+0000","last_became_active":"2023-10-08T16:06:40.263230+0000","last_became_peered":"2023-10-08T16:06:40.263230+0000","last_unstale":"2023-10-08T16:06:40.268533+0000","last_undegraded":"2023-10-08T16:06:40.268533+0000","last_fullsized":"2023-10-08T16:06:40.268533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:50.492409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258991+0000","last_change":"2023-10-08T16:06:39.299840+0000","last_active":"2023-10-08T16:06:40.258991+0000","last_peered":"2023-10-08T16:06:40.258991+0000","last_clean":"2023-10-08T16:06:40.258991+0000","last_became_active":"2023-10-08T16:06:39.299502+0000","last_became_peered":"2023-10-08T16:06:39.299502+0000","last_unstale":"2023-10-08T16:06:40.258991+0000","last_undegraded":"2023-10-08T16:06:40.258991+0000","last_fullsized":"2023-10-08T16:06:40.258991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268950+0000","last_change":"2023-10-08T16:06:40.263516+0000","last_active":"2023-10-08T16:06:40.268950+0000","last_peered":"2023-10-08T16:06:40.268950+0000","last_clean":"2023-10-08T16:06:40.268950+0000","last_became_active":"2023-10-08T16:06:40.263180+0000","last_became_peered":"2023-10-08T16:06:40.263180+0000","last_unstale":"2023-10-08T16:06:40.268950+0000","last_undegraded":"2023-10-08T16:06:40.268950+0000","last_fullsized":"2023-10-08T16:06:40.268950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260056+0000","last_change":"2023-10-08T16:06:39.302588+0000","last_active":"2023-10-08T16:06:40.260056+0000","last_peered":"2023-10-08T16:06:40.260056+0000","last_clean":"2023-10-08T16:06:40.260056+0000","last_became_active":"2023-10-08T16:06:39.302361+0000","last_became_peered":"2023-10-08T16:06:39.302361+0000","last_unstale":"2023-10-08T16:06:40.260056+0000","last_undegraded":"2023-10-08T16:06:40.260056+0000","last_fullsized":"2023-10-08T16:06:40.260056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267686+0000","last_change":"2023-10-08T16:06:40.262950+0000","last_active":"2023-10-08T16:06:40.267686+0000","last_peered":"2023-10-08T16:06:40.267686+0000","last_clean":"2023-10-08T16:06:40.267686+0000","last_became_active":"2023-10-08T16:06:40.262620+0000","last_became_peered":"2023-10-08T16:06:40.262620+0000","last_unstale":"2023-10-08T16:06:40.267686+0000","last_undegraded":"2023-10-08T16:06:40.267686+0000","last_fullsized":"2023-10-08T16:06:40.267686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301577+0000","last_change":"2023-10-08T16:06:39.304109+0000","last_active":"2023-10-08T16:06:40.301577+0000","last_peered":"2023-10-08T16:06:40.301577+0000","last_clean":"2023-10-08T16:06:40.301577+0000","last_became_active":"2023-10-08T16:06:39.303757+0000","last_became_peered":"2023-10-08T16:06:39.303757+0000","last_unstale":"2023-10-08T16:06:40.301577+0000","last_undegraded":"2023-10-08T16:06:40.301577+0000","last_fullsized":"2023-10-08T16:06:40.301577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267750+0000","last_change":"2023-10-08T16:06:40.259475+0000","last_active":"2023-10-08T16:06:40.267750+0000","last_peered":"2023-10-08T16:06:40.267750+0000","last_clean":"2023-10-08T16:06:40.267750+0000","last_became_active":"2023-10-08T16:06:40.259042+0000","last_became_peered":"2023-10-08T16:06:40.259042+0000","last_unstale":"2023-10-08T16:06:40.267750+0000","last_undegraded":"2023-10-08T16:06:40.267750+0000","last_fullsized":"2023-10-08T16:06:40.267750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282564+0000","last_change":"2023-10-08T16:06:40.276456+0000","last_active":"2023-10-08T16:06:40.282564+0000","last_peered":"2023-10-08T16:06:40.282564+0000","last_clean":"2023-10-08T16:06:40.282564+0000","last_became_active":"2023-10-08T16:06:40.276127+0000","last_became_peered":"2023-10-08T16:06:40.276127+0000","last_unstale":"2023-10-08T16:06:40.282564+0000","last_undegraded":"2023-10-08T16:06:40.282564+0000","last_fullsized":"2023-10-08T16:06:40.282564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.299639+0000","last_change":"2023-10-08T16:06:39.302950+0000","last_active":"2023-10-08T16:06:40.299639+0000","last_peered":"2023-10-08T16:06:40.299639+0000","last_clean":"2023-10-08T16:06:40.299639+0000","last_became_active":"2023-10-08T16:06:39.302504+0000","last_became_peered":"2023-10-08T16:06:39.302504+0000","last_unstale":"2023-10-08T16:06:40.299639+0000","last_undegraded":"2023-10-08T16:06:40.299639+0000","last_fullsized":"2023-10-08T16:06:40.299639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279270+0000","last_change":"2023-10-08T16:06:40.269067+0000","last_active":"2023-10-08T16:06:40.279270+0000","last_peered":"2023-10-08T16:06:40.279270+0000","last_clean":"2023-10-08T16:06:40.279270+0000","last_became_active":"2023-10-08T16:06:40.268755+0000","last_became_peered":"2023-10-08T16:06:40.268755+0000","last_unstale":"2023-10-08T16:06:40.279270+0000","last_undegraded":"2023-10-08T16:06:40.279270+0000","last_fullsized":"2023-10-08T16:06:40.279270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300353+0000","last_change":"2023-10-08T16:06:39.305358+0000","last_active":"2023-10-08T16:06:40.300353+0000","last_peered":"2023-10-08T16:06:40.300353+0000","last_clean":"2023-10-08T16:06:40.300353+0000","last_became_active":"2023-10-08T16:06:39.305022+0000","last_became_peered":"2023-10-08T16:06:39.305022+0000","last_unstale":"2023-10-08T16:06:40.300353+0000","last_undegraded":"2023-10-08T16:06:40.300353+0000","last_fullsized":"2023-10-08T16:06:40.300353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:17.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278272+0000","last_change":"2023-10-08T16:06:40.274826+0000","last_active":"2023-10-08T16:06:40.278272+0000","last_peered":"2023-10-08T16:06:40.278272+0000","last_clean":"2023-10-08T16:06:40.278272+0000","last_became_active":"2023-10-08T16:06:40.274506+0000","last_became_peered":"2023-10-08T16:06:40.274506+0000","last_unstale":"2023-10-08T16:06:40.278272+0000","last_undegraded":"2023-10-08T16:06:40.278272+0000","last_fullsized":"2023-10-08T16:06:40.278272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301960+0000","last_change":"2023-10-08T16:06:39.298025+0000","last_active":"2023-10-08T16:06:40.301960+0000","last_peered":"2023-10-08T16:06:40.301960+0000","last_clean":"2023-10-08T16:06:40.301960+0000","last_became_active":"2023-10-08T16:06:39.297643+0000","last_became_peered":"2023-10-08T16:06:39.297643+0000","last_unstale":"2023-10-08T16:06:40.301960+0000","last_undegraded":"2023-10-08T16:06:40.301960+0000","last_fullsized":"2023-10-08T16:06:40.301960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273032+0000","last_change":"2023-10-08T16:06:40.268521+0000","last_active":"2023-10-08T16:06:40.273032+0000","last_peered":"2023-10-08T16:06:40.273032+0000","last_clean":"2023-10-08T16:06:40.273032+0000","last_became_active":"2023-10-08T16:06:40.267613+0000","last_became_peered":"2023-10-08T16:06:40.267613+0000","last_unstale":"2023-10-08T16:06:40.273032+0000","last_undegraded":"2023-10-08T16:06:40.273032+0000","last_fullsized":"2023-10-08T16:06:40.273032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301633+0000","last_change":"2023-10-08T16:06:39.303632+0000","last_active":"2023-10-08T16:06:40.301633+0000","last_peered":"2023-10-08T16:06:40.301633+0000","last_clean":"2023-10-08T16:06:40.301633+0000","last_became_active":"2023-10-08T16:06:39.303353+0000","last_became_peered":"2023-10-08T16:06:39.303353+0000","last_unstale":"2023-10-08T16:06:40.301633+0000","last_undegraded":"2023-10-08T16:06:40.301633+0000","last_fullsized":"2023-10-08T16:06:40.301633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:47.995 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:06:47.995 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T16:06:47.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T16:06:47.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T16:06:47.996 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T16:06:48.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.099+0000 7f547b59e700 1 Processor -- start 2023-10-08T16:06:48.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.099+0000 7f547b59e700 1 -- start start 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f547c0afd60 0x7f547c0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0c8fd0 con 0x7f547c155f70 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0c83c0 con 0x7f547c0afd60 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0c86a0 con 0x7f547c155ba0 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f5479d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f547c155f70 0x7f547c0c79a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56880/0 (socket says 172.21.15.3:56880) 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f5479d9b700 1 -- 172.21.15.3:0/778950964 learned_addr learned my addr 172.21.15.3:0/778950964 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:48.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547a59c700 1 --2- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547ad9d700 1 --2- 172.21.15.3:0/778950964 >> v2:172.21.15.27:3300/0 conn(0x7f547c0afd60 0x7f547c0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547959a700 1 -- 172.21.15.3:0/778950964 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820232175 0 0) 0x7f547c0c8fd0 con 0x7f547c155f70 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547959a700 1 -- 172.21.15.3:0/778950964 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5464003570 con 0x7f547c155f70 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547959a700 1 -- 172.21.15.3:0/778950964 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517256206 0 0) 0x7f5464003570 con 0x7f547c155f70 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547ad9d700 1 -- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 msgr2=0x7f547c0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547ad9d700 1 --2- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547ad9d700 1 -- 172.21.15.3:0/778950964 >> v1:172.21.15.3:6789/0 conn(0x7f547c155f70 legacy=0x7f547c0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547ad9d700 1 -- 172.21.15.3:0/778950964 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0c8980 con 0x7f547c0afd60 2023-10-08T16:06:48.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547ad9d700 1 --2- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c0ca950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54700098e0 tx=0x7f54700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68eea4e3f35e09c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547959a700 1 -- 172.21.15.3:0/778950964 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740017f0 con 0x7f547c0afd60 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547959a700 1 -- 172.21.15.3:0/778950964 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470011420 con 0x7f547c0afd60 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547959a700 1 -- 172.21.15.3:0/778950964 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700117a0 con 0x7f547c0afd60 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 msgr2=0x7f547c0ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 --2- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c0ca950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54700098e0 tx=0x7f54700091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- 172.21.15.3:0/778950964 shutdown_connections 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 --2- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c0ca950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 --2- 172.21.15.3:0/778950964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- 172.21.15.3:0/778950964 >> 172.21.15.3:0/778950964 conn(0x7f547c06b6b0 msgr2=0x7f547c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- 172.21.15.3:0/778950964 shutdown_connections 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.103+0000 7f547b59e700 1 -- 172.21.15.3:0/778950964 wait complete. 2023-10-08T16:06:48.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 Processor -- start 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 -- start start 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c166c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 0x7f547c154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c157f30 con 0x7f547c0a5230 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c157320 con 0x7f547c0afd60 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c157600 con 0x7f547c155ba0 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 0x7f547c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 0x7f547c154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36692/0 (socket says 172.21.15.3:36692) 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 -- 172.21.15.3:0/3374822890 learned_addr learned my addr 172.21.15.3:0/3374822890 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:48.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f5479d9b700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547a59c700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c166c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 -- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 msgr2=0x7f547c0a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 -- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 msgr2=0x7f547c166c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c166c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 -- 172.21.15.3:0/3374822890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470009420 con 0x7f547c0a5230 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.107+0000 7f547ad9d700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 0x7f547c154370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5470002000 tx=0x7f5470016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547001cc40 con 0x7f547c0a5230 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547001cda0 con 0x7f547c0a5230 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c1578e0 con 0x7f547c0a5230 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547001a680 con 0x7f547c0a5230 2023-10-08T16:06:48.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0c3260 con 0x7f547c0a5230 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c1580e0 con 0x7f547c0a5230 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f547001aa30 con 0x7f547c0a5230 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f546a7fc700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f545c060550 0x7f545c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f547007e150 con 0x7f547c0a5230 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f547a59c700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f545c060550 0x7f545c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.111+0000 7f547a59c700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f545c060550 0x7f545c062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f546c009db0 tx=0x7f546c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.119+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f547c1580e0 con 0x7f547c0a5230 2023-10-08T16:06:48.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.323+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f547c04be40 con 0x7f547c0a5230 2023-10-08T16:06:48.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.331+0000 7f546a7fc700 1 -- 172.21.15.3:0/3374822890 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154124 (secure 0 0 0) 0x7f547004e740 con 0x7f547c0a5230 2023-10-08T16:06:48.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f545c060550 msgr2=0x7f545c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f545c060550 0x7f545c062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f546c009db0 tx=0x7f546c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 msgr2=0x7f547c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 0x7f547c154370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5470002000 tx=0x7f5470016000 comp rx=0 tx=0).stop 2023-10-08T16:06:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 shutdown_connections 2023-10-08T16:06:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f545c060550 0x7f545c062a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f547c0a5230 0x7f547c154370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f547c155ba0 0x7f547c0a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 --2- 172.21.15.3:0/3374822890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c0afd60 0x7f547c166c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 >> 172.21.15.3:0/3374822890 conn(0x7f547c06b6b0 msgr2=0x7f547c0ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 shutdown_connections 2023-10-08T16:06:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.335+0000 7f547b59e700 1 -- 172.21.15.3:0/3374822890 wait complete. 2023-10-08T16:06:48.352 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":33399},{"type":"v1","addr":"172.21.15.3:6833","nonce":33399}]},"active_addr":"172.21.15.3:6833/33399","active_change":"2023-10-08T16:06:19.802685+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1255691708}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3862342650}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":2915664251}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1043980332}]}]} 2023-10-08T16:06:48.355 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T16:06:48.356 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T16:06:48.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:48.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.459+0000 7fee0ffff700 1 Processor -- start 2023-10-08T16:06:48.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.459+0000 7fee0ffff700 1 -- start start 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fee10156e40 0x7fee100c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10068280 0x7fee100686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee10068c00 con 0x7fee10068fd0 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee100c8690 con 0x7fee10156e40 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100c70b0 con 0x7fee10068280 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0e7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fee10068fd0 0x7fee100c6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56888/0 (socket says 172.21.15.3:56888) 2023-10-08T16:06:48.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0e7fc700 1 -- 172.21.15.3:0/2408395249 learned_addr learned my addr 172.21.15.3:0/2408395249 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0f7fe700 1 --2- 172.21.15.3:0/2408395249 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10068280 0x7fee100686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0effd700 1 --2- 172.21.15.3:0/2408395249 >> v2:172.21.15.27:3300/0 conn(0x7fee10156e40 0x7fee100c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0dffb700 1 -- 172.21.15.3:0/2408395249 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019032957 0 0) 0x7fee10068c00 con 0x7fee10068fd0 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0dffb700 1 -- 172.21.15.3:0/2408395249 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf8003570 con 0x7fee10068fd0 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0f7fe700 1 -- 172.21.15.3:0/2408395249 >> v2:172.21.15.27:3300/0 conn(0x7fee10156e40 msgr2=0x7fee100c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0f7fe700 1 --2- 172.21.15.3:0/2408395249 >> v2:172.21.15.27:3300/0 conn(0x7fee10156e40 0x7fee100c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0f7fe700 1 -- 172.21.15.3:0/2408395249 >> v1:172.21.15.3:6789/0 conn(0x7fee10068fd0 legacy=0x7fee100c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0f7fe700 1 -- 172.21.15.3:0/2408395249 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100c7390 con 0x7fee10068280 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0effd700 1 --2- 172.21.15.3:0/2408395249 >> v2:172.21.15.27:3300/0 conn(0x7fee10156e40 0x7fee100c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0f7fe700 1 --2- 172.21.15.3:0/2408395249 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10068280 0x7fee100686c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee08009e60 tx=0x7fee08009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d49376fee89bca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0dffb700 1 -- 172.21.15.3:0/2408395249 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800e070 con 0x7fee10068280 2023-10-08T16:06:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0dffb700 1 -- 172.21.15.3:0/2408395249 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0800bab0 con 0x7fee10068280 2023-10-08T16:06:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0dffb700 1 -- 172.21.15.3:0/2408395249 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800be70 con 0x7fee10068280 2023-10-08T16:06:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- 172.21.15.3:0/2408395249 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10068280 msgr2=0x7fee100686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 --2- 172.21.15.3:0/2408395249 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10068280 0x7fee100686c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee08009e60 tx=0x7fee08009780 comp rx=0 tx=0).stop 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- 172.21.15.3:0/2408395249 shutdown_connections 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 --2- 172.21.15.3:0/2408395249 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10068280 0x7fee100686c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 --2- 172.21.15.3:0/2408395249 >> v2:172.21.15.27:3300/0 conn(0x7fee10156e40 0x7fee100c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- 172.21.15.3:0/2408395249 >> 172.21.15.3:0/2408395249 conn(0x7fee100c8c90 msgr2=0x7fee100c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- 172.21.15.3:0/2408395249 shutdown_connections 2023-10-08T16:06:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.463+0000 7fee0ffff700 1 -- 172.21.15.3:0/2408395249 wait complete. 2023-10-08T16:06:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 Processor -- start 2023-10-08T16:06:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 -- start start 2023-10-08T16:06:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee10068280 0x7fee10165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 0x7fee10158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10156e40 0x7fee10159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1015a920 con 0x7fee10068fd0 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1016aac0 con 0x7fee10068280 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1015ab70 con 0x7fee10156e40 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 0x7fee10158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 0x7fee10158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36696/0 (socket says 172.21.15.3:36696) 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 -- 172.21.15.3:0/1202591580 learned_addr learned my addr 172.21.15.3:0/1202591580 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0effd700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee10068280 0x7fee10165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0f7fe700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10156e40 0x7fee10159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 -- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10156e40 msgr2=0x7fee10159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10156e40 0x7fee10159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 -- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee10068280 msgr2=0x7fee10165fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee10068280 0x7fee10165fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 -- 172.21.15.3:0/1202591580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00009420 con 0x7fee10068fd0 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0f7fe700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10156e40 0x7fee10159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0e7fc700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 0x7fee10158c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee0400c7c0 tx=0x7fee04007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04005b30 con 0x7fee10068fd0 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04005c90 con 0x7fee10068fd0 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04007320 con 0x7fee10068fd0 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.467+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08009a20 con 0x7fee10068fd0 2023-10-08T16:06:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1015b130 con 0x7fee10068fd0 2023-10-08T16:06:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1015b350 con 0x7fee10068fd0 2023-10-08T16:06:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fee0401b3b0 con 0x7fee10068fd0 2023-10-08T16:06:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fedf6ffd700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedfc060550 0x7fedfc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee0407bc20 con 0x7fee10068fd0 2023-10-08T16:06:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fee0effd700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedfc060550 0x7fedfc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.471+0000 7fee0effd700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedfc060550 0x7fedfc062a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee00009f40 tx=0x7fee000091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.479+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fee0404c210 con 0x7fee10068fd0 2023-10-08T16:06:48.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.639+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee1004be40 con 0x7fee10068fd0 2023-10-08T16:06:48.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fedf6ffd700 1 -- 172.21.15.3:0/1202591580 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fee04017090 con 0x7fee10068fd0 2023-10-08T16:06:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:48.646 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedfc060550 msgr2=0x7fedfc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedfc060550 0x7fedfc062a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee00009f40 tx=0x7fee000091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 msgr2=0x7fee10158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 0x7fee10158c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee0400c7c0 tx=0x7fee04007e00 comp rx=0 tx=0).stop 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 shutdown_connections 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedfc060550 0x7fedfc062a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fee10156e40 0x7fee10159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee10068fd0 0x7fee10158c40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 --2- 172.21.15.3:0/1202591580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee10068280 0x7fee10165fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 >> 172.21.15.3:0/1202591580 conn(0x7fee100c8c90 msgr2=0x7fee100ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 shutdown_connections 2023-10-08T16:06:48.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.643+0000 7fee0ffff700 1 -- 172.21.15.3:0/1202591580 wait complete. 2023-10-08T16:06:48.660 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T16:06:48.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:48.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 Processor -- start 2023-10-08T16:06:48.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- start start 2023-10-08T16:06:48.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f76a0151210 0x7f76a00c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a01515e0 0x7f76a00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a006dd20 con 0x7f76a015a9b0 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a00c9000 con 0x7f76a0151210 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a006d3f0 con 0x7f76a01515e0 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f76a0151210 0x7f76a00c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f76a0151210 0x7f76a00c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36702/0 (socket says 172.21.15.3:36702) 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 -- 172.21.15.3:0/877664383 learned_addr learned my addr 172.21.15.3:0/877664383 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f769ffff700 1 --2- 172.21.15.3:0/877664383 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a01515e0 0x7f76a00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 -- 172.21.15.3:0/877664383 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a01515e0 msgr2=0x7f76a00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:48.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 --2- 172.21.15.3:0/877664383 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a01515e0 0x7f76a00c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 -- 172.21.15.3:0/877664383 >> v1:172.21.15.27:6789/0 conn(0x7f76a015a9b0 legacy=0x7f76a00ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 -- 172.21.15.3:0/877664383 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a006d6d0 con 0x7f76a0151210 2023-10-08T16:06:48.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a4c1b700 1 --2- 172.21.15.3:0/877664383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a0151210 0x7f76a00c82e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76880099e0 tx=0x7f7688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a57225f33dc320 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f769f7fe700 1 -- 172.21.15.3:0/877664383 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768800b8b0 con 0x7f76a0151210 2023-10-08T16:06:48.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f769f7fe700 1 -- 172.21.15.3:0/877664383 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768800ba10 con 0x7f76a0151210 2023-10-08T16:06:48.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f769f7fe700 1 -- 172.21.15.3:0/877664383 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768800bdb0 con 0x7f76a0151210 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- 172.21.15.3:0/877664383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a0151210 msgr2=0x7f76a00c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/877664383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a0151210 0x7f76a00c82e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76880099e0 tx=0x7f7688009250 comp rx=0 tx=0).stop 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- 172.21.15.3:0/877664383 shutdown_connections 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/877664383 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a01515e0 0x7f76a00c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/877664383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a0151210 0x7f76a00c82e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- 172.21.15.3:0/877664383 >> 172.21.15.3:0/877664383 conn(0x7f76a00cdb50 msgr2=0x7f76a00cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- 172.21.15.3:0/877664383 shutdown_connections 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.767+0000 7f76a5c1d700 1 -- 172.21.15.3:0/877664383 wait complete. 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 Processor -- start 2023-10-08T16:06:48.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- start start 2023-10-08T16:06:48.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a0151210 0x7f76a00c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76a01515e0 0x7f76a00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 0x7f76a014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a014efb0 con 0x7f76a015a9b0 2023-10-08T16:06:48.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a015be00 con 0x7f76a01515e0 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00c6300 con 0x7f76a0151210 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 0x7f76a014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 0x7f76a014e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36710/0 (socket says 172.21.15.3:36710) 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 -- 172.21.15.3:0/252959470 learned_addr learned my addr 172.21.15.3:0/252959470 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a4c1b700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a0151210 0x7f76a00c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f769ffff700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76a01515e0 0x7f76a00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 -- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a0151210 msgr2=0x7f76a00c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a0151210 0x7f76a00c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 -- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76a01515e0 msgr2=0x7f76a00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76a01515e0 0x7f76a00c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 -- 172.21.15.3:0/252959470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880094f0 con 0x7f76a015a9b0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a541c700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 0x7f76a014e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f769000c560 tx=0x7f7690007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690011590 con 0x7f76a015a9b0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76900116f0 con 0x7f76a015a9b0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00c65e0 con 0x7f76a015a9b0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690011ab0 con 0x7f76a015a9b0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a015c170 con 0x7f76a015a9b0 2023-10-08T16:06:48.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.771+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a004be40 con 0x7f76a015a9b0 2023-10-08T16:06:48.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.775+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f769001b3b0 con 0x7f76a015a9b0 2023-10-08T16:06:48.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.775+0000 7f769cff9700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7680060550 0x7f7680062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:48.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.775+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f769007bcf0 con 0x7f76a015a9b0 2023-10-08T16:06:48.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.775+0000 7f76a4c1b700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7680060550 0x7f7680062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:48.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.775+0000 7f76a4c1b700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7680060550 0x7f7680062a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76880099e0 tx=0x7f7688017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:48.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.779+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7690080070 con 0x7f76a015a9b0 2023-10-08T16:06:48.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.939+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76a0168430 con 0x7f76a015a9b0 2023-10-08T16:06:48.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.939+0000 7f769cff9700 1 -- 172.21.15.3:0/252959470 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7690017020 con 0x7f76a015a9b0 2023-10-08T16:06:48.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:48.945 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7680060550 msgr2=0x7f7680062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7680060550 0x7f7680062a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76880099e0 tx=0x7f7688017000 comp rx=0 tx=0).stop 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 msgr2=0x7f76a014e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 0x7f76a014e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f769000c560 tx=0x7f7690007ef0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 shutdown_connections 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7680060550 0x7f7680062a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76a015a9b0 0x7f76a014e320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76a01515e0 0x7f76a00c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 --2- 172.21.15.3:0/252959470 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f76a0151210 0x7f76a00c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 >> 172.21.15.3:0/252959470 conn(0x7f76a00cdb50 msgr2=0x7f76a00c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 shutdown_connections 2023-10-08T16:06:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:48.943+0000 7f76a5c1d700 1 -- 172.21.15.3:0/252959470 wait complete. 2023-10-08T16:06:48.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T16:06:48.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T16:06:49.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T16:06:49.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T16:06:49.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T16:06:49.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T16:06:49.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T16:06:49.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T16:06:49.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f7741a11700 1 Processor -- start 2023-10-08T16:06:49.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f7741a11700 1 -- start start 2023-10-08T16:06:49.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7fb15f06c700 1 Processor -- start 2023-10-08T16:06:49.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7fb15f06c700 1 -- start start 2023-10-08T16:06:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f410ec8c700 1 Processor -- start 2023-10-08T16:06:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f410ec8c700 1 -- start start 2023-10-08T16:06:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f7741a11700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f773c158f10 0x7f773c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f7741a11700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c15d9b0 con 0x7f773c158b40 2023-10-08T16:06:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f7741a11700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c0ca6e0 con 0x7f773c0ca2c0 2023-10-08T16:06:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f7741a11700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c159360 con 0x7f773c158f10 2023-10-08T16:06:49.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f773affd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f773c158b40 0x7f773c0adba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56896/0 (socket says 172.21.15.3:56896) 2023-10-08T16:06:49.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f773affd700 1 -- 172.21.15.3:0/320665676 learned_addr learned my addr 172.21.15.3:0/320665676 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7ff7a0d9a700 1 Processor -- start 2023-10-08T16:06:49.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f773a7fc700 1 --2- 172.21.15.3:0/320665676 >> v2:172.21.15.27:3300/0 conn(0x7f773c158f10 0x7f773c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f8d38f85700 1 Processor -- start 2023-10-08T16:06:49.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7f8d38f85700 1 -- start start 2023-10-08T16:06:49.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.151+0000 7fb15f06c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb1580c67c0 0x7fb1580ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb158155f00 0x7fb15806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580adcc0 con 0x7fb158155b30 2023-10-08T16:06:49.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580ad0b0 con 0x7fb1580c67c0 2023-10-08T16:06:49.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580ad390 con 0x7fb158155f00 2023-10-08T16:06:49.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 -- start start 2023-10-08T16:06:49.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894955323 0 0) 0x7f773c15d9b0 con 0x7f773c158b40 2023-10-08T16:06:49.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7724003570 con 0x7f773c158b40 2023-10-08T16:06:49.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb1580c67c0 0x7fb1580ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f41080c7400 0x7f41080c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4108154ff0 0x7f4108155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41080ac8b0 con 0x7f410806c700 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410806c3e0 con 0x7f41080c7400 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410806cb50 con 0x7f4108154ff0 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788636158 0 0) 0x7f773c0ca6e0 con 0x7f773c0ca2c0 2023-10-08T16:06:49.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f773c15d9b0 con 0x7f773c0ca2c0 2023-10-08T16:06:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb1580c67c0 0x7fb1580ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36718/0 (socket says 172.21.15.3:36718) 2023-10-08T16:06:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 -- 172.21.15.3:0/3857939047 learned_addr learned my addr 172.21.15.3:0/3857939047 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f773a7fc700 1 -- 172.21.15.3:0/320665676 >> v1:172.21.15.27:6789/0 conn(0x7f773c0ca2c0 legacy=0x7f773c06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f773a7fc700 1 -- 172.21.15.3:0/320665676 >> v1:172.21.15.3:6789/0 conn(0x7f773c158b40 legacy=0x7f773c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f773a7fc700 1 -- 172.21.15.3:0/320665676 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c15cda0 con 0x7f773c158f10 2023-10-08T16:06:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f4107fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f410806c700 0x7f410806b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:53452/0 (socket says 172.21.15.3:53452) 2023-10-08T16:06:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f4107fff700 1 -- 172.21.15.3:0/3414386009 learned_addr learned my addr 172.21.15.3:0/3414386009 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410d229700 1 --2- 172.21.15.3:0/3414386009 >> v2:172.21.15.27:3300/0 conn(0x7f4108154ff0 0x7f4108155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 -- 172.21.15.3:0/3857939047 >> v2:172.21.15.27:3300/0 conn(0x7fb158155f00 msgr2=0x7fb15806a570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:06:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 --2- 172.21.15.3:0/3857939047 >> v2:172.21.15.27:3300/0 conn(0x7fb158155f00 0x7fb15806a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 -- 172.21.15.3:0/3857939047 >> v1:172.21.15.27:6789/0 conn(0x7fb158155b30 legacy=0x7fb1580c60b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:06:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 -- 172.21.15.3:0/3857939047 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580ad670 con 0x7fb1580c67c0 2023-10-08T16:06:49.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ca28700 1 --2- 172.21.15.3:0/3414386009 >> v2:172.21.15.3:3300/0 conn(0x7f41080c7400 0x7f41080c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 Processor -- start 2023-10-08T16:06:49.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 -- start start 2023-10-08T16:06:49.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d38f85700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8d34154bb0 0x7f8d3406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d38f85700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d340ab750 con 0x7f8d340b0ae0 2023-10-08T16:06:49.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d38f85700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d340abff0 con 0x7f8d3406dc50 2023-10-08T16:06:49.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d38f85700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3406e0d0 con 0x7f8d34154bb0 2023-10-08T16:06:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb157fff700 1 --2- 172.21.15.3:0/3857939047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1580c67c0 0x7fb1580ae150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb15806a500 tx=0x7fb150009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9309f3fe9a7739 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d33fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8d340b0ae0 0x7f8d34154f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56898/0 (socket says 172.21.15.3:56898) 2023-10-08T16:06:49.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d33fff700 1 -- 172.21.15.3:0/673056386 learned_addr learned my addr 172.21.15.3:0/673056386 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f41077fe700 1 -- 172.21.15.3:0/3414386009 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966296577 0 0) 0x7f41080ac8b0 con 0x7f410806c700 2023-10-08T16:06:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f41077fe700 1 -- 172.21.15.3:0/3414386009 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f0003570 con 0x7f410806c700 2023-10-08T16:06:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff79c0ae0f0 0x7ff79c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff79c0c65d0 0x7ff79c0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c1613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c15d8f0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c06ba40 con 0x7ff79c0ae0f0 2023-10-08T16:06:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff7a0d9a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c06bed0 con 0x7ff79c160f70 2023-10-08T16:06:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff79c0c65d0 0x7ff79c0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff79c0c65d0 0x7ff79c0c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36750/0 (socket says 172.21.15.3:36750) 2023-10-08T16:06:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 -- 172.21.15.3:0/2849205904 learned_addr learned my addr 172.21.15.3:0/2849205904 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410d229700 1 -- 172.21.15.3:0/3414386009 >> v2:172.21.15.3:3300/0 conn(0x7f41080c7400 msgr2=0x7f41080c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410d229700 1 --2- 172.21.15.3:0/3414386009 >> v2:172.21.15.3:3300/0 conn(0x7f41080c7400 0x7f41080c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410d229700 1 -- 172.21.15.3:0/3414386009 >> v1:172.21.15.27:6789/0 conn(0x7f410806c700 legacy=0x7f410806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410d229700 1 -- 172.21.15.3:0/3414386009 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080ac2a0 con 0x7f4108154ff0 2023-10-08T16:06:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f773a7fc700 1 --2- 172.21.15.3:0/320665676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158f10 0x7f773c0c9d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77300098e0 tx=0x7f77300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f955214722a7070f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff79a59c700 1 --2- 172.21.15.3:0/2849205904 >> v2:172.21.15.27:3300/0 conn(0x7ff79c0ae0f0 0x7ff79c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1577fe700 1 -- 172.21.15.3:0/3857939047 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000e070 con 0x7fb1580c67c0 2023-10-08T16:06:49.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff79ad9d700 1 --2- 172.21.15.3:0/2849205904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c1613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410d229700 1 --2- 172.21.15.3:0/3414386009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f4108155470 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f410000f300 tx=0x7f410000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ed685349039c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d337fe700 1 --2- 172.21.15.3:0/673056386 >> v2:172.21.15.3:3300/0 conn(0x7f8d34154bb0 0x7f8d3406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011630 con 0x7f773c158f10 2023-10-08T16:06:49.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1577fe700 1 -- 172.21.15.3:0/3857939047 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000bc90 con 0x7fb1580c67c0 2023-10-08T16:06:49.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1577fe700 1 -- 172.21.15.3:0/3857939047 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000be00 con 0x7fb1580c67c0 2023-10-08T16:06:49.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730011790 con 0x7f773c158f10 2023-10-08T16:06:49.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7739ffb700 1 -- 172.21.15.3:0/320665676 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011b30 con 0x7f773c158f10 2023-10-08T16:06:49.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198445042 0 0) 0x7f8d340ab750 con 0x7f8d340b0ae0 2023-10-08T16:06:49.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c004680 con 0x7f8d340b0ae0 2023-10-08T16:06:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 -- 172.21.15.3:0/2849205904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 msgr2=0x7ff79c1613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 --2- 172.21.15.3:0/2849205904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c1613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 -- 172.21.15.3:0/2849205904 >> v2:172.21.15.27:3300/0 conn(0x7ff79c0ae0f0 msgr2=0x7ff79c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 --2- 172.21.15.3:0/2849205904 >> v2:172.21.15.27:3300/0 conn(0x7ff79c0ae0f0 0x7ff79c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 -- 172.21.15.3:0/2849205904 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0c6f50 con 0x7ff79c0c65d0 2023-10-08T16:06:49.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f41077fe700 1 -- 172.21.15.3:0/3414386009 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100012070 con 0x7f4108154ff0 2023-10-08T16:06:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb1a006cf90 0x7fb1a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1a00aeb80 0x7fb1a015b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a00c80c0 con 0x7fb1a00b1990 2023-10-08T16:06:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00ac190 con 0x7fb1a006cf90 2023-10-08T16:06:49.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb1a4f2e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00c7ab0 con 0x7fb1a00aeb80 2023-10-08T16:06:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f41077fe700 1 -- 172.21.15.3:0/3414386009 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410000d0d0 con 0x7f4108154ff0 2023-10-08T16:06:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f41077fe700 1 -- 172.21.15.3:0/3414386009 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410000d450 con 0x7f4108154ff0 2023-10-08T16:06:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457725808 0 0) 0x7f8d1c004680 con 0x7f8d340b0ae0 2023-10-08T16:06:49.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 >> v2:172.21.15.3:3300/0 conn(0x7f8d34154bb0 msgr2=0x7f8d3406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb19dd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1a00aeb80 0x7fb1a015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb19dd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1a00aeb80 0x7fb1a015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59812/0 (socket says 172.21.15.3:59812) 2023-10-08T16:06:49.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb19dd9b700 1 -- 172.21.15.3:0/1175607518 learned_addr learned my addr 172.21.15.3:0/1175607518 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 --2- 172.21.15.3:0/673056386 >> v2:172.21.15.3:3300/0 conn(0x7f8d34154bb0 0x7f8d3406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 >> v1:172.21.15.27:6789/0 conn(0x7f8d3406dc50 legacy=0x7f8d340b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340b1100 con 0x7f8d340b0ae0 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f8d24004b20 con 0x7f8d340b0ae0 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d337fe700 1 --2- 172.21.15.3:0/673056386 >> v2:172.21.15.3:3300/0 conn(0x7f8d34154bb0 0x7f8d3406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 >> v1:172.21.15.3:6789/0 conn(0x7f8d340b0ae0 legacy=0x7f8d34154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d1c004b70 0x7f8d1c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d1c005920 0x7f8d1c005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d1c0062d0 0x7f8d1c003490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3406e0d0 con 0x7f8d1c005920 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c003b00 con 0x7f8d1c0062d0 2023-10-08T16:06:49.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c003cc0 con 0x7f8d1c004b70 2023-10-08T16:06:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- 172.21.15.3:0/3857939047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1580c67c0 msgr2=0x7fb1580ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 --2- 172.21.15.3:0/3857939047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1580c67c0 0x7fb1580ae150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb15806a500 tx=0x7fb150009840 comp rx=0 tx=0).stop 2023-10-08T16:06:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7741a11700 1 -- 172.21.15.3:0/320665676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158f10 msgr2=0x7f773c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7741a11700 1 --2- 172.21.15.3:0/320665676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158f10 0x7f773c0c9d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77300098e0 tx=0x7f77300091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- 172.21.15.3:0/3857939047 shutdown_connections 2023-10-08T16:06:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 --2- 172.21.15.3:0/3857939047 >> v2:172.21.15.27:3300/0 conn(0x7fb158155f00 0x7fb15806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 --2- 172.21.15.3:0/3857939047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1580c67c0 0x7fb1580ae150 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- 172.21.15.3:0/3857939047 >> 172.21.15.3:0/3857939047 conn(0x7fb158067b30 msgr2=0x7fb1580cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- 172.21.15.3:0/3857939047 shutdown_connections 2023-10-08T16:06:49.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb15f06c700 1 -- 172.21.15.3:0/3857939047 wait complete. 2023-10-08T16:06:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7ff799d9b700 1 --2- 172.21.15.3:0/2849205904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c0c6a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0c95f0 tx=0x7ff794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ffb3210a9453ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7741a11700 1 -- 172.21.15.3:0/320665676 shutdown_connections 2023-10-08T16:06:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7741a11700 1 --2- 172.21.15.3:0/320665676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158f10 0x7f773c0c9d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f7741a11700 1 -- 172.21.15.3:0/320665676 >> 172.21.15.3:0/320665676 conn(0x7f773c067060 msgr2=0x7f773c067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 -- 172.21.15.3:0/3414386009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 msgr2=0x7f4108155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f410ec8c700 1 --2- 172.21.15.3:0/3414386009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f4108155470 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f410000f300 tx=0x7f410000db90 comp rx=0 tx=0).stop 2023-10-08T16:06:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7fb19e59c700 1 --2- 172.21.15.3:0/1175607518 >> v2:172.21.15.3:3300/0 conn(0x7fb1a006cf90 0x7fb1a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d337fe700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d1c004b70 0x7f8d1c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.155+0000 7f8d33fff700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d1c0062d0 0x7f8d1c003490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f410ec8c700 1 -- 172.21.15.3:0/3414386009 shutdown_connections 2023-10-08T16:06:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f410ec8c700 1 --2- 172.21.15.3:0/3414386009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f4108155470 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f410ec8c700 1 --2- 172.21.15.3:0/3414386009 >> v2:172.21.15.3:3300/0 conn(0x7f41080c7400 0x7f41080c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff79959a700 1 -- 172.21.15.3:0/2849205904 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400e070 con 0x7ff79c0c65d0 2023-10-08T16:06:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f410ec8c700 1 -- 172.21.15.3:0/3414386009 >> 172.21.15.3:0/3414386009 conn(0x7f4108067b30 msgr2=0x7f41080cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff79959a700 1 -- 172.21.15.3:0/2849205904 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400ba20 con 0x7ff79c0c65d0 2023-10-08T16:06:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff79959a700 1 -- 172.21.15.3:0/2849205904 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7940092e0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d32ffd700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d1c005920 0x7f8d1c005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d337fe700 1 -- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d1c0062d0 msgr2=0x7f8d1c003490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d337fe700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d1c0062d0 0x7f8d1c003490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 Processor -- start 2023-10-08T16:06:49.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d337fe700 1 -- 172.21.15.3:0/673056386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d1c005920 msgr2=0x7f8d1c005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d337fe700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d1c005920 0x7f8d1c005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d33fff700 1 -- 172.21.15.3:0/673056386 reap_dead start 2023-10-08T16:06:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d337fe700 1 -- 172.21.15.3:0/673056386 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340b1100 con 0x7f8d1c004b70 2023-10-08T16:06:49.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d32ffd700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d1c005920 0x7f8d1c005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19dd9b700 1 -- 172.21.15.3:0/1175607518 >> v2:172.21.15.3:3300/0 conn(0x7fb1a006cf90 msgr2=0x7fb1a006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19dd9b700 1 --2- 172.21.15.3:0/1175607518 >> v2:172.21.15.3:3300/0 conn(0x7fb1a006cf90 0x7fb1a006d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19dd9b700 1 -- 172.21.15.3:0/1175607518 >> v1:172.21.15.27:6789/0 conn(0x7fb1a00b1990 legacy=0x7fb1a00b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19dd9b700 1 -- 172.21.15.3:0/1175607518 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00cc6e0 con 0x7fb1a00aeb80 2023-10-08T16:06:49.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19e59c700 1 --2- 172.21.15.3:0/1175607518 >> v2:172.21.15.3:3300/0 conn(0x7fb1a006cf90 0x7fb1a006d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d337fe700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d1c004b70 0x7f8d1c004f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00e3c0 tx=0x7f8d2c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f8beaf0f7c0851 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c009c50 con 0x7f8d1c004b70 2023-10-08T16:06:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19dd9b700 1 --2- 172.21.15.3:0/1175607518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00aeb80 0x7fb1a015b520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0070210 tx=0x7fb194009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd8a731e62f1560d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/2849205904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 msgr2=0x7ff79c0c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/2849205904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c0c6a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0c95f0 tx=0x7ff794009840 comp rx=0 tx=0).stop 2023-10-08T16:06:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 Processor -- start 2023-10-08T16:06:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00f040 con 0x7f8d1c004b70 2023-10-08T16:06:49.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d327fc700 1 -- 172.21.15.3:0/673056386 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00ee60 con 0x7f8d1c004b70 2023-10-08T16:06:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/2849205904 shutdown_connections 2023-10-08T16:06:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/2849205904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c1613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/2849205904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c0c6a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/2849205904 >> v2:172.21.15.27:3300/0 conn(0x7ff79c0ae0f0 0x7ff79c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/2849205904 >> 172.21.15.3:0/2849205904 conn(0x7ff79c067b30 msgr2=0x7ff79c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 -- start start 2023-10-08T16:06:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19d59a700 1 -- 172.21.15.3:0/1175607518 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194009e70 con 0x7fb1a00aeb80 2023-10-08T16:06:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/2849205904 shutdown_connections 2023-10-08T16:06:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f7741a11700 1 -- 172.21.15.3:0/320665676 shutdown_connections 2023-10-08T16:06:49.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/2849205904 wait complete. 2023-10-08T16:06:49.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19d59a700 1 -- 172.21.15.3:0/1175607518 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19400b860 con 0x7fb1a00aeb80 2023-10-08T16:06:49.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb19d59a700 1 -- 172.21.15.3:0/1175607518 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400bc00 con 0x7fb1a00aeb80 2023-10-08T16:06:49.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f7741a11700 1 -- 172.21.15.3:0/320665676 wait complete. 2023-10-08T16:06:49.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 -- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d1c004b70 msgr2=0x7f8d1c004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d1c004b70 0x7f8d1c004f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00e3c0 tx=0x7f8d2c00b040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 -- 172.21.15.3:0/673056386 shutdown_connections 2023-10-08T16:06:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 --2- 172.21.15.3:0/673056386 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d1c004b70 0x7f8d1c004f80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 -- 172.21.15.3:0/673056386 >> 172.21.15.3:0/673056386 conn(0x7f8d340cc3b0 msgr2=0x7f8d34067270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 -- 172.21.15.3:0/673056386 shutdown_connections 2023-10-08T16:06:49.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f8d38f85700 1 -- 172.21.15.3:0/673056386 wait complete. 2023-10-08T16:06:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/1175607518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00aeb80 msgr2=0x7fb1a015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb1a4f2e700 1 --2- 172.21.15.3:0/1175607518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00aeb80 0x7fb1a015b520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0070210 tx=0x7fb194009250 comp rx=0 tx=0).stop 2023-10-08T16:06:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1580c67c0 0x7fb1580c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb158155b30 0x7fb158148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb158155f00 0x7fb158145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f410ec8c700 1 -- 172.21.15.3:0/3414386009 shutdown_connections 2023-10-08T16:06:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb158148a60 con 0x7fb158155b30 2023-10-08T16:06:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c4620 con 0x7fb1580c67c0 2023-10-08T16:06:49.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15f06c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c5e20 con 0x7fb158155f00 2023-10-08T16:06:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f410ec8c700 1 -- 172.21.15.3:0/3414386009 wait complete. 2023-10-08T16:06:49.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 -- start start 2023-10-08T16:06:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb280adc50 0x7fbb280ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb280c69d0 0x7fbb2814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb28158ab0 con 0x7fbb2814f4c0 2023-10-08T16:06:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2814f960 con 0x7fbb280adc50 2023-10-08T16:06:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2e9a3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28158d00 con 0x7fbb280c69d0 2023-10-08T16:06:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15d609700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb158155f00 0x7fb158145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15d609700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb158155f00 0x7fb158145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:35096/0 (socket says 172.21.15.3:35096) 2023-10-08T16:06:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb15d609700 1 -- 172.21.15.3:0/2900001588 learned_addr learned my addr 172.21.15.3:0/2900001588 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2cf40700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbb2814f4c0 0x7fbb280c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56902/0 (socket says 172.21.15.3:56902) 2023-10-08T16:06:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb2cf40700 1 -- 172.21.15.3:0/3675005405 learned_addr learned my addr 172.21.15.3:0/3675005405 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7ff7a0d9a700 1 Processor -- start 2023-10-08T16:06:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb277fe700 1 --2- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb280c69d0 0x7fbb2814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f7741a11700 1 Processor -- start 2023-10-08T16:06:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fbb27fff700 1 --2- 172.21.15.3:0/3675005405 >> v2:172.21.15.27:3300/0 conn(0x7fbb280adc50 0x7fbb280ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7f7741a11700 1 -- start start 2023-10-08T16:06:49.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb157fff700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb158155b30 0x7fb158148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/1175607518 shutdown_connections 2023-10-08T16:06:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb1a4f2e700 1 --2- 172.21.15.3:0/1175607518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00aeb80 0x7fb1a015b520 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0070210 tx=0x7fb194009250 comp rx=0 tx=0).stop 2023-10-08T16:06:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb1a4f2e700 1 --2- 172.21.15.3:0/1175607518 >> v2:172.21.15.3:3300/0 conn(0x7fb1a006cf90 0x7fb1a006d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.159+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/1175607518 >> 172.21.15.3:0/1175607518 conn(0x7fb1a006b640 msgr2=0x7fb1a006ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15d609700 1 -- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1580c67c0 msgr2=0x7fb1580c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15ce08700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1580c67c0 0x7fb1580c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb26ffd700 1 -- 172.21.15.3:0/3675005405 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744508686 0 0) 0x7fbb28158ab0 con 0x7fbb2814f4c0 2023-10-08T16:06:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb26ffd700 1 -- 172.21.15.3:0/3675005405 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb10003570 con 0x7fbb2814f4c0 2023-10-08T16:06:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 Processor -- start 2023-10-08T16:06:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 Processor -- start 2023-10-08T16:06:49.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 -- start start 2023-10-08T16:06:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/1175607518 shutdown_connections 2023-10-08T16:06:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15d609700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1580c67c0 0x7fb1580c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15d609700 1 -- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb158155b30 msgr2=0x7fb158148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15d609700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb158155b30 0x7fb158148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15d609700 1 -- 172.21.15.3:0/2900001588 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009ae0 con 0x7fb158155f00 2023-10-08T16:06:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15d609700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb158155f00 0x7fb158145f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00b4c0 tx=0x7fb14c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00f510 con 0x7fb158155f00 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00f690 con 0x7fb158155f00 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00fa50 con 0x7fb158155f00 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15f06c700 1 -- 172.21.15.3:0/2900001588 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580c4340 con 0x7fb158155f00 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15f06c700 1 -- 172.21.15.3:0/2900001588 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1581486f0 con 0x7fb158155f00 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb27fff700 1 -- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb280c69d0 msgr2=0x7fbb2814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb27fff700 1 --2- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb280c69d0 0x7fbb2814ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb26ffd700 1 -- 172.21.15.3:0/3675005405 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 392808282 0 0) 0x7fbb10003570 con 0x7fbb2814f4c0 2023-10-08T16:06:49.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb27fff700 1 -- 172.21.15.3:0/3675005405 >> v1:172.21.15.3:6789/0 conn(0x7fbb2814f4c0 legacy=0x7fbb280c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb27fff700 1 -- 172.21.15.3:0/3675005405 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28158fe0 con 0x7fbb280adc50 2023-10-08T16:06:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 -- start start 2023-10-08T16:06:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 -- start start 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3414cff0 0x7f8d3406b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d3414d3c0 0x7f8d3406b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d3416db20 0x7f8d3416dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34171930 con 0x7f8d3416db20 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34171000 con 0x7f8d3414cff0 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d38f85700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d341712e0 con 0x7f8d3414d3c0 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d3414d3c0 0x7f8d3406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d3414d3c0 0x7f8d3406b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:35110/0 (socket says 172.21.15.3:35110) 2023-10-08T16:06:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 -- 172.21.15.3:0/4053899395 learned_addr learned my addr 172.21.15.3:0/4053899395 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb27fff700 1 --2- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb280ae020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009d50 tx=0x7fbb20009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a5fe78d536e28a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f410806c700 0x7f41081482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41080c7400 0x7f41080acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f41080ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108148820 con 0x7f41080c7400 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410814c860 con 0x7f4108154ff0 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ec8c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410814bf70 con 0x7f410806c700 2023-10-08T16:06:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4107fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41080c7400 0x7f41080acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f7741a11700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f773c0ca2c0 0x7f773c150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f7741a11700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158b40 0x7f773c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f7741a11700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f773c158f10 0x7f773c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f773c158f10 0x7f773c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f773c158f10 0x7f773c15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36802/0 (socket says 172.21.15.3:36802) 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158b40 0x7f773c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158b40 0x7f773c15db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59834/0 (socket says 172.21.15.3:59834) 2023-10-08T16:06:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c0ae0f0 0x7ff79c170bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c16dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c16e120 con 0x7ff79c0c65d0 2023-10-08T16:06:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0af880 con 0x7ff79c0ae0f0 2023-10-08T16:06:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0b0490 con 0x7ff79c160f70 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff79a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c0ae0f0 0x7ff79c170bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c16dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff79a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c0ae0f0 0x7ff79c170bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59826/0 (socket says 172.21.15.3:59826) 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff79a59c700 1 -- 172.21.15.3:0/1771877906 learned_addr learned my addr 172.21.15.3:0/1771877906 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff79ad9d700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 -- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 msgr2=0x7ff79c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff79c160f70 0x7ff79c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 -- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c0ae0f0 msgr2=0x7ff79c170bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c0ae0f0 0x7ff79c170bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 -- 172.21.15.3:0/1771877906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009ae0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4107fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41080c7400 0x7f41080acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36818/0 (socket says 172.21.15.3:36818) 2023-10-08T16:06:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4107fff700 1 -- 172.21.15.3:0/735777307 learned_addr learned my addr 172.21.15.3:0/735777307 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb26ffd700 1 -- 172.21.15.3:0/3675005405 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18004cd0 con 0x7fbb280adc50 2023-10-08T16:06:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 -- 172.21.15.3:0/4074283718 learned_addr learned my addr 172.21.15.3:0/4074283718 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c150880 con 0x7f773c158f10 2023-10-08T16:06:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0af710 con 0x7f773c158b40 2023-10-08T16:06:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15ee30 con 0x7f773c0ca2c0 2023-10-08T16:06:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff799d9b700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c16dbe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff794015000 tx=0x7ff794018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410d229700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f41080ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f410ca28700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f410806c700 0x7f41081482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4107fff700 1 -- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f410806c700 msgr2=0x7f41081482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 -- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3414cff0 msgr2=0x7f8d3406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3414cff0 0x7f8d3406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 -- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d3416db20 msgr2=0x7f8d3416dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d3416db20 0x7f8d3416dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 -- 172.21.15.3:0/4053899395 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d341715c0 con 0x7f8d3414d3c0 2023-10-08T16:06:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773affd700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f773c0ca2c0 0x7f773c150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb15f06c700 1 -- 172.21.15.3:0/2900001588 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb15804be40 con 0x7fb158155f00 2023-10-08T16:06:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb26ffd700 1 -- 172.21.15.3:0/3675005405 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2000c8b0 con 0x7fbb280adc50 2023-10-08T16:06:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb26ffd700 1 -- 172.21.15.3:0/3675005405 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000cc30 con 0x7fbb280adc50 2023-10-08T16:06:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 Processor -- start 2023-10-08T16:06:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 -- start start 2023-10-08T16:06:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4e3015d080 0x7f4e3015d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 0x7f4e3006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006aa10 0x7f4e3006d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3006ce60 con 0x7f4e3006a570 2023-10-08T16:06:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3006b540 con 0x7f4e3015d080 2023-10-08T16:06:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e375d6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3006cb30 con 0x7f4e3006aa10 2023-10-08T16:06:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/1175607518 wait complete. 2023-10-08T16:06:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d32ffd700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d3414d3c0 0x7f8d3406b970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e5e0 tx=0x7f8d28009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794008be0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e34b71700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 0x7f4e3006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794008d80 con 0x7ff79c0c65d0 2023-10-08T16:06:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7940266b0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e34b71700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 0x7f4e3006d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36820/0 (socket says 172.21.15.3:36820) 2023-10-08T16:06:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e34b71700 1 -- 172.21.15.3:0/3032626570 learned_addr learned my addr 172.21.15.3:0/3032626570 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c0af2c0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c0b0120 con 0x7ff79c0c65d0 2023-10-08T16:06:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e35b73700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006aa10 0x7f4e3006d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f4e35372700 1 --2- 172.21.15.3:0/3032626570 >> v2:172.21.15.27:3300/0 conn(0x7f4e3015d080 0x7f4e3015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 msgr2=0x7fbb280ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7fbb2e9a3700 1 --2- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb280ae020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009d50 tx=0x7fbb20009780 comp rx=0 tx=0).stop 2023-10-08T16:06:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb14c01a400 con 0x7fb158155f00 2023-10-08T16:06:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e35372700 1 -- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006aa10 msgr2=0x7f4e3006d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e35372700 1 --2- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006aa10 0x7f4e3006d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e35372700 1 -- 172.21.15.3:0/3032626570 >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 msgr2=0x7f4e3006d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4107fff700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f410806c700 0x7f41081482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4107fff700 1 -- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 msgr2=0x7f41080ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4107fff700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f41080ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4107fff700 1 -- 172.21.15.3:0/735777307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410000de30 con 0x7f41080c7400 2023-10-08T16:06:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 Processor -- start 2023-10-08T16:06:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 -- start start 2023-10-08T16:06:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e35372700 1 --2- 172.21.15.3:0/3032626570 >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 0x7f4e3006d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e35372700 1 -- 172.21.15.3:0/3032626570 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3006af80 con 0x7f4e3015d080 2023-10-08T16:06:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 -- 172.21.15.3:0/4074283718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f773c0ca2c0 msgr2=0x7f773c150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f773c0ca2c0 0x7f773c150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 -- 172.21.15.3:0/4074283718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158b40 msgr2=0x7f773c15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f773c158b40 0x7f773c15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009420 con 0x7f773c158f10 2023-10-08T16:06:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f773b7fe700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f773c158f10 0x7f773c15e080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f773400cb10 tx=0x7f77340027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77340040f0 con 0x7f773c158f10 2023-10-08T16:06:49.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400a7e0 con 0x7f773c158f10 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400aba0 con 0x7f773c158f10 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c15f110 con 0x7f773c158f10 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c15f3f0 con 0x7f773c158f10 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.163+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280105f0 con 0x7f8d3414d3c0 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d28010750 con 0x7f8d3414d3c0 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d38f85700 1 -- 172.21.15.3:0/4053899395 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3416e500 con 0x7f8d3414d3c0 2023-10-08T16:06:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d38f85700 1 -- 172.21.15.3:0/4053899395 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d34152850 con 0x7f8d3414d3c0 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb144060550 0x7fb144062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb14c07c2c0 con 0x7fb158155f00 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb15ce08700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb144060550 0x7fb144062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7fb1440686e0 0x7fb14406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 --> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb14406b1a0 con 0x7fb1440686e0 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e35372700 1 --2- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3015d080 0x7f4e3015d450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e300cb6c0 tx=0x7f4e2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99fed83eec5528b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4107fff700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41080c7400 0x7f41080acf90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c590 tx=0x7f40fc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3675005405 shutdown_connections 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fbb2e9a3700 1 --2- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb280c69d0 0x7fbb2814ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fbb2e9a3700 1 --2- 172.21.15.3:0/3675005405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb280ae020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3675005405 >> 172.21.15.3:0/3675005405 conn(0x7fbb28067060 msgr2=0x7fbb28067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb157fff700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7fb1440686e0 0x7fb14406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14c009180 con 0x7fb158155f00 2023-10-08T16:06:49.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb157fff700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7fb1440686e0 0x7fb14406aaf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a006cf90 0x7fb1a00c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00b1990 0x7fb1a00c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb1a0151320 0x7fb1a00c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c3bb0 con 0x7fb1a006cf90 2023-10-08T16:06:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c3dc0 con 0x7fb1a00b1990 2023-10-08T16:06:49.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb1a4f2e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c40a0 con 0x7fb1a0151320 2023-10-08T16:06:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e27fff700 1 -- 172.21.15.3:0/3032626570 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c011630 con 0x7f4e3015d080 2023-10-08T16:06:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e27fff700 1 -- 172.21.15.3:0/3032626570 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c011790 con 0x7f4e3015d080 2023-10-08T16:06:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e34b71700 1 --2- 172.21.15.3:0/3032626570 >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 0x7f4e3006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb15ce08700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb144060550 0x7fb144062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb14800ecd0 tx=0x7fb148008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb1a0151320 0x7fb1a00c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb1a0151320 0x7fb1a00c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:35152/0 (socket says 172.21.15.3:35152) 2023-10-08T16:06:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 -- 172.21.15.3:0/170109687 learned_addr learned my addr 172.21.15.3:0/170109687 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3675005405 shutdown_connections 2023-10-08T16:06:49.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff780000fd0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff794003040 con 0x7ff79c0c65d0 2023-10-08T16:06:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff78a7fc700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff77c060650 0x7ff77c062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff79407ec80 con 0x7ff79c0c65d0 2023-10-08T16:06:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff78a7fc700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7ff77c0687e0 0x7ff77c06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 --> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff77c06b2a0 con 0x7ff77c0687e0 2023-10-08T16:06:49.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28010af0 con 0x7f8d3414d3c0 2023-10-08T16:06:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d38f85700 1 -- 172.21.15.3:0/4053899395 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d14000fd0 con 0x7f8d3414d3c0 2023-10-08T16:06:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8d28014480 con 0x7f8d3414d3c0 2023-10-08T16:06:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff79a59c700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff77c060650 0x7ff77c062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8d200606d0 0x7f8d20062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d2807c660 con 0x7f8d3414d3c0 2023-10-08T16:06:49.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f410ca28700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f410806c700 0x7f41081482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f410d229700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4108154ff0 0x7f41080ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff79ad9d700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7ff77c0687e0 0x7ff77c06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc005b30 con 0x7f41080c7400 2023-10-08T16:06:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc005c90 con 0x7f41080c7400 2023-10-08T16:06:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc007300 con 0x7f41080c7400 2023-10-08T16:06:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108158860 con 0x7f41080c7400 2023-10-08T16:06:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f8d200688e0 0x7f8d2006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 --> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d2006b3a0 con 0x7f8d200688e0 2023-10-08T16:06:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d2807ec00 con 0x7f8d3414d3c0 2023-10-08T16:06:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410814c4f0 con 0x7f41080c7400 2023-10-08T16:06:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f8d33fff700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f8d200688e0 0x7f8d2006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== osd.5 v2:172.21.15.27:6816/33604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb14406b1a0 con 0x7fb1440686e0 2023-10-08T16:06:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7ff79ad9d700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7ff77c0687e0 0x7ff77c06abf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19e59c700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a006cf90 0x7fb1a00c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19dd9b700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00b1990 0x7fb1a00c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 -- 172.21.15.3:0/170109687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00b1990 msgr2=0x7fb1a00c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1a00b1990 0x7fb1a00c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 -- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a006cf90 msgr2=0x7fb1a00c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a006cf90 0x7fb1a00c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 -- 172.21.15.3:0/170109687 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009a20 con 0x7fb1a0151320 2023-10-08T16:06:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fb19ed9d700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb1a0151320 0x7fb1a00c4b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb19000c4c0 tx=0x7fb190007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7734012420 con 0x7f773c158f10 2023-10-08T16:06:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7722ffd700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7728060600 0x7f7728062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f773407c840 con 0x7f773c158f10 2023-10-08T16:06:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f7741a11700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f771c0015f0 0x7f771c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f771c006b90 con 0x7f771c0015f0 2023-10-08T16:06:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4108068870 con 0x7f41080c7400 2023-10-08T16:06:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011590 con 0x7fb1a0151320 2023-10-08T16:06:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940094f0 con 0x7fb1a0151320 2023-10-08T16:06:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a00c4660 con 0x7fb1a0151320 2023-10-08T16:06:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190011710 con 0x7fb1a0151320 2023-10-08T16:06:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f773a7fc700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f771c0015f0 0x7f771c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f8d33fff700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f8d200688e0 0x7f8d2006acf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff79404f3a0 con 0x7ff79c0c65d0 2023-10-08T16:06:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e375d6700 1 -- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3015d080 msgr2=0x7f4e3015d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7f4e375d6700 1 --2- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3015d080 0x7f4e3015d450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e300cb6c0 tx=0x7f4e2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- 172.21.15.3:0/3032626570 shutdown_connections 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 --2- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006aa10 0x7f4e3006d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 --2- 172.21.15.3:0/3032626570 >> v2:172.21.15.3:3300/0 conn(0x7f4e3006a570 0x7f4e3006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 --2- 172.21.15.3:0/3032626570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3015d080 0x7f4e3015d450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- 172.21.15.3:0/3032626570 >> 172.21.15.3:0/3032626570 conn(0x7f4e30067060 msgr2=0x7f4e30067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- 172.21.15.3:0/3032626570 shutdown_connections 2023-10-08T16:06:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- 172.21.15.3:0/3032626570 wait complete. 2023-10-08T16:06:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.167+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3675005405 wait complete. 2023-10-08T16:06:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 Processor -- start 2023-10-08T16:06:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 -- start start 2023-10-08T16:06:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011ad0 con 0x7fb1a0151320 2023-10-08T16:06:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb2814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f773a7fc700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f771c0015f0 0x7f771c003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb280c69d0 0x7fbb2814d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb2814f4c0 0x7fbb28153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2814d280 con 0x7fbb280c69d0 2023-10-08T16:06:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2814e670 con 0x7fbb280adc50 2023-10-08T16:06:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb2e9a3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2814a580 con 0x7fbb2814f4c0 2023-10-08T16:06:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 Processor -- start 2023-10-08T16:06:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- start start 2023-10-08T16:06:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f773affd700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7728060600 0x7f7728062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb27fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb2814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb27fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb2814a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59890/0 (socket says 172.21.15.3:59890) 2023-10-08T16:06:49.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb27fff700 1 -- 172.21.15.3:0/3869454218 learned_addr learned my addr 172.21.15.3:0/3869454218 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb280c69d0 0x7fbb2814d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== osd.7 v2:172.21.15.27:6824/33607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff77c06b2a0 con 0x7ff77c0687e0 2023-10-08T16:06:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7ff79a59c700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff77c060650 0x7ff77c062b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009dd0 tx=0x7ff78c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb19001b3b0 con 0x7fb1a0151320 2023-10-08T16:06:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb184000fd0 con 0x7fb1a0151320 2023-10-08T16:06:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f773affd700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7728060600 0x7f7728062ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f772c007fd0 tx=0x7f772c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== osd.3 v2:172.21.15.3:6816/33490 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f771c006b90 con 0x7f771c0015f0 2023-10-08T16:06:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 -- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb2814f4c0 msgr2=0x7fbb28153f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:06:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbb2814f4c0 0x7fbb28153f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 -- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 msgr2=0x7fbb2814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb2814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 -- 172.21.15.3:0/3869454218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2000d040 con 0x7fbb280c69d0 2023-10-08T16:06:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb27fff700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb280adc50 0x7fbb2814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006a570 0x7f4e30167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3006aa10 0x7f4e30167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb277fe700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb280c69d0 0x7fbb2814d9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00e9a0 tx=0x7fbb1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e3015d080 0x7f4e301460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30142b40 con 0x7f4e3015d080 2023-10-08T16:06:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e301486a0 con 0x7f4e3006aa10 2023-10-08T16:06:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e375d6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30146de0 con 0x7f4e3006a570 2023-10-08T16:06:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb180060650 0x7fb180062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb19007bc00 con 0x7fb1a0151320 2023-10-08T16:06:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fb18e7fc700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7fb1800686f0 0x7fb18006ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e34b71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3006aa10 0x7f4e30167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f4e35372700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006a570 0x7f4e30167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e34b71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3006aa10 0x7f4e30167c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59902/0 (socket says 172.21.15.3:59902) 2023-10-08T16:06:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e34b71700 1 -- 172.21.15.3:0/976685498 learned_addr learned my addr 172.21.15.3:0/976685498 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 --> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb18006b1b0 con 0x7fb1800686f0 2023-10-08T16:06:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1900801e0 con 0x7fb1a0151320 2023-10-08T16:06:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00ee90 con 0x7fbb280c69d0 2023-10-08T16:06:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.171+0000 7f8d337fe700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8d200606d0 0x7f8d20062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== osd.4 v2:172.21.15.27:6800/33605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8d2006b3a0 con 0x7f8d200688e0 2023-10-08T16:06:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00c850 con 0x7fbb280c69d0 2023-10-08T16:06:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2814c670 con 0x7fbb280c69d0 2023-10-08T16:06:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fb19dd9b700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7fb1800686f0 0x7fb18006ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00cc30 con 0x7fbb280c69d0 2023-10-08T16:06:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2814cc30 con 0x7fbb280c69d0 2023-10-08T16:06:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e35372700 1 -- 172.21.15.3:0/976685498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3006aa10 msgr2=0x7f4e30167c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e35372700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3006aa10 0x7f4e30167c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e35372700 1 -- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e3015d080 msgr2=0x7f4e301460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e35372700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e3015d080 0x7f4e301460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e35372700 1 -- 172.21.15.3:0/976685498 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200094f0 con 0x7f4e3006a570 2023-10-08T16:06:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e35372700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006a570 0x7f4e30167700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c016000 tx=0x7f4e2c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fb19dd9b700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7fb1800686f0 0x7fb18006ab00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb2804be40 con 0x7fbb280c69d0 2023-10-08T16:06:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c01f070 con 0x7f4e3006a570 2023-10-08T16:06:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c01aa00 con 0x7f4e3006a570 2023-10-08T16:06:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c009420 con 0x7f4e3006a570 2023-10-08T16:06:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c01ada0 con 0x7f4e3006a570 2023-10-08T16:06:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e30148330 con 0x7f4e3006a570 2023-10-08T16:06:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbb1c013470 con 0x7fbb280c69d0 2023-10-08T16:06:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e301481b0 con 0x7f4e3006a570 2023-10-08T16:06:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb0ffff700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbb14060550 0x7fbb14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f40fc012400 con 0x7f41080c7400 2023-10-08T16:06:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== osd.1 v2:172.21.15.3:6804/33488 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb18006b1b0 con 0x7fb1800686f0 2023-10-08T16:06:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f8d337fe700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8d200606d0 0x7f8d20062b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d34068200 tx=0x7f8d2c01b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb27fff700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbb14060550 0x7fbb14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb1c07c7f0 con 0x7fbb280c69d0 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7fbb0ffff700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fbb14068760 0x7fbb1406ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 --> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb1406b220 con 0x7fbb14068760 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb1c081240 con 0x7fbb280c69d0 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7fbb2cf40700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fbb14068760 0x7fbb1406ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7fbb27fff700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbb14060550 0x7fbb14062a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb20003400 tx=0x7fbb20019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40fc07c6a0 con 0x7f41080c7400 2023-10-08T16:06:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f40ec068830 0x7f40ec06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 --> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40ec06b2f0 con 0x7f40ec068830 2023-10-08T16:06:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40fc07ca70 con 0x7f41080c7400 2023-10-08T16:06:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f410d229700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f40ec068830 0x7f40ec06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7fbb2cf40700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fbb14068760 0x7fbb1406ab70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f410d229700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f40ec068830 0x7f40ec06ac40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== osd.0 v2:172.21.15.3:6800/33489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f40ec06b2f0 con 0x7f40ec068830 2023-10-08T16:06:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== osd.6 v2:172.21.15.27:6808/33606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbb1406b220 con 0x7fbb14068760 2023-10-08T16:06:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.183+0000 7fb19e59c700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb180060650 0x7fb180062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.183+0000 7fb19e59c700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb180060650 0x7fb180062b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1980099f0 tx=0x7fb19800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.175+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4e2c023070 con 0x7f4e3006a570 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e257fa700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4e14060550 0x7f4e14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e2c07d4a0 con 0x7f4e3006a570 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e257fa700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7f4e14068760 0x7f4e1406ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 --> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e1406b220 con 0x7f4e14068760 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e2c07fa00 con 0x7f4e3006a570 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e35b73700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7f4e14068760 0x7f4e1406ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e35b73700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7f4e14068760 0x7f4e1406ab70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.179+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== osd.2 v2:172.21.15.3:6824/33499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4e1406b220 con 0x7f4e14068760 2023-10-08T16:06:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.187+0000 7f410ca28700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.187+0000 7f4e34b71700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4e14060550 0x7f4e14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.187+0000 7f4e34b71700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4e14060550 0x7f4e14062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e300ad280 tx=0x7f4e20009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.187+0000 7f410ca28700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b4b0 tx=0x7f40f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 --> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f771c005c20 con 0x7f771c0015f0 2023-10-08T16:06:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7722ffd700 1 -- 172.21.15.3:0/4074283718 <== osd.3 v2:172.21.15.3:6816/33490 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f771c005c20 con 0x7f771c0015f0 2023-10-08T16:06:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 --> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff780002d30 con 0x7ff77c0687e0 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f771c0015f0 msgr2=0x7f771c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f771c0015f0 0x7f771c003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7728060600 msgr2=0x7f7728062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7728060600 0x7f7728062ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f772c007fd0 tx=0x7f772c009040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f773c158f10 msgr2=0x7f773c15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 --2- 172.21.15.3:0/4074283718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f773c158f10 0x7f773c15e080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f773400cb10 tx=0x7f77340027a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f773b7fe700 1 -- 172.21.15.3:0/4074283718 reap_dead start 2023-10-08T16:06:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 shutdown_connections 2023-10-08T16:06:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7ff78a7fc700 1 -- 172.21.15.3:0/1771877906 <== osd.7 v2:172.21.15.27:6824/33607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff780002d30 con 0x7ff77c0687e0 2023-10-08T16:06:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 >> 172.21.15.3:0/4074283718 conn(0x7f773c067060 msgr2=0x7f773c06b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 shutdown_connections 2023-10-08T16:06:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.199+0000 7f7741a11700 1 -- 172.21.15.3:0/4074283718 wait complete. 2023-10-08T16:06:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7ff77c0687e0 msgr2=0x7ff77c06abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7ff77c0687e0 0x7ff77c06abf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff77c060650 msgr2=0x7ff77c062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff77c060650 0x7ff77c062b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009dd0 tx=0x7ff78c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 msgr2=0x7ff79c16dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 --2- 172.21.15.3:0/1771877906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff79c0c65d0 0x7ff79c16dbe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff794015000 tx=0x7ff794018000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff79ad9d700 1 -- 172.21.15.3:0/1771877906 reap_dead start 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 shutdown_connections 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 >> 172.21.15.3:0/1771877906 conn(0x7ff79c067b30 msgr2=0x7ff79c0c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 shutdown_connections 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.203+0000 7ff7a0d9a700 1 -- 172.21.15.3:0/1771877906 wait complete. 2023-10-08T16:06:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d38f85700 1 -- 172.21.15.3:0/4053899395 --> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d14002d30 con 0x7f8d200688e0 2023-10-08T16:06:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 --> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb184002d30 con 0x7fb1800686f0 2023-10-08T16:06:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7fb18e7fc700 1 -- 172.21.15.3:0/170109687 <== osd.1 v2:172.21.15.3:6804/33488 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb184002d30 con 0x7fb1800686f0 2023-10-08T16:06:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d1b7fe700 1 -- 172.21.15.3:0/4053899395 <== osd.4 v2:172.21.15.27:6800/33605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d14002d30 con 0x7f8d200688e0 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f8d200688e0 msgr2=0x7f8d2006acf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f8d200688e0 0x7f8d2006acf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8d200606d0 msgr2=0x7f8d20062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8d200606d0 0x7f8d20062b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d34068200 tx=0x7f8d2c01b000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d3414d3c0 msgr2=0x7f8d3406b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 --2- 172.21.15.3:0/4053899395 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8d3414d3c0 0x7f8d3406b970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e5e0 tx=0x7f8d28009040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d33fff700 1 -- 172.21.15.3:0/4053899395 reap_dead start 2023-10-08T16:06:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 shutdown_connections 2023-10-08T16:06:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 >> 172.21.15.3:0/4053899395 conn(0x7f8d340cc3b0 msgr2=0x7f8d34150450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 --> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e3004be40 con 0x7f4e14068760 2023-10-08T16:06:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e257fa700 1 -- 172.21.15.3:0/976685498 <== osd.2 v2:172.21.15.3:6824/33499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e3004be40 con 0x7f4e14068760 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7f4e14068760 msgr2=0x7f4e1406ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7f4e14068760 0x7f4e1406ab70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4e14060550 msgr2=0x7f4e14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4e14060550 0x7f4e14062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e300ad280 tx=0x7f4e20009250 comp rx=0 tx=0).stop 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006a570 msgr2=0x7f4e30167700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 --2- 172.21.15.3:0/976685498 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4e3006a570 0x7f4e30167700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c016000 tx=0x7f4e2c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e35b73700 1 -- 172.21.15.3:0/976685498 reap_dead start 2023-10-08T16:06:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 shutdown_connections 2023-10-08T16:06:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 >> 172.21.15.3:0/976685498 conn(0x7f4e30067060 msgr2=0x7f4e3015c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 shutdown_connections 2023-10-08T16:06:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.207+0000 7f4e375d6700 1 -- 172.21.15.3:0/976685498 wait complete. 2023-10-08T16:06:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 shutdown_connections 2023-10-08T16:06:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7f8d197fa700 1 -- 172.21.15.3:0/4053899395 wait complete. 2023-10-08T16:06:49.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb15f06c700 1 -- 172.21.15.3:0/2900001588 --> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1580ad950 con 0x7fb1440686e0 2023-10-08T16:06:49.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7fb1800686f0 msgr2=0x7fb18006ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7fb1800686f0 0x7fb18006ab00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb180060650 msgr2=0x7fb180062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb180060650 0x7fb180062b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1980099f0 tx=0x7fb19800b040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb1a0151320 msgr2=0x7fb1a00c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 --2- 172.21.15.3:0/170109687 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb1a0151320 0x7fb1a00c4b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb19000c4c0 tx=0x7fb190007f50 comp rx=0 tx=0).stop 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb19ed9d700 1 -- 172.21.15.3:0/170109687 reap_dead start 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 shutdown_connections 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 >> 172.21.15.3:0/170109687 conn(0x7fb1a006b640 msgr2=0x7fb1a0067a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 shutdown_connections 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb1a4f2e700 1 -- 172.21.15.3:0/170109687 wait complete. 2023-10-08T16:06:49.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb154ff9700 1 -- 172.21.15.3:0/2900001588 <== osd.5 v2:172.21.15.27:6816/33604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1580ad950 con 0x7fb1440686e0 2023-10-08T16:06:49.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7fb1440686e0 msgr2=0x7fb14406aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7fb1440686e0 0x7fb14406aaf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb144060550 msgr2=0x7fb144062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb144060550 0x7fb144062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb14800ecd0 tx=0x7fb148008040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb158155f00 msgr2=0x7fb158145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 --2- 172.21.15.3:0/2900001588 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb158155f00 0x7fb158145f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00b4c0 tx=0x7fb14c009060 comp rx=0 tx=0).stop 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb15d609700 1 -- 172.21.15.3:0/2900001588 reap_dead start 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 shutdown_connections 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 >> 172.21.15.3:0/2900001588 conn(0x7fb158067b30 msgr2=0x7fb1580c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 shutdown_connections 2023-10-08T16:06:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.211+0000 7fb13e7fc700 1 -- 172.21.15.3:0/2900001588 wait complete. 2023-10-08T16:06:49.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.215+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 --> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb281592c0 con 0x7fbb14068760 2023-10-08T16:06:49.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 --> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4108068870 con 0x7f40ec068830 2023-10-08T16:06:49.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f4104ff9700 1 -- 172.21.15.3:0/735777307 <== osd.0 v2:172.21.15.3:6800/33489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4108068870 con 0x7f40ec068830 2023-10-08T16:06:49.287 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb0ffff700 1 -- 172.21.15.3:0/3869454218 <== osd.6 v2:172.21.15.27:6808/33606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb281592c0 con 0x7fbb14068760 2023-10-08T16:06:49.287 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:06:49.288 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:49.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:06:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f40ec068830 msgr2=0x7f40ec06ac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f40ec068830 0x7f40ec06ac40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 msgr2=0x7f40ec062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b4b0 tx=0x7f40f8008040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41080c7400 msgr2=0x7f41080acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 --2- 172.21.15.3:0/735777307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41080c7400 0x7f41080acf90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c590 tx=0x7f40fc007e00 comp rx=0 tx=0).stop 2023-10-08T16:06:49.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410d229700 1 -- 172.21.15.3:0/735777307 reap_dead start 2023-10-08T16:06:49.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 shutdown_connections 2023-10-08T16:06:49.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 >> 172.21.15.3:0/735777307 conn(0x7f4108067b30 msgr2=0x7f410814ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 shutdown_connections 2023-10-08T16:06:49.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fbb14068760 msgr2=0x7fbb1406ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fbb14068760 0x7fbb1406ab70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7f410ec8c700 1 -- 172.21.15.3:0/735777307 wait complete. 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbb14060550 msgr2=0x7fbb14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbb14060550 0x7fbb14062a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb20003400 tx=0x7fbb20019000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb280c69d0 msgr2=0x7fbb2814d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 --2- 172.21.15.3:0/3869454218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb280c69d0 0x7fbb2814d9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00e9a0 tx=0x7fbb1c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2cf40700 1 -- 172.21.15.3:0/3869454218 reap_dead start 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 shutdown_connections 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 >> 172.21.15.3:0/3869454218 conn(0x7fbb28067060 msgr2=0x7fbb280c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 shutdown_connections 2023-10-08T16:06:49.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.219+0000 7fbb2e9a3700 1 -- 172.21.15.3:0/3869454218 wait complete. 2023-10-08T16:06:49.293 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-10-08T16:06:49.293 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:06:49.294 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-10-08T16:06:49.294 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:06:49.295 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-10-08T16:06:49.295 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:06:49.296 INFO:teuthology.orchestra.run.smithi003.stdout:55834574857 2023-10-08T16:06:49.296 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:06:49.297 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-10-08T16:06:49.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:06:49.298 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:49.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:06:49.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 Processor -- start 2023-10-08T16:06:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 -- start start 2023-10-08T16:06:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f922c154e50 0x7f922c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c155220 0x7f922c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c06ad00 con 0x7f922c0c79d0 2023-10-08T16:06:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c06bb20 con 0x7f922c154e50 2023-10-08T16:06:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f9230a8b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c06af30 con 0x7f922c155220 2023-10-08T16:06:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f922bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f922c0c79d0 0x7f922c0ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56912/0 (socket says 172.21.15.3:56912) 2023-10-08T16:06:49.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f922bfff700 1 -- 172.21.15.3:0/407666672 learned_addr learned my addr 172.21.15.3:0/407666672 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f922b7fe700 1 --2- 172.21.15.3:0/407666672 >> v2:172.21.15.27:3300/0 conn(0x7f922c154e50 0x7f922c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f922affd700 1 --2- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c155220 0x7f922c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f922a7fc700 1 -- 172.21.15.3:0/407666672 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635202154 0 0) 0x7f922c06ad00 con 0x7f922c0c79d0 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.475+0000 7f922a7fc700 1 -- 172.21.15.3:0/407666672 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9214003570 con 0x7f922c0c79d0 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922b7fe700 1 -- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c155220 msgr2=0x7f922c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922b7fe700 1 --2- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c155220 0x7f922c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922b7fe700 1 -- 172.21.15.3:0/407666672 >> v1:172.21.15.3:6789/0 conn(0x7f922c0c79d0 legacy=0x7f922c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922b7fe700 1 -- 172.21.15.3:0/407666672 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c06b1f0 con 0x7f922c154e50 2023-10-08T16:06:49.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922b7fe700 1 --2- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c06bfb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f921c0098e0 tx=0x7f921c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa950f5d962b9e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922a7fc700 1 -- 172.21.15.3:0/407666672 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c011630 con 0x7f922c154e50 2023-10-08T16:06:49.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922a7fc700 1 -- 172.21.15.3:0/407666672 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c011790 con 0x7f922c154e50 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f922a7fc700 1 -- 172.21.15.3:0/407666672 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c011b30 con 0x7f922c154e50 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 -- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 msgr2=0x7f922c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 --2- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c06bfb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f921c0098e0 tx=0x7f921c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 -- 172.21.15.3:0/407666672 shutdown_connections 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 --2- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c155220 0x7f922c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 --2- 172.21.15.3:0/407666672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c06bfb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 -- 172.21.15.3:0/407666672 >> 172.21.15.3:0/407666672 conn(0x7f922c0c83d0 msgr2=0x7f922c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 -- 172.21.15.3:0/407666672 shutdown_connections 2023-10-08T16:06:49.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.479+0000 7f9230a8b700 1 -- 172.21.15.3:0/407666672 wait complete. 2023-10-08T16:06:49.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 Processor -- start 2023-10-08T16:06:49.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 -- start start 2023-10-08T16:06:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c0c79d0 0x7f922c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 0x7f922c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c156c20 con 0x7f922c155220 2023-10-08T16:06:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c156010 con 0x7f922c154e50 2023-10-08T16:06:49.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f9230a8b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1562f0 con 0x7f922c0c79d0 2023-10-08T16:06:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3d2ea700 1 Processor -- start 2023-10-08T16:06:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3d2ea700 1 -- start start 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 0x7f922c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 0x7f922c155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36858/0 (socket says 172.21.15.3:36858) 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922b7fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c0c79d0 0x7f922c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 -- 172.21.15.3:0/3196923930 learned_addr learned my addr 172.21.15.3:0/3196923930 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922affd700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 -- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c0c79d0 msgr2=0x7f922c1570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c0c79d0 0x7f922c1570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 -- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 msgr2=0x7f922c14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 -- 172.21.15.3:0/3196923930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c009420 con 0x7f922c155220 2023-10-08T16:06:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922b7fe700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c0c79d0 0x7f922c1570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f922bfff700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 0x7f922c155710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9224001460 tx=0x7f9224001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3d2ea700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcf38156fc0 0x7fcf380c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3d2ea700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3806b040 con 0x7fcf3806aad0 2023-10-08T16:06:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3d2ea700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3806b320 con 0x7fcf380c6ae0 2023-10-08T16:06:49.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3d2ea700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3806b600 con 0x7fcf38156fc0 2023-10-08T16:06:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f410e2ba700 1 Processor -- start 2023-10-08T16:06:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7f410e2ba700 1 -- start start 2023-10-08T16:06:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf3cae9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcf38156fc0 0x7fcf380c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400a940 con 0x7f922c155220 2023-10-08T16:06:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922400aaa0 con 0x7f922c155220 2023-10-08T16:06:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400ae20 con 0x7f922c155220 2023-10-08T16:06:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf377fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcf3806aad0 0x7fcf3806c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56914/0 (socket says 172.21.15.3:56914) 2023-10-08T16:06:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.483+0000 7fcf377fe700 1 -- 172.21.15.3:0/2983034838 learned_addr learned my addr 172.21.15.3:0/2983034838 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3cae9700 1 -- 172.21.15.3:0/2983034838 >> v1:172.21.15.27:6789/0 conn(0x7fcf380c6ae0 legacy=0x7fcf381568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3cae9700 1 -- 172.21.15.3:0/2983034838 >> v1:172.21.15.3:6789/0 conn(0x7fcf3806aad0 legacy=0x7fcf3806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3cae9700 1 -- 172.21.15.3:0/2983034838 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3806b8e0 con 0x7fcf38156fc0 2023-10-08T16:06:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 Processor -- start 2023-10-08T16:06:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 -- start start 2023-10-08T16:06:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3cae9700 1 --2- 172.21.15.3:0/2983034838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf38156fc0 0x7fcf380c6eb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00fad0 tx=0x7fcf2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f80405d1c038a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 Processor -- start 2023-10-08T16:06:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf36ffd700 1 -- 172.21.15.3:0/2983034838 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00f430 con 0x7fcf38156fc0 2023-10-08T16:06:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f1fefafc700 1 Processor -- start 2023-10-08T16:06:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f9230a8b700 1 -- 172.21.15.3:0/3196923930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c1565d0 con 0x7f922c155220 2023-10-08T16:06:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f9230a8b700 1 -- 172.21.15.3:0/3196923930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c150250 con 0x7f922c155220 2023-10-08T16:06:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf36ffd700 1 -- 172.21.15.3:0/2983034838 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00c070 con 0x7fcf38156fc0 2023-10-08T16:06:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 -- start start 2023-10-08T16:06:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb06415d080 0x7fb06415d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a570 0x7fb06406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06406ce60 con 0x7fb06406a9e0 2023-10-08T16:06:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06406b540 con 0x7fb06415d080 2023-10-08T16:06:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb069c28700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06406cb30 con 0x7fb06406a570 2023-10-08T16:06:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/2983034838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf38156fc0 msgr2=0x7fcf380c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/2983034838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf38156fc0 0x7fcf380c6eb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00fad0 tx=0x7fcf2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f1fefafc700 1 -- start start 2023-10-08T16:06:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f9230a8b700 1 -- 172.21.15.3:0/3196923930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c04be40 con 0x7f922c155220 2023-10-08T16:06:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb06415d080 0x7fb06415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb06415d080 0x7fb06415d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59934/0 (socket says 172.21.15.3:59934) 2023-10-08T16:06:49.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 -- 172.21.15.3:0/2486117945 learned_addr learned my addr 172.21.15.3:0/2486117945 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb062ffd700 1 --2- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a570 0x7fb06406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/2983034838 shutdown_connections 2023-10-08T16:06:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/2983034838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf38156fc0 0x7fcf380c6eb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/2983034838 >> 172.21.15.3:0/2983034838 conn(0x7fcf380c83d0 msgr2=0x7fcf380c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fceb806c700 0x7fceb80cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 -- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a570 msgr2=0x7fb06406d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 --2- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a570 0x7fb06406d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 -- 172.21.15.3:0/2486117945 >> v1:172.21.15.27:6789/0 conn(0x7fb06406a9e0 legacy=0x7fb0640aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 -- 172.21.15.3:0/2486117945 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06406af80 con 0x7fb06415d080 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fceb80c7850 0x7fceb8154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80ac8b0 con 0x7fceb80c7400 2023-10-08T16:06:49.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb806c3e0 con 0x7fceb806c700 2023-10-08T16:06:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebeb8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb80ac2a0 con 0x7fceb80c7850 2023-10-08T16:06:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9224007300 con 0x7f922c155220 2023-10-08T16:06:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410e2ba700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f410806de10 0x7f410815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410e2ba700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f41080ca520 0x7f410806c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebc927700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fceb806c700 0x7fceb80cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fceb7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fceb80c7400 0x7fceb806b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:53482/0 (socket says 172.21.15.3:53482) 2023-10-08T16:06:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fceb7fff700 1 -- 172.21.15.3:0/1016189829 learned_addr learned my addr 172.21.15.3:0/1016189829 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410e2ba700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410806d980 con 0x7f41080ca150 2023-10-08T16:06:49.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410e2ba700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41080cb390 con 0x7f41080ca520 2023-10-08T16:06:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410e2ba700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410806cd70 con 0x7f410806de10 2023-10-08T16:06:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f887987f700 1 Processor -- start 2023-10-08T16:06:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fb0637fe700 1 --2- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 0x7fb06415d450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0580099b0 tx=0x7fb058009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28046723d24bf7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410cab7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f410806de10 0x7f410815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410d2b8700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f41080ca150 0x7f410815bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56920/0 (socket says 172.21.15.3:56920) 2023-10-08T16:06:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410d2b8700 1 -- 172.21.15.3:0/2695159038 learned_addr learned my addr 172.21.15.3:0/2695159038 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fcebd128700 1 --2- 172.21.15.3:0/1016189829 >> v2:172.21.15.27:3300/0 conn(0x7fceb80c7850 0x7fceb8154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f92137fe700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9218060620 0x7f9218062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f887987f700 1 -- start start 2023-10-08T16:06:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f922407cb80 con 0x7f922c155220 2023-10-08T16:06:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288235531 0 0) 0x7fceb80ac8b0 con 0x7fceb80c7400 2023-10-08T16:06:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea0003570 con 0x7fceb80c7400 2023-10-08T16:06:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f922b7fe700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9218060620 0x7f9218062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410cab7700 1 -- 172.21.15.3:0/2695159038 >> v2:172.21.15.3:3300/0 conn(0x7f41080ca520 msgr2=0x7f410806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410cab7700 1 --2- 172.21.15.3:0/2695159038 >> v2:172.21.15.3:3300/0 conn(0x7f41080ca520 0x7f410806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.487+0000 7f410cab7700 1 -- 172.21.15.3:0/2695159038 >> v1:172.21.15.3:6789/0 conn(0x7f41080ca150 legacy=0x7f410815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410cab7700 1 -- 172.21.15.3:0/2695159038 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410806d050 con 0x7f410806de10 2023-10-08T16:06:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb0627fc700 1 -- 172.21.15.3:0/2486117945 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058009ea0 con 0x7fb06415d080 2023-10-08T16:06:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb0627fc700 1 -- 172.21.15.3:0/2486117945 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800b860 con 0x7fb06415d080 2023-10-08T16:06:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb0627fc700 1 -- 172.21.15.3:0/2486117945 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800bc00 con 0x7fb06415d080 2023-10-08T16:06:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 <== mon.1 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561247788 0 0) 0x7fcea0003570 con 0x7fceb80c7400 2023-10-08T16:06:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 >> v2:172.21.15.27:3300/0 conn(0x7fceb80c7850 msgr2=0x7fceb8154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 --2- 172.21.15.3:0/1016189829 >> v2:172.21.15.27:3300/0 conn(0x7fceb80c7850 0x7fceb8154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 >> v2:172.21.15.3:3300/0 conn(0x7fceb806c700 msgr2=0x7fceb80cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 --2- 172.21.15.3:0/1016189829 >> v2:172.21.15.3:3300/0 conn(0x7fceb806c700 0x7fceb80cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb806be20 con 0x7fceb80c7400 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 <== mon.1 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fcea8001470 con 0x7fceb80c7400 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 >> v1:172.21.15.27:6789/0 conn(0x7fceb80c7400 legacy=0x7fceb806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcea0004810 0x7fcea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcea00051c0 0x7fcea000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb806c3e0 con 0x7fcea0004810 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80ac2a0 con 0x7fcea00051c0 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000c080 con 0x7fcea0003a60 2023-10-08T16:06:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fefafc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1fe80c77d0 0x7f1fe806c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fefafc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80ac8b0 con 0x7f1fe80c7400 2023-10-08T16:06:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fefafc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80ac2a0 con 0x7f1fe8154ff0 2023-10-08T16:06:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fefafc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe806c3e0 con 0x7f1fe80c77d0 2023-10-08T16:06:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410cab7700 1 --2- 172.21.15.3:0/2695159038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f410806de10 0x7f410815c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41080c5f10 tx=0x7f40f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=870f1a81c4f04403 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fee099700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1fe8154ff0 0x7f1fe8155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:53488/0 (socket says 172.21.15.3:53488) 2023-10-08T16:06:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fee099700 1 -- 172.21.15.3:0/2310072975 learned_addr learned my addr 172.21.15.3:0/2310072975 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f922b7fe700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9218060620 0x7f9218062ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f921c0091e0 tx=0x7f921c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f40fffff700 1 -- 172.21.15.3:0/2695159038 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800b670 con 0x7f410806de10 2023-10-08T16:06:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f40fffff700 1 -- 172.21.15.3:0/2695159038 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f800b7d0 con 0x7f410806de10 2023-10-08T16:06:49.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f40fffff700 1 -- 172.21.15.3:0/2695159038 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800bb70 con 0x7f410806de10 2023-10-08T16:06:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f887987f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8874155220 0x7f887406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f887987f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887406ad00 con 0x7f88740c8eb0 2023-10-08T16:06:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb069c28700 1 -- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 msgr2=0x7fb06415d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb069c28700 1 --2- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 0x7fb06415d450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0580099b0 tx=0x7fb058009250 comp rx=0 tx=0).stop 2023-10-08T16:06:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f887987f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887406bb20 con 0x7f8874154e50 2023-10-08T16:06:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f887987f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887406af30 con 0x7f8874155220 2023-10-08T16:06:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fed097700 1 --2- 172.21.15.3:0/2310072975 >> v2:172.21.15.27:3300/0 conn(0x7f1fe80c77d0 0x7f1fe806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8874155220 0x7f887406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 -- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcea00051c0 msgr2=0x7fcea000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcea00051c0 0x7fcea000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8874155220 0x7f887406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:59986/0 (socket says 172.21.15.3:59986) 2023-10-08T16:06:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 -- 172.21.15.3:0/2866343757 learned_addr learned my addr 172.21.15.3:0/2866343757 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f887887d700 1 --1- 172.21.15.3:0/2866343757 >> v1:172.21.15.27:6789/0 conn(0x7f8874154e50 0x7f88740c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:53496/0 (socket says 172.21.15.3:53496) 2023-10-08T16:06:49.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/2983034838 shutdown_connections 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/2983034838 wait complete. 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 -- 172.21.15.3:0/1016189829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcea0004810 msgr2=0x7fcea0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcea0004810 0x7fcea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 -- 172.21.15.3:0/1016189829 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0003570 con 0x7fcea0003a60 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebd128700 1 -- 172.21.15.3:0/1016189829 reap_dead start 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb069c28700 1 -- 172.21.15.3:0/2486117945 shutdown_connections 2023-10-08T16:06:49.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb069c28700 1 --2- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a570 0x7fb06406d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb069c28700 1 --2- 172.21.15.3:0/2486117945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 0x7fb06415d450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fb069c28700 1 -- 172.21.15.3:0/2486117945 >> 172.21.15.3:0/2486117945 conn(0x7fb064067060 msgr2=0x7fb064067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fed097700 1 -- 172.21.15.3:0/2310072975 >> v1:172.21.15.27:6789/0 conn(0x7f1fe8154ff0 legacy=0x7f1fe8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fed097700 1 -- 172.21.15.3:0/2310072975 >> v1:172.21.15.3:6789/0 conn(0x7f1fe80c7400 legacy=0x7f1fe806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fed097700 1 -- 172.21.15.3:0/2310072975 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe806be20 con 0x7f1fe80c77d0 2023-10-08T16:06:49.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcebc927700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fceac00bb60 tx=0x7fceac008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b8af54291e0595 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 -- 172.21.15.3:0/2695159038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f410806de10 msgr2=0x7f410815c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 --2- 172.21.15.3:0/2695159038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f410806de10 0x7f410815c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41080c5f10 tx=0x7f40f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 -- 172.21.15.3:0/2695159038 shutdown_connections 2023-10-08T16:06:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 --2- 172.21.15.3:0/2695159038 >> v2:172.21.15.3:3300/0 conn(0x7f41080ca520 0x7f410806c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 --2- 172.21.15.3:0/2695159038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f410806de10 0x7f410815c5d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 -- 172.21.15.3:0/2695159038 >> 172.21.15.3:0/2695159038 conn(0x7f41080c83d0 msgr2=0x7f41080c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 -- 172.21.15.3:0/2695159038 shutdown_connections 2023-10-08T16:06:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f410e2ba700 1 -- 172.21.15.3:0/2695159038 wait complete. 2023-10-08T16:06:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fec896700 1 -- 172.21.15.3:0/2310072975 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753153398 0 0) 0x7f1fe80ac2a0 con 0x7f1fe8154ff0 2023-10-08T16:06:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 -- 172.21.15.3:0/2866343757 >> v1:172.21.15.27:6789/0 conn(0x7f8874154e50 legacy=0x7f88740c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 -- 172.21.15.3:0/2866343757 >> v1:172.21.15.3:6789/0 conn(0x7f88740c8eb0 legacy=0x7f88740ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 -- 172.21.15.3:0/2866343757 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887406b1f0 con 0x7f8874155220 2023-10-08T16:06:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00d5d0 con 0x7fcea0003a60 2023-10-08T16:06:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f8873fff700 1 --2- 172.21.15.3:0/2866343757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8874155220 0x7f887406bfb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88680099b0 tx=0x7f8868009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449f44d1d642660b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fed097700 1 --2- 172.21.15.3:0/2310072975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe80c77d0 0x7f1fe806c700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009910 tx=0x7f1fd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f7858ac0e2afdd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00d730 con 0x7fcea0003a60 2023-10-08T16:06:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fceb77fe700 1 -- 172.21.15.3:0/1016189829 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00daf0 con 0x7fcea0003a60 2023-10-08T16:06:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f88737fe700 1 -- 172.21.15.3:0/2866343757 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800b860 con 0x7f8874155220 2023-10-08T16:06:49.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fec896700 1 -- 172.21.15.3:0/2310072975 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800c930 con 0x7f1fe80c77d0 2023-10-08T16:06:49.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f88737fe700 1 -- 172.21.15.3:0/2866343757 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800b9c0 con 0x7f8874155220 2023-10-08T16:06:49.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f88737fe700 1 -- 172.21.15.3:0/2866343757 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800bd60 con 0x7f8874155220 2023-10-08T16:06:49.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7f1fec896700 1 -- 172.21.15.3:0/2310072975 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800ca90 con 0x7f1fe80c77d0 2023-10-08T16:06:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 msgr2=0x7fcea0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fceac00bb60 tx=0x7fceac008040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1016189829 shutdown_connections 2023-10-08T16:06:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 --2- 172.21.15.3:0/1016189829 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 Processor -- start 2023-10-08T16:06:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1016189829 >> 172.21.15.3:0/1016189829 conn(0x7fceb8067b30 msgr2=0x7fceb80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f887987f700 1 -- 172.21.15.3:0/2866343757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8874155220 msgr2=0x7f887406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 -- start start 2023-10-08T16:06:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1016189829 shutdown_connections 2023-10-08T16:06:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 -- 172.21.15.3:0/2310072975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe80c77d0 msgr2=0x7f1fe806c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2310072975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe80c77d0 0x7f1fe806c700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009910 tx=0x7f1fd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1016189829 wait complete. 2023-10-08T16:06:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.491+0000 7fcf3d2ea700 1 Processor -- start 2023-10-08T16:06:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 -- start start 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f887987f700 1 --2- 172.21.15.3:0/2866343757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8874155220 0x7f887406bfb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88680099b0 tx=0x7f8868009250 comp rx=0 tx=0).stop 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f887987f700 1 -- 172.21.15.3:0/2866343757 shutdown_connections 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f887987f700 1 --2- 172.21.15.3:0/2866343757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8874155220 0x7f887406bfb0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88680099b0 tx=0x7f8868009250 comp rx=0 tx=0).stop 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f887987f700 1 -- 172.21.15.3:0/2866343757 >> 172.21.15.3:0/2866343757 conn(0x7f88740c83d0 msgr2=0x7f88740c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 -- 172.21.15.3:0/2310072975 shutdown_connections 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2310072975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe80c77d0 0x7f1fe806c700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 -- 172.21.15.3:0/2310072975 >> 172.21.15.3:0/2310072975 conn(0x7f1fe8067b30 msgr2=0x7f1fe80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 -- 172.21.15.3:0/2310072975 shutdown_connections 2023-10-08T16:06:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf3806aad0 0x7fcf3814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 0x7fcf38158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf38156fc0 0x7fcf380c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38166230 con 0x7fcf380c6ae0 2023-10-08T16:06:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38165f50 con 0x7fcf3806aad0 2023-10-08T16:06:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fb069c28700 1 -- 172.21.15.3:0/2486117945 shutdown_connections 2023-10-08T16:06:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380c2b40 con 0x7fcf38156fc0 2023-10-08T16:06:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 0x7fcf38158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 0x7fcf38158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36918/0 (socket says 172.21.15.3:36918) 2023-10-08T16:06:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 -- 172.21.15.3:0/1806369129 learned_addr learned my addr 172.21.15.3:0/1806369129 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf37fff700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf3806aad0 0x7fcf3814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3cae9700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf38156fc0 0x7fcf380c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f410806de10 0x7f4108169500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fb069c28700 1 -- 172.21.15.3:0/2486117945 wait complete. 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41080ca150 0x7f410814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f41080ca520 0x7f410814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410814b0e0 con 0x7f410806de10 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 -- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf38156fc0 msgr2=0x7fcf380c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf38156fc0 0x7fcf380c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 -- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf3806aad0 msgr2=0x7fcf3814aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf3806aad0 0x7fcf3814aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410814b3c0 con 0x7f41080ca150 2023-10-08T16:06:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410e2ba700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410814b6a0 con 0x7f41080ca520 2023-10-08T16:06:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410d2b8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f410806de10 0x7f4108169500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410d2b8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f410806de10 0x7f4108169500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36926/0 (socket says 172.21.15.3:36926) 2023-10-08T16:06:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410d2b8700 1 -- 172.21.15.3:0/1042870453 learned_addr learned my addr 172.21.15.3:0/1042870453 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 -- 172.21.15.3:0/1806369129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c00f610 con 0x7fcf380c6ae0 2023-10-08T16:06:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410dab9700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f41080ca520 0x7f410814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf37fff700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf3806aad0 0x7fcf3814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:49.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41080ca150 0x7f410814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf377fe700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 0x7fcf38158c20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000cec0 tx=0x7fcf30001c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000aaf0 con 0x7fcf380c6ae0 2023-10-08T16:06:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf380c2e20 con 0x7fcf380c6ae0 2023-10-08T16:06:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 -- 172.21.15.3:0/2310072975 wait complete. 2023-10-08T16:06:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 Processor -- start 2023-10-08T16:06:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3814af40 con 0x7fcf380c6ae0 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3000ac50 con 0x7fcf380c6ae0 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300070f0 con 0x7fcf380c6ae0 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 -- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f41080ca520 msgr2=0x7f410814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f41080ca520 0x7f410814a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 -- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f410806de10 msgr2=0x7f4108169500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f410806de10 0x7f4108169500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 -- 172.21.15.3:0/1042870453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8009420 con 0x7f41080ca150 2023-10-08T16:06:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f410cab7700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41080ca150 0x7f410814d260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40f8015000 tx=0x7f40f8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fb069c28700 1 Processor -- start 2023-10-08T16:06:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 -- start start 2023-10-08T16:06:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7f1fefafc700 1 -- start start 2023-10-08T16:06:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 Processor -- start 2023-10-08T16:06:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.495+0000 7fcebeb8b700 1 -- start start 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1fe80c7400 0x7f1fe81420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 0x7f1fe80b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe8149a00 0x7f1fe80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c2460 con 0x7f1fe8154ff0 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8142900 con 0x7f1fe8149a00 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c45c0 con 0x7f1fe80c7400 2023-10-08T16:06:49.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f922404d240 con 0x7f922c155220 2023-10-08T16:06:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fceb814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f801b470 con 0x7f41080ca150 2023-10-08T16:06:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 0x7f1fe80b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 0x7f1fe80b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36932/0 (socket says 172.21.15.3:36932) 2023-10-08T16:06:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 -- 172.21.15.3:0/2796234106 learned_addr learned my addr 172.21.15.3:0/2796234106 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed898700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1fe80c7400 0x7f1fe81420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f801b5d0 con 0x7f41080ca150 2023-10-08T16:06:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 0x7fceb814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fee099700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe8149a00 0x7f1fe80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceb80c38f0 0x7fceb8150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f410e2ba700 1 -- 172.21.15.3:0/1042870453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410814b980 con 0x7f41080ca150 2023-10-08T16:06:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcf300074a0 con 0x7fcf380c6ae0 2023-10-08T16:06:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80c1310 con 0x7fceb80c38f0 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb814b1f0 con 0x7fceb80c02d0 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb814b950 con 0x7fcea0003a60 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 0x7fceb814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 0x7fceb814b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:60028/0 (socket says 172.21.15.3:60028) 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 -- 172.21.15.3:0/1806467927 learned_addr learned my addr 172.21.15.3:0/1806467927 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f801b970 con 0x7f41080ca150 2023-10-08T16:06:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f410e2ba700 1 -- 172.21.15.3:0/1042870453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410814d7a0 con 0x7f41080ca150 2023-10-08T16:06:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 -- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1fe80c7400 msgr2=0x7f1fe81420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1fe80c7400 0x7f1fe81420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 -- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe8149a00 msgr2=0x7f1fe80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe8149a00 0x7f1fe80ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 -- 172.21.15.3:0/2796234106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009420 con 0x7f1fe8154ff0 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 0x7fb06416de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a9e0 0x7fb0640bdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 0x7fb0640bb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640bbe10 con 0x7fb06406a570 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06415a470 con 0x7fb06415d080 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640be450 con 0x7fb06406a9e0 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 0x7fb06416de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 0x7fb06416de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36946/0 (socket says 172.21.15.3:36946) 2023-10-08T16:06:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebc927700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fceb814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 -- 172.21.15.3:0/3772900589 learned_addr learned my addr 172.21.15.3:0/3772900589 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcf1ffff700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcf200606e0 0x7fcf20062b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fed097700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 0x7f1fe80b0870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80098e0 tx=0x7f1fd8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 -- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 msgr2=0x7fceb814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fceb814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 -- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceb80c38f0 msgr2=0x7fceb8150600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:06:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf3007cd20 con 0x7fcf380c6ae0 2023-10-08T16:06:49.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcf37fff700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcf200606e0 0x7fcf20062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 -- 172.21.15.3:0/3772900589 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a9e0 msgr2=0x7fb0640bdd60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a9e0 0x7fb0640bdd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 -- 172.21.15.3:0/3772900589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 msgr2=0x7fb0640bb8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 0x7fb0640bb8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 -- 172.21.15.3:0/3772900589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580094f0 con 0x7fb06406a570 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb0637fe700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 0x7fb06416de50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0640c9060 tx=0x7fb058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f887987f700 1 -- 172.21.15.3:0/2866343757 shutdown_connections 2023-10-08T16:06:49.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebd128700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceb80c38f0 0x7fceb8150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceb80c38f0 0x7fceb8150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 -- 172.21.15.3:0/1806467927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80c42d0 con 0x7fceb80c02d0 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebd128700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceb80c38f0 0x7fceb8150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3804be40 con 0x7fcf380c6ae0 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8026070 con 0x7f1fe8154ff0 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800c020 con 0x7f1fe8154ff0 2023-10-08T16:06:49.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe80c3c90 con 0x7f1fe8154ff0 2023-10-08T16:06:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe80c4250 con 0x7f1fe8154ff0 2023-10-08T16:06:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd801c040 con 0x7f1fe8154ff0 2023-10-08T16:06:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb7fff700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 0x7fceb814b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea800cb40 tx=0x7fcea8001d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f40f801bd20 con 0x7f41080ca150 2023-10-08T16:06:49.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8004b10 con 0x7fceb80c02d0 2023-10-08T16:06:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40fd7fa700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea8004c70 con 0x7fceb80c02d0 2023-10-08T16:06:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8007150 con 0x7fceb80c02d0 2023-10-08T16:06:49.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcf37fff700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcf200606e0 0x7fcf20062b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf28001e10 tx=0x7fcf28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1806467927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb80c09e0 con 0x7fceb80c02d0 2023-10-08T16:06:49.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40f807e3c0 con 0x7f41080ca150 2023-10-08T16:06:49.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fcebeb8b700 1 -- 172.21.15.3:0/1806467927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb80c0fa0 con 0x7fceb80c02d0 2023-10-08T16:06:49.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe804be40 con 0x7f1fe8154ff0 2023-10-08T16:06:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f410d2b8700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e00052b0 con 0x7f41080ca150 2023-10-08T16:06:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f410d2b8700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4104009ac0 tx=0x7f4104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800bbe0 con 0x7fb06406a570 2023-10-08T16:06:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058011420 con 0x7fb06406a570 2023-10-08T16:06:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f887987f700 1 -- 172.21.15.3:0/2866343757 wait complete. 2023-10-08T16:06:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580117c0 con 0x7fb06406a570 2023-10-08T16:06:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 -- 172.21.15.3:0/3772900589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06415a730 con 0x7fb06406a570 2023-10-08T16:06:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.499+0000 7fb069c28700 1 -- 172.21.15.3:0/3772900589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06415acf0 con 0x7fb06406a570 2023-10-08T16:06:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f18d16fa700 1 Processor -- start 2023-10-08T16:06:49.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06415af10 con 0x7fb06406a570 2023-10-08T16:06:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb80c1160 con 0x7fceb80c02d0 2023-10-08T16:06:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f18d16fa700 1 -- start start 2023-10-08T16:06:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcea80074c0 con 0x7fceb80c02d0 2023-10-08T16:06:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1fd8022620 con 0x7f1fe8154ff0 2023-10-08T16:06:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fceb4ff9700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcea4060650 0x7fcea4062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f1fddffb700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1fcc060550 0x7f1fcc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcea807c0e0 con 0x7fceb80c02d0 2023-10-08T16:06:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fcebc927700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcea4060650 0x7fcea4062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd807ed70 con 0x7f1fe8154ff0 2023-10-08T16:06:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f1fed898700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1fcc060550 0x7f1fcc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f887987f700 1 Processor -- start 2023-10-08T16:06:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f887987f700 1 -- start start 2023-10-08T16:06:49.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7fcebc927700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcea4060650 0x7fcea4062b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fceac00bb60 tx=0x7fceac01b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f1fed898700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1fcc060550 0x7f1fcc062a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4003a80 tx=0x7f1fe4007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.503+0000 7f18d16fa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18cc06d1c0 0x7f18cc06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18d16fa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18cc06a570 0x7f18cc154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18d16fa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18d16fa700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc06bb40 con 0x7f18cc06a570 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18d16fa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc155910 con 0x7f18cc06d1c0 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18d16fa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc06bfd0 con 0x7f18cc06a9a0 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18cc06a570 0x7f18cc154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18cc06a570 0x7f18cc154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36962/0 (socket says 172.21.15.3:36962) 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 -- 172.21.15.3:0/1956445957 learned_addr learned my addr 172.21.15.3:0/1956445957 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18d0ef9700 1 --2- 172.21.15.3:0/1956445957 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cbfff700 1 --2- 172.21.15.3:0/1956445957 >> v2:172.21.15.27:3300/0 conn(0x7f18cc06d1c0 0x7f18cc06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 0x7f88741525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 0x7f887415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f887415e160 0x7f88740c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740c2dc0 con 0x7f8874154e50 2023-10-08T16:06:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887415d790 con 0x7f887415e160 2023-10-08T16:06:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887415cb80 con 0x7f88740c8eb0 2023-10-08T16:06:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 -- 172.21.15.3:0/1956445957 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 msgr2=0x7f18cc1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 --2- 172.21.15.3:0/1956445957 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 -- 172.21.15.3:0/1956445957 >> v2:172.21.15.27:3300/0 conn(0x7f18cc06d1c0 msgr2=0x7f18cc06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 --2- 172.21.15.3:0/1956445957 >> v2:172.21.15.27:3300/0 conn(0x7f18cc06d1c0 0x7f18cc06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 -- 172.21.15.3:0/1956445957 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc06af30 con 0x7f18cc06a570 2023-10-08T16:06:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cbfff700 1 --2- 172.21.15.3:0/1956445957 >> v2:172.21.15.27:3300/0 conn(0x7f18cc06d1c0 0x7f18cc06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 0x7f887415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887887d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 0x7f88741525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887887d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 0x7f88741525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:35222/0 (socket says 172.21.15.3:35222) 2023-10-08T16:06:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 0x7f887415dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36978/0 (socket says 172.21.15.3:36978) 2023-10-08T16:06:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887887d700 1 -- 172.21.15.3:0/2018681605 learned_addr learned my addr 172.21.15.3:0/2018681605 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18cb7fe700 1 --2- 172.21.15.3:0/1956445957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06a570 0x7f18cc154e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0698a0 tx=0x7f18c000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40024e112e9e8c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887907e700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f887415e160 0x7f88740c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 -- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 msgr2=0x7f88741525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 0x7f88741525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 -- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f887415e160 msgr2=0x7f88740c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f887415e160 0x7f88740c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 -- 172.21.15.3:0/2018681605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680094f0 con 0x7f8874154e50 2023-10-08T16:06:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887887d700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 0x7f88741525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8873fff700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 0x7f887415dc20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88740cb800 tx=0x7f8868017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf3004d2f0 con 0x7fcf380c6ae0 2023-10-08T16:06:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868011e10 con 0x7f8874154e50 2023-10-08T16:06:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f18caffd700 1 -- 172.21.15.3:0/1956445957 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000db10 con 0x7f18cc06a570 2023-10-08T16:06:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887415ce60 con 0x7f8874154e50 2023-10-08T16:06:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb058011bb0 con 0x7fb06406a570 2023-10-08T16:06:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.507+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887415d420 con 0x7f8874154e50 2023-10-08T16:06:49.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7fb04b7fe700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb050060620 0x7fb050062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7fb062ffd700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb050060620 0x7fb050062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7fb062ffd700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb050060620 0x7fb050062ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb06415a200 tx=0x7fb0540091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f40f802a080 con 0x7f41080ca150 2023-10-08T16:06:49.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868024650 con 0x7f8874154e50 2023-10-08T16:06:49.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868024800 con 0x7f8874154e50 2023-10-08T16:06:49.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb058052fe0 con 0x7fb06406a570 2023-10-08T16:06:49.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fd804f360 con 0x7f1fe8154ff0 2023-10-08T16:06:49.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f18caffd700 1 -- 172.21.15.3:0/1956445957 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c000dc70 con 0x7f18cc06a570 2023-10-08T16:06:49.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f18caffd700 1 -- 172.21.15.3:0/1956445957 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0017410 con 0x7f18cc06a570 2023-10-08T16:06:49.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f18d16fa700 1 -- 172.21.15.3:0/1956445957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06a570 msgr2=0x7f18cc154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.511+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1956445957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06a570 0x7f18cc154e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0698a0 tx=0x7f18c000b4e0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 -- 172.21.15.3:0/1956445957 shutdown_connections 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1956445957 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1956445957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06a570 0x7f18cc154e90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1956445957 >> v2:172.21.15.27:3300/0 conn(0x7f18cc06d1c0 0x7f18cc06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 -- 172.21.15.3:0/1956445957 >> 172.21.15.3:0/1956445957 conn(0x7f18cc0c83d0 msgr2=0x7f18cc0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 -- 172.21.15.3:0/1956445957 shutdown_connections 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 -- 172.21.15.3:0/1956445957 wait complete. 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 Processor -- start 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7f18d16fa700 1 -- start start 2023-10-08T16:06:49.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.515+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcea80502c0 con 0x7fceb80c02d0 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88540052b0 con 0x7f8874154e50 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d16fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18cc06a570 0x7f18cc0c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d16fa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d16fa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 0x7f18cc14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d16fa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc154950 con 0x7f18cc06d1c0 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d16fa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc14cd80 con 0x7f18cc06a570 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d16fa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc14d460 con 0x7f18cc06a9a0 2023-10-08T16:06:49.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 0x7f18cc14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 0x7f18cc14c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36990/0 (socket says 172.21.15.3:36990) 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 -- 172.21.15.3:0/1644504068 learned_addr learned my addr 172.21.15.3:0/1644504068 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18cb7fe700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 -- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 msgr2=0x7f18cc14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 -- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18cc06a570 msgr2=0x7f18cc0c1210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18cc06a570 0x7f18cc0c1210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 -- 172.21.15.3:0/1644504068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c000b780 con 0x7f18cc06d1c0 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.519+0000 7f18d0ef9700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 0x7f18cc14c840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00d8c0 tx=0x7f18bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0125f0 con 0x7f18cc06d1c0 2023-10-08T16:06:49.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc012750 con 0x7f18cc06d1c0 2023-10-08T16:06:49.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb05804ebe0 con 0x7fb06406a570 2023-10-08T16:06:49.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc012b10 con 0x7f18cc06d1c0 2023-10-08T16:06:49.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.527+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc14d740 con 0x7f18cc06d1c0 2023-10-08T16:06:49.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.527+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc14dd00 con 0x7f18cc06d1c0 2023-10-08T16:06:49.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8868024c30 con 0x7f8874154e50 2023-10-08T16:06:49.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f8870ff9700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8860060580 0x7f8860062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f886807e1a0 con 0x7f8874154e50 2023-10-08T16:06:49.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f887887d700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8860060580 0x7f8860062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.523+0000 7f887887d700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8860060580 0x7f8860062a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8864001690 tx=0x7f8864007f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.531+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f886804e7f0 con 0x7f8874154e50 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.535+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18bc01e460 con 0x7f18cc06d1c0 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.535+0000 7f18b3fff700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f18b80605a0 0x7f18b8062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.535+0000 7f18cbfff700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f18b80605a0 0x7f18b8062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.535+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18bc07ccb0 con 0x7f18cc06d1c0 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.535+0000 7f18cbfff700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f18b80605a0 0x7f18b8062a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f18c40094d0 tx=0x7f18c4009610 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.539+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc04be40 con 0x7f18cc06d1c0 2023-10-08T16:06:49.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.551+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18bc050db0 con 0x7f18cc06d1c0 2023-10-08T16:06:49.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.799+0000 7f9230a8b700 1 -- 172.21.15.3:0/3196923930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f922c0c9510 con 0x7f922c155220 2023-10-08T16:06:49.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.799+0000 7f92137fe700 1 -- 172.21.15.3:0/3196923930 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9224050860 con 0x7f922c155220 2023-10-08T16:06:49.806 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 -- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9218060620 msgr2=0x7f9218062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9218060620 0x7f9218062ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f921c0091e0 tx=0x7f921c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 -- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 msgr2=0x7f922c155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 0x7f922c155710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9224001460 tx=0x7f9224001ae0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 -- 172.21.15.3:0/3196923930 shutdown_connections 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9218060620 0x7f9218062ad0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f922c155220 0x7f922c155710 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f922c154e50 0x7f922c14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 --2- 172.21.15.3:0/3196923930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f922c0c79d0 0x7f922c1570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 -- 172.21.15.3:0/3196923930 >> 172.21.15.3:0/3196923930 conn(0x7f922c0c83d0 msgr2=0x7f922c06d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 -- 172.21.15.3:0/3196923930 shutdown_connections 2023-10-08T16:06:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.807+0000 7f92117fa700 1 -- 172.21.15.3:0/3196923930 wait complete. 2023-10-08T16:06:49.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2023-10-08T16:06:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf3806bbc0 con 0x7fcf380c6ae0 2023-10-08T16:06:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf1ffff700 1 -- 172.21.15.3:0/1806369129 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf30050910 con 0x7fcf380c6ae0 2023-10-08T16:06:49.862 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-10-08T16:06:49.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcf200606e0 msgr2=0x7fcf20062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcf200606e0 0x7fcf20062b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf28001e10 tx=0x7fcf28009040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 msgr2=0x7fcf38158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 0x7fcf38158c20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000cec0 tx=0x7fcf30001c20 comp rx=0 tx=0).stop 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 shutdown_connections 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcf200606e0 0x7fcf20062b90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcf38156fc0 0x7fcf380c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf380c6ae0 0x7fcf38158c20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 --2- 172.21.15.3:0/1806369129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf3806aad0 0x7fcf3814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 >> 172.21.15.3:0/1806369129 conn(0x7fcf380c83d0 msgr2=0x7fcf380c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 shutdown_connections 2023-10-08T16:06:49.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.823+0000 7fcf3d2ea700 1 -- 172.21.15.3:0/1806369129 wait complete. 2023-10-08T16:06:49.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.827+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fceb80c14c0 con 0x7fceb80c02d0 2023-10-08T16:06:49.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.827+0000 7fceb4ff9700 1 -- 172.21.15.3:0/1806467927 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fceb80c14c0 con 0x7fceb80c02d0 2023-10-08T16:06:49.864 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:49.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcea4060650 msgr2=0x7fcea4062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcea4060650 0x7fcea4062b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fceac00bb60 tx=0x7fceac01b000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 msgr2=0x7fceb814b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 0x7fceb814b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea800cb40 tx=0x7fcea8001d20 comp rx=0 tx=0).stop 2023-10-08T16:06:49.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f40e0005830 con 0x7f41080ca150 2023-10-08T16:06:49.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 shutdown_connections 2023-10-08T16:06:49.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcea4060650 0x7fcea4062b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceb80c38f0 0x7fceb8150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fceb80c02d0 0x7fceb814b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 --2- 172.21.15.3:0/1806467927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcea0003a60 0x7fceb814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 >> 172.21.15.3:0/1806467927 conn(0x7fceb8067b30 msgr2=0x7fceb80c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 shutdown_connections 2023-10-08T16:06:49.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7fce9e7fc700 1 -- 172.21.15.3:0/1806467927 wait complete. 2023-10-08T16:06:49.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7f40fd7fa700 1 -- 172.21.15.3:0/1042870453 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40f804ea30 con 0x7f41080ca150 2023-10-08T16:06:49.872 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-10-08T16:06:49.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1fe80c4700 con 0x7f1fe8154ff0 2023-10-08T16:06:49.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.831+0000 7f1fddffb700 1 -- 172.21.15.3:0/2796234106 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fd8052980 con 0x7f1fe8154ff0 2023-10-08T16:06:49.873 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 msgr2=0x7f40ec062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4104009ac0 tx=0x7f4104008040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41080ca150 msgr2=0x7f410814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41080ca150 0x7f410814d260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40f8015000 tx=0x7f40f8016000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 shutdown_connections 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f40ec060620 0x7f40ec062ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f41080ca520 0x7f410814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41080ca150 0x7f410814d260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 --2- 172.21.15.3:0/1042870453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f410806de10 0x7f4108169500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 >> 172.21.15.3:0/1042870453 conn(0x7f41080c83d0 msgr2=0x7f410815d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 shutdown_connections 2023-10-08T16:06:49.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1fcc060550 msgr2=0x7f1fcc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f40f2ffd700 1 -- 172.21.15.3:0/1042870453 wait complete. 2023-10-08T16:06:49.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1fcc060550 0x7f1fcc062a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4003a80 tx=0x7f1fe4007ec0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 msgr2=0x7f1fe80b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 0x7f1fe80b0870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80098e0 tx=0x7f1fd8018000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 shutdown_connections 2023-10-08T16:06:49.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1fcc060550 0x7f1fcc062a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fe8149a00 0x7f1fe80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8154ff0 0x7f1fe80b0870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 --2- 172.21.15.3:0/2796234106 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1fe80c7400 0x7f1fe81420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 >> 172.21.15.3:0/2796234106 conn(0x7f1fe8067b30 msgr2=0x7f1fe806ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 shutdown_connections 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.835+0000 7f1fefafc700 1 -- 172.21.15.3:0/2796234106 wait complete. 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.839+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb06404be40 con 0x7fb06406a570 2023-10-08T16:06:49.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.839+0000 7fb04b7fe700 1 -- 172.21.15.3:0/3772900589 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb058015020 con 0x7fb06406a570 2023-10-08T16:06:49.878 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:49.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2023-10-08T16:06:49.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb050060620 msgr2=0x7fb050062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb050060620 0x7fb050062ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb06415a200 tx=0x7fb0540091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 msgr2=0x7fb06416de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 0x7fb06416de50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0640c9060 tx=0x7fb058017000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 shutdown_connections 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb050060620 0x7fb050062ad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06415d080 0x7fb0640bb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb06406a9e0 0x7fb0640bdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 --2- 172.21.15.3:0/3772900589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb06406a570 0x7fb06416de50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 >> 172.21.15.3:0/3772900589 conn(0x7fb064067060 msgr2=0x7fb0640c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 shutdown_connections 2023-10-08T16:06:49.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.843+0000 7fb0497fa700 1 -- 172.21.15.3:0/3772900589 wait complete. 2023-10-08T16:06:49.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2023-10-08T16:06:49.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2023-10-08T16:06:49.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2023-10-08T16:06:49.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.851+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8854005830 con 0x7f8874154e50 2023-10-08T16:06:49.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2023-10-08T16:06:49.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f8870ff9700 1 -- 172.21.15.3:0/2018681605 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f886802ce90 con 0x7f8874154e50 2023-10-08T16:06:49.884 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8860060580 msgr2=0x7f8860062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8860060580 0x7f8860062a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8864001690 tx=0x7f8864007f70 comp rx=0 tx=0).stop 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 msgr2=0x7f887415dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 0x7f887415dc20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88740cb800 tx=0x7f8868017000 comp rx=0 tx=0).stop 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 shutdown_connections 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8860060580 0x7f8860062a30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f887415e160 0x7f88740c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8874154e50 0x7f887415dc20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 --2- 172.21.15.3:0/2018681605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f88740c8eb0 0x7f88741525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 >> 172.21.15.3:0/2018681605 conn(0x7f88740c83d0 msgr2=0x7f88740c15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 shutdown_connections 2023-10-08T16:06:49.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.855+0000 7f887987f700 1 -- 172.21.15.3:0/2018681605 wait complete. 2023-10-08T16:06:49.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.867+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18cc06b210 con 0x7f18cc06d1c0 2023-10-08T16:06:49.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.867+0000 7f18b3fff700 1 -- 172.21.15.3:0/1644504068 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18bc050940 con 0x7f18cc06d1c0 2023-10-08T16:06:49.887 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-10-08T16:06:49.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2023-10-08T16:06:49.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f18b80605a0 msgr2=0x7f18b8062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f18b80605a0 0x7f18b8062a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f18c40094d0 tx=0x7f18c4009610 comp rx=0 tx=0).stop 2023-10-08T16:06:49.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 msgr2=0x7f18cc14c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 0x7f18cc14c840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00d8c0 tx=0x7f18bc008040 comp rx=0 tx=0).stop 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 shutdown_connections 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f18b80605a0 0x7f18b8062a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18cc06d1c0 0x7f18cc14c840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18cc06a9a0 0x7f18cc14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 --2- 172.21.15.3:0/1644504068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18cc06a570 0x7f18cc0c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 >> 172.21.15.3:0/1644504068 conn(0x7f18cc0c83d0 msgr2=0x7f18cc0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 shutdown_connections 2023-10-08T16:06:49.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:49.871+0000 7f18d16fa700 1 -- 172.21.15.3:0/1644504068 wait complete. 2023-10-08T16:06:49.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2023-10-08T16:06:50.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:06:50.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:06:50.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:06:50.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:06:50.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:06:50.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:06:50.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:06:50.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:06:51.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd062626700 1 Processor -- start 2023-10-08T16:06:51.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd062626700 1 -- start start 2023-10-08T16:06:51.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd062626700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd05c155220 0x7fd05c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd062626700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c06ad00 con 0x7fd05c154e50 2023-10-08T16:06:51.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd062626700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c06bb20 con 0x7fd05c0ca080 2023-10-08T16:06:51.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd062626700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c06af30 con 0x7fd05c155220 2023-10-08T16:06:51.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd061624700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd05c154e50 0x7fd05c0c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51488/0 (socket says 172.21.15.3:51488) 2023-10-08T16:06:51.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd061624700 1 -- 172.21.15.3:0/1176938280 learned_addr learned my addr 172.21.15.3:0/1176938280 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd060e23700 1 --2- 172.21.15.3:0/1176938280 >> v2:172.21.15.27:3300/0 conn(0x7fd05c155220 0x7fd05c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd060e23700 1 -- 172.21.15.3:0/1176938280 >> v1:172.21.15.27:6789/0 conn(0x7fd05c0ca080 legacy=0x7fd05c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd060e23700 1 -- 172.21.15.3:0/1176938280 >> v1:172.21.15.3:6789/0 conn(0x7fd05c154e50 legacy=0x7fd05c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd060e23700 1 -- 172.21.15.3:0/1176938280 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c06b1f0 con 0x7fd05c155220 2023-10-08T16:06:51.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd060e23700 1 --2- 172.21.15.3:0/1176938280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c155220 0x7fd05c06bfb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd05400d300 tx=0x7fd054007620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4acec89b70acb01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd053fff700 1 -- 172.21.15.3:0/1176938280 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054010070 con 0x7fd05c155220 2023-10-08T16:06:51.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd053fff700 1 -- 172.21.15.3:0/1176938280 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400dcb0 con 0x7fd05c155220 2023-10-08T16:06:51.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:50.999+0000 7fd053fff700 1 -- 172.21.15.3:0/1176938280 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054007ab0 con 0x7fd05c155220 2023-10-08T16:06:51.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 -- 172.21.15.3:0/1176938280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c155220 msgr2=0x7fd05c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 --2- 172.21.15.3:0/1176938280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c155220 0x7fd05c06bfb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd05400d300 tx=0x7fd054007620 comp rx=0 tx=0).stop 2023-10-08T16:06:51.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 -- 172.21.15.3:0/1176938280 shutdown_connections 2023-10-08T16:06:51.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 --2- 172.21.15.3:0/1176938280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c155220 0x7fd05c06bfb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 -- 172.21.15.3:0/1176938280 >> 172.21.15.3:0/1176938280 conn(0x7fd05c0c83d0 msgr2=0x7fd05c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 -- 172.21.15.3:0/1176938280 shutdown_connections 2023-10-08T16:06:51.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 -- 172.21.15.3:0/1176938280 wait complete. 2023-10-08T16:06:51.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 Processor -- start 2023-10-08T16:06:51.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.003+0000 7fd062626700 1 -- start start 2023-10-08T16:06:51.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c0ca080 0x7fd05c1691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 0x7fd05c16bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 0x7fd05c16bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 0x7fd05c16bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42486/0 (socket says 172.21.15.3:42486) 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd05c155220 0x7fd05c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd061624700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c0ca080 0x7fd05c1691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd061624700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c0ca080 0x7fd05c1691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:40424/0 (socket says 172.21.15.3:40424) 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1761e0 con 0x7fd05c154e50 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c176760 con 0x7fd05c0ca080 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0c32b0 con 0x7fd05c155220 2023-10-08T16:06:51.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 -- 172.21.15.3:0/2043136746 learned_addr learned my addr 172.21.15.3:0/2043136746 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 -- 172.21.15.3:0/2043136746 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd05c155220 msgr2=0x7fd05c153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd05c155220 0x7fd05c153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 -- 172.21.15.3:0/2043136746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c0ca080 msgr2=0x7fd05c1691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c0ca080 0x7fd05c1691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 -- 172.21.15.3:0/2043136746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540078c0 con 0x7fd05c154e50 2023-10-08T16:06:51.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd060e23700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 0x7fd05c16bd40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd054008000 tx=0x7fd054019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054000f40 con 0x7fd05c154e50 2023-10-08T16:06:51.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd054016440 con 0x7fd05c154e50 2023-10-08T16:06:51.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0540010a0 con 0x7fd05c154e50 2023-10-08T16:06:51.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 -- 172.21.15.3:0/2043136746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c0c3590 con 0x7fd05c154e50 2023-10-08T16:06:51.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.007+0000 7fd062626700 1 -- 172.21.15.3:0/2043136746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c1763f0 con 0x7fd05c154e50 2023-10-08T16:06:51.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.011+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd054016a90 con 0x7fd05c154e50 2023-10-08T16:06:51.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.011+0000 7fd0517fa700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd040060620 0x7fd040062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.011+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd05407ded0 con 0x7fd05c154e50 2023-10-08T16:06:51.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.011+0000 7fd061624700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd040060620 0x7fd040062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.011+0000 7fd061624700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd040060620 0x7fd040062ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd05c06e2d0 tx=0x7fd058009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.019+0000 7fd062626700 1 -- 172.21.15.3:0/2043136746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c04be40 con 0x7fd05c154e50 2023-10-08T16:06:51.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.023+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd05404e540 con 0x7fd05c154e50 2023-10-08T16:06:51.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f944093b700 1 Processor -- start 2023-10-08T16:06:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f944093b700 1 -- start start 2023-10-08T16:06:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f944093b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f944093b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c06ad00 con 0x7f943c154e50 2023-10-08T16:06:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f944093b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c06bb20 con 0x7f943c155220 2023-10-08T16:06:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f944093b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c06af30 con 0x7f943c0ca790 2023-10-08T16:06:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f943bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f943bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c06bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:39854/0 (socket says 172.21.15.3:39854) 2023-10-08T16:06:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f943bfff700 1 -- 172.21.15.3:0/3021905250 learned_addr learned my addr 172.21.15.3:0/3021905250 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f943bfff700 1 -- 172.21.15.3:0/3021905250 >> v1:172.21.15.27:6789/0 conn(0x7f943c155220 legacy=0x7f943c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f943bfff700 1 -- 172.21.15.3:0/3021905250 >> v1:172.21.15.3:6789/0 conn(0x7f943c154e50 legacy=0x7f943c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.031+0000 7f943bfff700 1 -- 172.21.15.3:0/3021905250 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c06b1f0 con 0x7f943c0ca790 2023-10-08T16:06:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f943bfff700 1 --2- 172.21.15.3:0/3021905250 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c06bfb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f943400d1d0 tx=0x7f9434007690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6a310fc3d0d02e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f943a7fc700 1 -- 172.21.15.3:0/3021905250 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434010070 con 0x7f943c0ca790 2023-10-08T16:06:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f943a7fc700 1 -- 172.21.15.3:0/3021905250 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400dca0 con 0x7f943c0ca790 2023-10-08T16:06:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 -- 172.21.15.3:0/3021905250 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 msgr2=0x7f943c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 --2- 172.21.15.3:0/3021905250 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c06bfb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f943400d1d0 tx=0x7f9434007690 comp rx=0 tx=0).stop 2023-10-08T16:06:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 -- 172.21.15.3:0/3021905250 shutdown_connections 2023-10-08T16:06:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 --2- 172.21.15.3:0/3021905250 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c06bfb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 -- 172.21.15.3:0/3021905250 >> 172.21.15.3:0/3021905250 conn(0x7f943c0c83d0 msgr2=0x7f943c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 -- 172.21.15.3:0/3021905250 shutdown_connections 2023-10-08T16:06:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.035+0000 7f944093b700 1 -- 172.21.15.3:0/3021905250 wait complete. 2023-10-08T16:06:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 Processor -- start 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 -- start start 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f943c154e50 0x7f943c178e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f943c155220 0x7f943c1769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c1793c0 con 0x7f943c155220 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c4d60 con 0x7f943c154e50 2023-10-08T16:06:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c4470 con 0x7f943c0ca790 2023-10-08T16:06:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f943c155220 0x7f943c1769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f943c155220 0x7f943c1769d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42494/0 (socket says 172.21.15.3:42494) 2023-10-08T16:06:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943bfff700 1 -- 172.21.15.3:0/100268482 learned_addr learned my addr 172.21.15.3:0/100268482 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943affd700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f943c154e50 0x7f943c178e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 -- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f943c154e50 msgr2=0x7f943c178e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f943c154e50 0x7f943c178e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 -- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f943c155220 msgr2=0x7f943c1769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f943c155220 0x7f943c1769d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 -- 172.21.15.3:0/100268482 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943400be70 con 0x7f943c0ca790 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f943b7fe700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c0c3a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f943000c510 tx=0x7f9430007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000ce80 con 0x7f943c0ca790 2023-10-08T16:06:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430011590 con 0x7f943c0ca790 2023-10-08T16:06:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c176f10 con 0x7f943c0ca790 2023-10-08T16:06:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430011950 con 0x7f943c0ca790 2023-10-08T16:06:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.039+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0c49f0 con 0x7f943c0ca790 2023-10-08T16:06:51.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.043+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c04be40 con 0x7f943c0ca790 2023-10-08T16:06:51.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.043+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9430011d40 con 0x7f943c0ca790 2023-10-08T16:06:51.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.043+0000 7f94237fe700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9428060550 0x7f9428062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.043+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f943007bbe0 con 0x7f943c0ca790 2023-10-08T16:06:51.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.043+0000 7f943affd700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9428060550 0x7f9428062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.043+0000 7f943affd700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9428060550 0x7f9428062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f943c177130 tx=0x7f942c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.055+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f943004c1d0 con 0x7f943c0ca790 2023-10-08T16:06:51.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.059+0000 7f1598dae700 1 Processor -- start 2023-10-08T16:06:51.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 Processor -- start 2023-10-08T16:06:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.059+0000 7f1598dae700 1 -- start start 2023-10-08T16:06:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f1598dae700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1594154df0 0x7f159406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f1598dae700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159406d2e0 con 0x7f15941551c0 2023-10-08T16:06:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f1598dae700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940c7710 con 0x7f15940c8b80 2023-10-08T16:06:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f1598dae700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159406c9b0 con 0x7f1594154df0 2023-10-08T16:06:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 -- start start 2023-10-08T16:06:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc380ae0f0 0x7fcc3815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc3806c700 0x7fcc3806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3806ba40 con 0x7fcc380c65d0 2023-10-08T16:06:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3815d8f0 con 0x7fcc3806c700 2023-10-08T16:06:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3e7cb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3806bed0 con 0x7fcc380ae0f0 2023-10-08T16:06:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f1591d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f15941551c0 0x7f15940c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51514/0 (socket says 172.21.15.3:51514) 2023-10-08T16:06:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f1591d9b700 1 -- 172.21.15.3:0/2666938162 learned_addr learned my addr 172.21.15.3:0/2666938162 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159259c700 1 --2- 172.21.15.3:0/2666938162 >> v2:172.21.15.27:3300/0 conn(0x7f1594154df0 0x7f159406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc377fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcc380c65d0 0x7fcc380c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:50620/0 (socket says 172.21.15.3:50620) 2023-10-08T16:06:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc377fe700 1 -- 172.21.15.3:0/2209002896 learned_addr learned my addr 172.21.15.3:0/2209002896 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3cd68700 1 --2- 172.21.15.3:0/2209002896 >> v2:172.21.15.3:3300/0 conn(0x7fcc3806c700 0x7fcc3806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286885601 0 0) 0x7f159406d2e0 con 0x7f15941551c0 2023-10-08T16:06:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f157c003570 con 0x7f15941551c0 2023-10-08T16:06:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc37fff700 1 --2- 172.21.15.3:0/2209002896 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc380ae0f0 0x7fcc3815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19646763 0 0) 0x7f15940c7710 con 0x7f15940c8b80 2023-10-08T16:06:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f159406d2e0 con 0x7f15940c8b80 2023-10-08T16:06:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159259c700 1 -- 172.21.15.3:0/2666938162 >> v1:172.21.15.27:6789/0 conn(0x7f15940c8b80 legacy=0x7f15940c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159259c700 1 -- 172.21.15.3:0/2666938162 >> v1:172.21.15.3:6789/0 conn(0x7f15941551c0 legacy=0x7f15940c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159259c700 1 -- 172.21.15.3:0/2666938162 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159406cc90 con 0x7f1594154df0 2023-10-08T16:06:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc36ffd700 1 -- 172.21.15.3:0/2209002896 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561395734 0 0) 0x7fcc3806ba40 con 0x7fcc380c65d0 2023-10-08T16:06:51.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f6131e32700 1 Processor -- start 2023-10-08T16:06:51.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc36ffd700 1 -- 172.21.15.3:0/2209002896 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc20003570 con 0x7fcc380c65d0 2023-10-08T16:06:51.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f6131e32700 1 -- start start 2023-10-08T16:06:51.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3cd68700 1 -- 172.21.15.3:0/2209002896 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc380ae0f0 msgr2=0x7fcc3815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3cd68700 1 --2- 172.21.15.3:0/2209002896 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc380ae0f0 0x7fcc3815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3cd68700 1 -- 172.21.15.3:0/2209002896 >> v1:172.21.15.27:6789/0 conn(0x7fcc380c65d0 legacy=0x7fcc380c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3cd68700 1 -- 172.21.15.3:0/2209002896 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380ae4c0 con 0x7fcc3806c700 2023-10-08T16:06:51.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7fcc3cd68700 1 --2- 172.21.15.3:0/2209002896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc3806c700 0x7fcc3806cb70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009b40 tx=0x7fcc280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e661e9d6b3c94e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159259c700 1 --2- 172.21.15.3:0/2666938162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1594154df0 0x7f159406d770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f158800aa90 tx=0x7f158800a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46484258cad7c5c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800c970 con 0x7f1594154df0 2023-10-08T16:06:51.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800cad0 con 0x7f1594154df0 2023-10-08T16:06:51.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.063+0000 7f159159a700 1 -- 172.21.15.3:0/2666938162 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800ce70 con 0x7f1594154df0 2023-10-08T16:06:51.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f612c1551c0 0x7f612c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c06d2e0 con 0x7f612c0c89b0 2023-10-08T16:06:51.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc36ffd700 1 -- 172.21.15.3:0/2209002896 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c001470 con 0x7fcc3806c700 2023-10-08T16:06:51.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 -- 172.21.15.3:0/2666938162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1594154df0 msgr2=0x7f159406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 --2- 172.21.15.3:0/2666938162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1594154df0 0x7f159406d770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f158800aa90 tx=0x7f158800a330 comp rx=0 tx=0).stop 2023-10-08T16:06:51.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0c7710 con 0x7f612c154df0 2023-10-08T16:06:51.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c06de80 con 0x7f612c1551c0 2023-10-08T16:06:51.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 -- 172.21.15.3:0/2666938162 shutdown_connections 2023-10-08T16:06:51.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 --2- 172.21.15.3:0/2666938162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1594154df0 0x7f159406d770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 -- 172.21.15.3:0/2666938162 >> 172.21.15.3:0/2666938162 conn(0x7f1594067060 msgr2=0x7f1594067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc36ffd700 1 -- 172.21.15.3:0/2209002896 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800b550 con 0x7fcc3806c700 2023-10-08T16:06:51.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f612c0c89b0 0x7f612c0c6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51530/0 (socket says 172.21.15.3:51530) 2023-10-08T16:06:51.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612bfff700 1 -- 172.21.15.3:0/149291375 learned_addr learned my addr 172.21.15.3:0/149291375 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612affd700 1 --2- 172.21.15.3:0/149291375 >> v2:172.21.15.27:3300/0 conn(0x7f612c1551c0 0x7f612c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612a7fc700 1 -- 172.21.15.3:0/149291375 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132510284 0 0) 0x7f612c06d2e0 con 0x7f612c0c89b0 2023-10-08T16:06:51.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612a7fc700 1 -- 172.21.15.3:0/149291375 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6114003570 con 0x7f612c0c89b0 2023-10-08T16:06:51.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 -- 172.21.15.3:0/2666938162 shutdown_connections 2023-10-08T16:06:51.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc36ffd700 1 -- 172.21.15.3:0/2209002896 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800b6e0 con 0x7fcc3806c700 2023-10-08T16:06:51.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612affd700 1 -- 172.21.15.3:0/149291375 >> v1:172.21.15.27:6789/0 conn(0x7f612c154df0 legacy=0x7f612c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612affd700 1 -- 172.21.15.3:0/149291375 >> v1:172.21.15.3:6789/0 conn(0x7f612c0c89b0 legacy=0x7f612c0c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612affd700 1 -- 172.21.15.3:0/149291375 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c06c9b0 con 0x7f612c1551c0 2023-10-08T16:06:51.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 -- 172.21.15.3:0/2666938162 wait complete. 2023-10-08T16:06:51.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/2209002896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc3806c700 msgr2=0x7fcc3806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/2209002896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc3806c700 0x7fcc3806cb70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009b40 tx=0x7fcc280091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612affd700 1 --2- 172.21.15.3:0/149291375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c1551c0 0x7f612c0c8470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f612400ae00 tx=0x7f612400a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9959dc204fa0abbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/2209002896 shutdown_connections 2023-10-08T16:06:51.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/2209002896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc3806c700 0x7fcc3806cb70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/2209002896 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc380ae0f0 0x7fcc3815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/2209002896 >> 172.21.15.3:0/2209002896 conn(0x7fcc38067b30 msgr2=0x7fcc380cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/2209002896 shutdown_connections 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612a7fc700 1 -- 172.21.15.3:0/149291375 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124015440 con 0x7f612c1551c0 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612a7fc700 1 -- 172.21.15.3:0/149291375 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240155a0 con 0x7f612c1551c0 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f612a7fc700 1 -- 172.21.15.3:0/149291375 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124015960 con 0x7f612c1551c0 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- 172.21.15.3:0/149291375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c1551c0 msgr2=0x7f612c0c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 --2- 172.21.15.3:0/149291375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c1551c0 0x7f612c0c8470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f612400ae00 tx=0x7f612400a6a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- 172.21.15.3:0/149291375 shutdown_connections 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 --2- 172.21.15.3:0/149291375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c1551c0 0x7f612c0c8470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- 172.21.15.3:0/149291375 >> 172.21.15.3:0/149291375 conn(0x7f612c067060 msgr2=0x7f612c067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- 172.21.15.3:0/149291375 shutdown_connections 2023-10-08T16:06:51.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f6131e32700 1 -- 172.21.15.3:0/149291375 wait complete. 2023-10-08T16:06:51.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7f1598dae700 1 Processor -- start 2023-10-08T16:06:51.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/2209002896 wait complete. 2023-10-08T16:06:51.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 Processor -- start 2023-10-08T16:06:51.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 -- start start 2023-10-08T16:06:51.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 -- start start 2023-10-08T16:06:51.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc3806c700 0x7fcc3815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc380ae0f0 0x7fcc381598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 0x7fcc380c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815d5c0 con 0x7fcc380c65d0 2023-10-08T16:06:51.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380c46e0 con 0x7fcc380ae0f0 2023-10-08T16:06:51.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3e7cb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380a4600 con 0x7fcc3806c700 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 Processor -- start 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 -- start start 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c0c89b0 0x7f612c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f612c154df0 0x7f612c14eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612c1551c0 0x7f612c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1695a0 con 0x7f612c1551c0 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c168990 con 0x7f612c0c89b0 2023-10-08T16:06:51.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f6131e32700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c168c70 con 0x7f612c154df0 2023-10-08T16:06:51.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15940c8b80 0x7f15941570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 0x7f159416ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f15941551c0 0x7f1594155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594158120 con 0x7f1594154df0 2023-10-08T16:06:51.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594157600 con 0x7f15940c8b80 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1594157880 con 0x7f15941551c0 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 0x7f159416ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 0x7f159416ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42524/0 (socket says 172.21.15.3:42524) 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 -- 172.21.15.3:0/3422584732 learned_addr learned my addr 172.21.15.3:0/3422584732 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f159259c700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15940c8b80 0x7f15941570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1592d9d700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f15941551c0 0x7f1594155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc377fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc380ae0f0 0x7fcc381598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 0x7fcc380c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc3806c700 0x7fcc3815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 0x7fcc380c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42508/0 (socket says 172.21.15.3:42508) 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 -- 172.21.15.3:0/3543740871 learned_addr learned my addr 172.21.15.3:0/3543740871 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc3806c700 0x7fcc3815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:39880/0 (socket says 172.21.15.3:39880) 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 -- 172.21.15.3:0/3543740871 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc3806c700 msgr2=0x7fcc3815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc3806c700 0x7fcc3815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 -- 172.21.15.3:0/3543740871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc380ae0f0 msgr2=0x7fcc381598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc380ae0f0 0x7fcc381598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 -- 172.21.15.3:0/3543740871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28009420 con 0x7fcc380c65d0 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 -- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f15941551c0 msgr2=0x7f1594155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f15941551c0 0x7f1594155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 -- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15940c8b80 msgr2=0x7f15941570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15940c8b80 0x7f15941570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 -- 172.21.15.3:0/3422584732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158800a5d0 con 0x7f1594154df0 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1592d9d700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f15941551c0 0x7f1594155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:51.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612affd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f612c154df0 0x7f612c14eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc3cd68700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 0x7fcc380c4ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3c0 tx=0x7fcc28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612affd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f612c154df0 0x7f612c14eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:39898/0 (socket says 172.21.15.3:39898) 2023-10-08T16:06:51.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612c1551c0 0x7f612c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612affd700 1 -- 172.21.15.3:0/2081927130 learned_addr learned my addr 172.21.15.3:0/2081927130 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1591d9b700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 0x7f159416ed40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f158401d7a0 tx=0x7f1584007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612b7fe700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c0c89b0 0x7f612c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584005b30 con 0x7f1594154df0 2023-10-08T16:06:51.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584005c90 con 0x7f1594154df0 2023-10-08T16:06:51.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 -- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f612c154df0 msgr2=0x7f612c14eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f612c154df0 0x7f612c14eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 -- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c0c89b0 msgr2=0x7f612c14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c0c89b0 0x7f612c14dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 -- 172.21.15.3:0/2081927130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612400a940 con 0x7f612c1551c0 2023-10-08T16:06:51.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1594157b60 con 0x7f1594154df0 2023-10-08T16:06:51.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840072e0 con 0x7f1594154df0 2023-10-08T16:06:51.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15941557b0 con 0x7f1594154df0 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 Processor -- start 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 -- start start 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efc280c88a0 0x7efc280aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc2806a570 0x7efc2806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2806cf40 con 0x7efc280868a0 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2806da10 con 0x7efc280c88a0 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2d1b7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280abfb0 con 0x7efc2806a570 2023-10-08T16:06:51.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc26d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7efc280868a0 0x7efc280c8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51542/0 (socket says 172.21.15.3:51542) 2023-10-08T16:06:51.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc26d9d700 1 -- 172.21.15.3:0/3463799904 learned_addr learned my addr 172.21.15.3:0/3463799904 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2659c700 1 --2- 172.21.15.3:0/3463799904 >> v2:172.21.15.27:3300/0 conn(0x7efc280c88a0 0x7efc280aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc2759e700 1 --2- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc2806a570 0x7efc2806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.067+0000 7efc25d9b700 1 -- 172.21.15.3:0/3463799904 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639929988 0 0) 0x7efc2806cf40 con 0x7efc280868a0 2023-10-08T16:06:51.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7efc25d9b700 1 -- 172.21.15.3:0/3463799904 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc10003550 con 0x7efc280868a0 2023-10-08T16:06:51.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28011e90 con 0x7fcc380c65d0 2023-10-08T16:06:51.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800b6c0 con 0x7fcc380c65d0 2023-10-08T16:06:51.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2801c690 con 0x7fcc380c65d0 2023-10-08T16:06:51.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc380a48e0 con 0x7fcc380c65d0 2023-10-08T16:06:51.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc38159df0 con 0x7fcc380c65d0 2023-10-08T16:06:51.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2659c700 1 -- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc2806a570 msgr2=0x7efc2806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2659c700 1 --2- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc2806a570 0x7efc2806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2659c700 1 -- 172.21.15.3:0/3463799904 >> v1:172.21.15.3:6789/0 conn(0x7efc280868a0 legacy=0x7efc280c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2659c700 1 -- 172.21.15.3:0/3463799904 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280c6270 con 0x7efc280c88a0 2023-10-08T16:06:51.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2659c700 1 --2- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280c88a0 0x7efc280aba70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc2000af20 tx=0x7efc2000c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5711c45d42cc58a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc25d9b700 1 -- 172.21.15.3:0/3463799904 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000a2e0 con 0x7efc280c88a0 2023-10-08T16:06:51.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1594155610 con 0x7f1594154df0 2023-10-08T16:06:51.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.071+0000 7f612bfff700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612c1551c0 0x7f612c14f090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61200058d0 tx=0x7f6120007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc25d9b700 1 -- 172.21.15.3:0/3463799904 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2000b920 con 0x7efc280c88a0 2023-10-08T16:06:51.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc25d9b700 1 -- 172.21.15.3:0/3463799904 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000bce0 con 0x7efc280c88a0 2023-10-08T16:06:51.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 -- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280c88a0 msgr2=0x7efc280aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280c88a0 0x7efc280aba70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc2000af20 tx=0x7efc2000c040 comp rx=0 tx=0).stop 2023-10-08T16:06:51.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120005b30 con 0x7f612c1551c0 2023-10-08T16:06:51.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c168f50 con 0x7f612c1551c0 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c14e4e0 con 0x7f612c1551c0 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120005c90 con 0x7f612c1551c0 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 -- 172.21.15.3:0/3463799904 shutdown_connections 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc2806a570 0x7efc2806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/3463799904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280c88a0 0x7efc280aba70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 -- 172.21.15.3:0/3463799904 >> 172.21.15.3:0/3463799904 conn(0x7efc28067060 msgr2=0x7efc28067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcc2801ca80 con 0x7fcc380c65d0 2023-10-08T16:06:51.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 -- 172.21.15.3:0/3463799904 shutdown_connections 2023-10-08T16:06:51.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61200072e0 con 0x7f612c1551c0 2023-10-08T16:06:51.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7efc2d1b7700 1 -- 172.21.15.3:0/3463799904 wait complete. 2023-10-08T16:06:51.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7fcc1ffff700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcc24060620 0x7fcc24062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.075+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc2807e0a0 con 0x7fcc380c65d0 2023-10-08T16:06:51.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 Processor -- start 2023-10-08T16:06:51.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc180052b0 con 0x7fcc380c65d0 2023-10-08T16:06:51.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7fcc37fff700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcc24060620 0x7fcc24062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c0052b0 con 0x7f612c1551c0 2023-10-08T16:06:51.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1584007690 con 0x7f1594154df0 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7fcc37fff700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcc24060620 0x7fcc24062ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000f570 tx=0x7fcc3000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 -- start start 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 0x7efc28168eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280868a0 0x7efc280a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc280c88a0 0x7efc280ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28175d50 con 0x7efc2806a570 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280c51a0 con 0x7efc280868a0 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2d1b7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280c5480 con 0x7efc280c88a0 2023-10-08T16:06:51.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 0x7efc28168eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 0x7efc28168eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42554/0 (socket says 172.21.15.3:42554) 2023-10-08T16:06:51.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 -- 172.21.15.3:0/460053698 learned_addr learned my addr 172.21.15.3:0/460053698 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2759e700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc280c88a0 0x7efc280ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc2659c700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280868a0 0x7efc280a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6120007690 con 0x7f612c1551c0 2023-10-08T16:06:51.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 -- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc280c88a0 msgr2=0x7efc280ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc280c88a0 0x7efc280ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 -- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280868a0 msgr2=0x7efc280a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280868a0 0x7efc280a55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 -- 172.21.15.3:0/460053698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2000aa30 con 0x7efc2806a570 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f15827fc700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1574060550 0x7f1574062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f158408d260 con 0x7f1594154df0 2023-10-08T16:06:51.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f159259c700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1574060550 0x7f1574062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f159259c700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1574060550 0x7f1574062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f158800a5a0 tx=0x7f158801a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7fa96bee2700 1 Processor -- start 2023-10-08T16:06:51.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7fa96bee2700 1 -- start start 2023-10-08T16:06:51.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7efc26d9d700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 0x7efc28168eb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c590 tx=0x7efc1c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f61137fe700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6118060580 0x7f6118062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f612b7fe700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6118060580 0x7f6118062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.079+0000 7f612b7fe700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6118060580 0x7f6118062a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f611c000c00 tx=0x7f611c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96bee2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa9640aad60 0x7fa9640ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96bee2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa964156c50 0x7fa964157400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96bee2700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9640ad810 con 0x7fa9640aa990 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96bee2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640acee0 con 0x7fa964156c50 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96bee2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640ad1c0 con 0x7fa9640aad60 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96a47f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa964156c50 0x7fa964157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa969c7e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa9640aa990 0x7fa9640adca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51548/0 (socket says 172.21.15.3:51548) 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa969c7e700 1 -- 172.21.15.3:0/2633340962 learned_addr learned my addr 172.21.15.3:0/2633340962 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96947d700 1 --2- 172.21.15.3:0/2633340962 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa9640aad60 0x7fa9640ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96a47f700 1 -- 172.21.15.3:0/2633340962 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa9640aad60 msgr2=0x7fa9640ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96a47f700 1 --2- 172.21.15.3:0/2633340962 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa9640aad60 0x7fa9640ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96a47f700 1 -- 172.21.15.3:0/2633340962 >> v1:172.21.15.3:6789/0 conn(0x7fa9640aa990 legacy=0x7fa9640adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96a47f700 1 -- 172.21.15.3:0/2633340962 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640ad4a0 con 0x7fa964156c50 2023-10-08T16:06:51.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7fa96a47f700 1 --2- 172.21.15.3:0/2633340962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa964156c50 0x7fa964157400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00d0d0 tx=0x7fa95c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a438db8a90f0c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c005c00 con 0x7efc2806a570 2023-10-08T16:06:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6120052eb0 con 0x7f612c1551c0 2023-10-08T16:06:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc280c5760 con 0x7efc2806a570 2023-10-08T16:06:51.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f158405d980 con 0x7f1594154df0 2023-10-08T16:06:51.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.083+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc281693f0 con 0x7efc2806a570 2023-10-08T16:06:51.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.087+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2804be40 con 0x7efc2806a570 2023-10-08T16:06:51.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.087+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcc2804e720 con 0x7fcc380c65d0 2023-10-08T16:06:51.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f63f149f700 1 Processor -- start 2023-10-08T16:06:51.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c007070 con 0x7efc2806a570 2023-10-08T16:06:51.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7fa968c7c700 1 -- 172.21.15.3:0/2633340962 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c010070 con 0x7fa964156c50 2023-10-08T16:06:51.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7fa968c7c700 1 -- 172.21.15.3:0/2633340962 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c00b2e0 con 0x7fa964156c50 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7fa968c7c700 1 -- 172.21.15.3:0/2633340962 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00dd80 con 0x7fa964156c50 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7fa96bee2700 1 -- 172.21.15.3:0/2633340962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa964156c50 msgr2=0x7fa964157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7fa96bee2700 1 --2- 172.21.15.3:0/2633340962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa964156c50 0x7fa964157400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00d0d0 tx=0x7fa95c00b990 comp rx=0 tx=0).stop 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0071e0 con 0x7efc2806a570 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efc1c007400 con 0x7efc2806a570 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f63f149f700 1 -- start start 2023-10-08T16:06:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f63f149f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f63ec06bfb0 0x7f63ec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f63f149f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec06ad00 con 0x7f63ec0c79d0 2023-10-08T16:06:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f63f149f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec06bb20 con 0x7f63ec0c8eb0 2023-10-08T16:06:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f63f149f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec06c410 con 0x7f63ec06bfb0 2023-10-08T16:06:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.091+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6120049be0 con 0x7f612c1551c0 2023-10-08T16:06:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7fa96bee2700 1 -- 172.21.15.3:0/2633340962 shutdown_connections 2023-10-08T16:06:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7fa96bee2700 1 --2- 172.21.15.3:0/2633340962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa964156c50 0x7fa964157400 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7fa96bee2700 1 --2- 172.21.15.3:0/2633340962 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa9640aad60 0x7fa9640ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7fa96bee2700 1 -- 172.21.15.3:0/2633340962 >> 172.21.15.3:0/2633340962 conn(0x7fa964067060 msgr2=0x7fa964067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7efc0effd700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc14060550 0x7efc14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc1c07c2e0 con 0x7efc2806a570 2023-10-08T16:06:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63eb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f63ec06bfb0 0x7f63ec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7efc2659c700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc14060550 0x7efc14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63ebfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f63ec0c8eb0 0x7f63ec154e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:50650/0 (socket says 172.21.15.3:50650) 2023-10-08T16:06:51.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63ebfff700 1 -- 172.21.15.3:0/742459625 learned_addr learned my addr 172.21.15.3:0/742459625 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7efc2659c700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc14060550 0x7efc14062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc2000ae70 tx=0x7efc20015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63eb7fe700 1 -- 172.21.15.3:0/742459625 >> v1:172.21.15.27:6789/0 conn(0x7f63ec0c8eb0 legacy=0x7f63ec154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63eb7fe700 1 -- 172.21.15.3:0/742459625 >> v1:172.21.15.3:6789/0 conn(0x7f63ec0c79d0 legacy=0x7f63ec0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63eb7fe700 1 -- 172.21.15.3:0/742459625 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec06af30 con 0x7f63ec06bfb0 2023-10-08T16:06:51.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.095+0000 7f63eb7fe700 1 --2- 172.21.15.3:0/742459625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec06bfb0 0x7f63ec0c7490 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009860 tx=0x7f63e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d56d5a4ea6e9709 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.099+0000 7fa96bee2700 1 -- 172.21.15.3:0/2633340962 shutdown_connections 2023-10-08T16:06:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.099+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efc1c04c8e0 con 0x7efc2806a570 2023-10-08T16:06:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.099+0000 7fa96bee2700 1 -- 172.21.15.3:0/2633340962 wait complete. 2023-10-08T16:06:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.099+0000 7f63eaffd700 1 -- 172.21.15.3:0/742459625 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011630 con 0x7f63ec06bfb0 2023-10-08T16:06:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.099+0000 7f63eaffd700 1 -- 172.21.15.3:0/742459625 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0011790 con 0x7f63ec06bfb0 2023-10-08T16:06:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.099+0000 7f63eaffd700 1 -- 172.21.15.3:0/742459625 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011b50 con 0x7f63ec06bfb0 2023-10-08T16:06:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 -- 172.21.15.3:0/742459625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec06bfb0 msgr2=0x7f63ec0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 --2- 172.21.15.3:0/742459625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec06bfb0 0x7f63ec0c7490 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009860 tx=0x7f63e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 -- 172.21.15.3:0/742459625 shutdown_connections 2023-10-08T16:06:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 --2- 172.21.15.3:0/742459625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec06bfb0 0x7f63ec0c7490 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009860 tx=0x7f63e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 -- 172.21.15.3:0/742459625 >> 172.21.15.3:0/742459625 conn(0x7f63ec0c83d0 msgr2=0x7f63ec0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 -- 172.21.15.3:0/742459625 shutdown_connections 2023-10-08T16:06:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 Processor -- start 2023-10-08T16:06:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 -- start start 2023-10-08T16:06:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 -- 172.21.15.3:0/742459625 wait complete. 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 0x7fa964152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9640aad60 0x7fa964157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa964156c50 0x7fa9640c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640c0630 con 0x7fa9640aad60 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9641528c0 con 0x7fa9640aa990 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96bee2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640bfa20 con 0x7fa964156c50 2023-10-08T16:06:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 0x7fa964152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 0x7fa964152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:40502/0 (socket says 172.21.15.3:40502) 2023-10-08T16:06:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 -- 172.21.15.3:0/3666417987 learned_addr learned my addr 172.21.15.3:0/3666417987 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa96a47f700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa964156c50 0x7fa9640c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 Processor -- start 2023-10-08T16:06:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 -- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa964156c50 msgr2=0x7fa9640c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa964156c50 0x7fa9640c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 -- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9640aad60 msgr2=0x7fa964157de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:06:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9640aad60 0x7fa964157de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 -- 172.21.15.3:0/3666417987 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c00bc30 con 0x7fa9640aa990 2023-10-08T16:06:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7fa969c7e700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 0x7fa964152380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c7c0 tx=0x7fa960007f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.103+0000 7f63f149f700 1 -- start start 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec0c79d0 0x7f63ec163b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63ec0c8eb0 0x7f63ec14b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec16e3f0 0x7f63ec0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec164070 con 0x7f63ec0c79d0 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec067560 con 0x7f63ec16e3f0 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec067840 con 0x7f63ec0c8eb0 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63eb7fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63ec0c8eb0 0x7f63ec14b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f0c9e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec16e3f0 0x7f63ec0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f0c9e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec16e3f0 0x7f63ec0c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:40514/0 (socket says 172.21.15.3:40514) 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec0c79d0 0x7f63ec163b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f0c9e700 1 -- 172.21.15.3:0/3122981673 learned_addr learned my addr 172.21.15.3:0/3122981673 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 -- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63ec0c8eb0 msgr2=0x7f63ec14b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63ec0c8eb0 0x7f63ec14b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 -- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec16e3f0 msgr2=0x7f63ec0c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec16e3f0 0x7f63ec0c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 -- 172.21.15.3:0/3122981673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0009420 con 0x7f63ec0c79d0 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63eb7fe700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63ec0c8eb0 0x7f63ec14b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63ebfff700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec0c79d0 0x7f63ec163b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f63e400cf20 tx=0x7f63e4001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400a9e0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec161640 con 0x7f63ec0c79d0 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec14bbb0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400ab40 con 0x7f63ec0c79d0 2023-10-08T16:06:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40070f0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.107+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec1614a0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.111+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f63e40074e0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.111+0000 7f63d3fff700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f63d4060780 0x7f63d4062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.111+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63e407cb10 con 0x7f63ec0c79d0 2023-10-08T16:06:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.111+0000 7f63eb7fe700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f63d4060780 0x7f63d4062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.111+0000 7f63eb7fe700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f63d4060780 0x7f63d4062c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63ec06c380 tx=0x7f63e0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960005b30 con 0x7fa9640aa990 2023-10-08T16:06:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9640bfd00 con 0x7fa9640aa990 2023-10-08T16:06:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9640c02c0 con 0x7fa9640aa990 2023-10-08T16:06:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005c90 con 0x7fa9640aa990 2023-10-08T16:06:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960007320 con 0x7fa9640aa990 2023-10-08T16:06:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f63ec1614a0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9440052b0 con 0x7fa9640aa990 2023-10-08T16:06:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.119+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa960007690 con 0x7fa9640aa990 2023-10-08T16:06:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.123+0000 7fa959ffb700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa950060800 0x7fa950062cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.123+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa96007bb30 con 0x7fa9640aa990 2023-10-08T16:06:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.123+0000 7fa96947d700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa950060800 0x7fa950062cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.123+0000 7fa96947d700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa950060800 0x7fa950062cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa964158e50 tx=0x7fa9540091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.131+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa960049be0 con 0x7fa9640aa990 2023-10-08T16:06:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.327+0000 7fd062626700 1 -- 172.21.15.3:0/2043136746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd05c04be40 con 0x7fd05c154e50 2023-10-08T16:06:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.327+0000 7fd0517fa700 1 -- 172.21.15.3:0/2043136746 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd054024070 con 0x7fd05c154e50 2023-10-08T16:06:51.334 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:51.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 -- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd040060620 msgr2=0x7fd040062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd040060620 0x7fd040062ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd05c06e2d0 tx=0x7fd058009040 comp rx=0 tx=0).stop 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 -- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 msgr2=0x7fd05c16bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 0x7fd05c16bd40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd054008000 tx=0x7fd054019000 comp rx=0 tx=0).stop 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 -- 172.21.15.3:0/2043136746 shutdown_connections 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd040060620 0x7fd040062ad0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd05c155220 0x7fd05c153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05c154e50 0x7fd05c16bd40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 --2- 172.21.15.3:0/2043136746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd05c0ca080 0x7fd05c1691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 -- 172.21.15.3:0/2043136746 >> 172.21.15.3:0/2043136746 conn(0x7fd05c0c83d0 msgr2=0x7fd05c06db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 -- 172.21.15.3:0/2043136746 shutdown_connections 2023-10-08T16:06:51.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.335+0000 7fd046ffd700 1 -- 172.21.15.3:0/2043136746 wait complete. 2023-10-08T16:06:51.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-08T16:06:51.352 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.363+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f943c06b4d0 con 0x7f943c0ca790 2023-10-08T16:06:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.363+0000 7f94237fe700 1 -- 172.21.15.3:0/100268482 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9430017020 con 0x7f943c0ca790 2023-10-08T16:06:51.368 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9428060550 msgr2=0x7f9428062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9428060550 0x7f9428062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f943c177130 tx=0x7f942c007ec0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 msgr2=0x7f943c0c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c0c3a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f943000c510 tx=0x7f9430007ec0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 shutdown_connections 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9428060550 0x7f9428062a00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f943c155220 0x7f943c1769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f943c154e50 0x7f943c178e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 --2- 172.21.15.3:0/100268482 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f943c0ca790 0x7f943c0c3a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 >> 172.21.15.3:0/100268482 conn(0x7f943c0c83d0 msgr2=0x7f943c06c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 shutdown_connections 2023-10-08T16:06:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.367+0000 7f944093b700 1 -- 172.21.15.3:0/100268482 wait complete. 2023-10-08T16:06:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.371+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1594155610 con 0x7f1594154df0 2023-10-08T16:06:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f15827fc700 1 -- 172.21.15.3:0/3422584732 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1584032020 con 0x7f1594154df0 2023-10-08T16:06:51.376 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-10-08T16:06:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1574060550 msgr2=0x7f1574062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1574060550 0x7f1574062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f158800a5a0 tx=0x7f158801a000 comp rx=0 tx=0).stop 2023-10-08T16:06:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 msgr2=0x7f159416ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 0x7f159416ed40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f158401d7a0 tx=0x7f1584007ea0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 shutdown_connections 2023-10-08T16:06:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1574060550 0x7f1574062a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f15941551c0 0x7f1594155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1594154df0 0x7f159416ed40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 --2- 172.21.15.3:0/3422584732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15940c8b80 0x7f15941570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 >> 172.21.15.3:0/3422584732 conn(0x7f1594067060 msgr2=0x7f159414fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 shutdown_connections 2023-10-08T16:06:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.375+0000 7f1598dae700 1 -- 172.21.15.3:0/3422584732 wait complete. 2023-10-08T16:06:51.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-08T16:06:51.385 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.383+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc2806b9d0 con 0x7efc2806a570 2023-10-08T16:06:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.383+0000 7efc0effd700 1 -- 172.21.15.3:0/460053698 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc1c04ff00 con 0x7efc2806a570 2023-10-08T16:06:51.388 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc14060550 msgr2=0x7efc14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc14060550 0x7efc14062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc2000ae70 tx=0x7efc20015000 comp rx=0 tx=0).stop 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 msgr2=0x7efc28168eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 0x7efc28168eb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c590 tx=0x7efc1c007dd0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 shutdown_connections 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc14060550 0x7efc14062a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efc280c88a0 0x7efc280ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc280868a0 0x7efc280a55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 --2- 172.21.15.3:0/460053698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc2806a570 0x7efc28168eb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 >> 172.21.15.3:0/460053698 conn(0x7efc28067060 msgr2=0x7efc280ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 shutdown_connections 2023-10-08T16:06:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.387+0000 7efc2d1b7700 1 -- 172.21.15.3:0/460053698 wait complete. 2023-10-08T16:06:51.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-08T16:06:51.394 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f610c005560 con 0x7f612c1551c0 2023-10-08T16:06:51.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f61137fe700 1 -- 172.21.15.3:0/2081927130 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f612004c010 con 0x7f612c1551c0 2023-10-08T16:06:51.397 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T16:06:51.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6118060580 msgr2=0x7f6118062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6118060580 0x7f6118062a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f611c000c00 tx=0x7f611c009040 comp rx=0 tx=0).stop 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612c1551c0 msgr2=0x7f612c14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612c1551c0 0x7f612c14f090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61200058d0 tx=0x7f6120007d10 comp rx=0 tx=0).stop 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 shutdown_connections 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6118060580 0x7f6118062a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612c1551c0 0x7f612c14f090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f612c154df0 0x7f612c14eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 --2- 172.21.15.3:0/2081927130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f612c0c89b0 0x7f612c14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 >> 172.21.15.3:0/2081927130 conn(0x7f612c067060 msgr2=0x7f612c0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 shutdown_connections 2023-10-08T16:06:51.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.395+0000 7f6131e32700 1 -- 172.21.15.3:0/2081927130 wait complete. 2023-10-08T16:06:51.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-08T16:06:51.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.399+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcc18005560 con 0x7fcc380c65d0 2023-10-08T16:06:51.402 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.399+0000 7fcc1ffff700 1 -- 172.21.15.3:0/3543740871 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc28051d40 con 0x7fcc380c65d0 2023-10-08T16:06:51.402 INFO:teuthology.orchestra.run.smithi003.stdout:55834574855 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcc24060620 msgr2=0x7fcc24062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcc24060620 0x7fcc24062ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000f570 tx=0x7fcc3000b040 comp rx=0 tx=0).stop 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 msgr2=0x7fcc380c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 0x7fcc380c4ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3c0 tx=0x7fcc28017000 comp rx=0 tx=0).stop 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 shutdown_connections 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcc24060620 0x7fcc24062ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc380c65d0 0x7fcc380c4ea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc380ae0f0 0x7fcc381598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 --2- 172.21.15.3:0/3543740871 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcc3806c700 0x7fcc3815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 >> 172.21.15.3:0/3543740871 conn(0x7fcc38067b30 msgr2=0x7fcc380c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 shutdown_connections 2023-10-08T16:06:51.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.403+0000 7fcc3e7cb700 1 -- 172.21.15.3:0/3543740871 wait complete. 2023-10-08T16:06:51.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-08T16:06:51.410 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-08T16:06:51.418 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa944005560 con 0x7fa9640aa990 2023-10-08T16:06:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa959ffb700 1 -- 172.21.15.3:0/3666417987 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa960017090 con 0x7fa9640aa990 2023-10-08T16:06:51.422 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-10-08T16:06:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa950060800 msgr2=0x7fa950062cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa950060800 0x7fa950062cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa964158e50 tx=0x7fa9540091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 msgr2=0x7fa964152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 0x7fa964152380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c7c0 tx=0x7fa960007f30 comp rx=0 tx=0).stop 2023-10-08T16:06:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 shutdown_connections 2023-10-08T16:06:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa950060800 0x7fa950062cb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa964156c50 0x7fa9640c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9640aad60 0x7fa964157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 --2- 172.21.15.3:0/3666417987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9640aa990 0x7fa964152380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 >> 172.21.15.3:0/3666417987 conn(0x7fa964067060 msgr2=0x7fa964152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 shutdown_connections 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.419+0000 7fa96bee2700 1 -- 172.21.15.3:0/3666417987 wait complete. 2023-10-08T16:06:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63ec1614a0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63d3fff700 1 -- 172.21.15.3:0/3122981673 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63ec1614a0 con 0x7f63ec0c79d0 2023-10-08T16:06:51.426 INFO:teuthology.orchestra.run.smithi003.stdout:55834574857 2023-10-08T16:06:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f63d4060780 msgr2=0x7f63d4062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f63d4060780 0x7f63d4062c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63ec06c380 tx=0x7f63e0016000 comp rx=0 tx=0).stop 2023-10-08T16:06:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec0c79d0 msgr2=0x7f63ec163b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec0c79d0 0x7f63ec163b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f63e400cf20 tx=0x7f63e4001a90 comp rx=0 tx=0).stop 2023-10-08T16:06:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 shutdown_connections 2023-10-08T16:06:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f63d4060780 0x7f63d4062c30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec16e3f0 0x7f63ec0c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63ec0c8eb0 0x7f63ec14b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 --2- 172.21.15.3:0/3122981673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63ec0c79d0 0x7f63ec163b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 >> 172.21.15.3:0/3122981673 conn(0x7f63ec0c83d0 msgr2=0x7f63ec0c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 shutdown_connections 2023-10-08T16:06:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.423+0000 7f63f149f700 1 -- 172.21.15.3:0/3122981673 wait complete. 2023-10-08T16:06:51.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-08T16:06:51.434 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-10-08T16:06:51.438 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:51.438 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:06:51.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 Processor -- start 2023-10-08T16:06:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 -- start start 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c0aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f828c0c6920 0x7f828c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c06c260 con 0x7f828c159e20 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c06b650 con 0x7f828c0c6920 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8291683700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c06b930 con 0x7f828c0aa960 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8290e82700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f828c159e20 0x7f828c06c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51568/0 (socket says 172.21.15.3:51568) 2023-10-08T16:06:51.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f8290e82700 1 -- 172.21.15.3:0/1614494577 learned_addr learned my addr 172.21.15.3:0/1614494577 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f828b7fe700 1 --2- 172.21.15.3:0/1614494577 >> v2:172.21.15.27:3300/0 conn(0x7f828c0c6920 0x7f828c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f828bfff700 1 --2- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c0aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f828affd700 1 -- 172.21.15.3:0/1614494577 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133216483 0 0) 0x7f828c06c260 con 0x7f828c159e20 2023-10-08T16:06:51.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.531+0000 7f828affd700 1 -- 172.21.15.3:0/1614494577 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c003570 con 0x7f828c159e20 2023-10-08T16:06:51.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828b7fe700 1 -- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 msgr2=0x7f828c0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828b7fe700 1 --2- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c0aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828b7fe700 1 -- 172.21.15.3:0/1614494577 >> v1:172.21.15.3:6789/0 conn(0x7f828c159e20 legacy=0x7f828c06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828b7fe700 1 -- 172.21.15.3:0/1614494577 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c06bc10 con 0x7f828c0c6920 2023-10-08T16:06:51.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828b7fe700 1 --2- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c0c6d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82740098e0 tx=0x7f82740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ebb95795fd0a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828affd700 1 -- 172.21.15.3:0/1614494577 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011630 con 0x7f828c0c6920 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828affd700 1 -- 172.21.15.3:0/1614494577 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8274011790 con 0x7f828c0c6920 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f828affd700 1 -- 172.21.15.3:0/1614494577 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011b30 con 0x7f828c0c6920 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 -- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 msgr2=0x7f828c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 --2- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c0c6d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82740098e0 tx=0x7f82740091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 -- 172.21.15.3:0/1614494577 shutdown_connections 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 --2- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c0c6d70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 --2- 172.21.15.3:0/1614494577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 -- 172.21.15.3:0/1614494577 >> 172.21.15.3:0/1614494577 conn(0x7f828c0c83d0 msgr2=0x7f828c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 -- 172.21.15.3:0/1614494577 shutdown_connections 2023-10-08T16:06:51.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 -- 172.21.15.3:0/1614494577 wait complete. 2023-10-08T16:06:51.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 Processor -- start 2023-10-08T16:06:51.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.535+0000 7f8291683700 1 -- start start 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 0x7f828c16aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0c4380 con 0x7f828c159e20 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c168f40 con 0x7f828c0c6920 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c168610 con 0x7f828c0aa960 2023-10-08T16:06:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 0x7f828c16aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 0x7f828c16aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42582/0 (socket says 172.21.15.3:42582) 2023-10-08T16:06:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 -- 172.21.15.3:0/3226780912 learned_addr learned my addr 172.21.15.3:0/3226780912 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f828b7fe700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f828bfff700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 -- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 msgr2=0x7f828c144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 -- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 msgr2=0x7f828c16a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c16a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 -- 172.21.15.3:0/3226780912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009420 con 0x7f828c159e20 2023-10-08T16:06:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8290e82700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 0x7f828c16aef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f828400cc40 tx=0x7f8284001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400a830 con 0x7f828c159e20 2023-10-08T16:06:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400a990 con 0x7f828c159e20 2023-10-08T16:06:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c1688f0 con 0x7f828c159e20 2023-10-08T16:06:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400ad10 con 0x7f828c159e20 2023-10-08T16:06:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c144780 con 0x7f828c159e20 2023-10-08T16:06:51.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c04be40 con 0x7f828c159e20 2023-10-08T16:06:51.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.539+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8284007300 con 0x7f828c159e20 2023-10-08T16:06:51.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.543+0000 7f8283fff700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8270060550 0x7f8270062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.543+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f828407cbc0 con 0x7f828c159e20 2023-10-08T16:06:51.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.543+0000 7f828bfff700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8270060550 0x7f8270062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.543+0000 7f828bfff700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8270060550 0x7f8270062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f828c0c4640 tx=0x7f827c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.547+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f828404d120 con 0x7f828c159e20 2023-10-08T16:06:51.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.699+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f828c06bef0 con 0x7f8270060550 2023-10-08T16:06:51.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.715+0000 7f8283fff700 1 -- 172.21.15.3:0/3226780912 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264327 (secure 0 0 0) 0x7f828c06bef0 con 0x7f8270060550 2023-10-08T16:06:51.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:51.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8270060550 msgr2=0x7f8270062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8270060550 0x7f8270062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f828c0c4640 tx=0x7f827c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 msgr2=0x7f828c16aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 0x7f828c16aef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f828400cc40 tx=0x7f8284001a40 comp rx=0 tx=0).stop 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 shutdown_connections 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8270060550 0x7f8270062a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f828c159e20 0x7f828c16aef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f828c0c6920 0x7f828c16a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 --2- 172.21.15.3:0/3226780912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f828c0aa960 0x7f828c144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 >> 172.21.15.3:0/3226780912 conn(0x7f828c0c83d0 msgr2=0x7f828c0ab990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 shutdown_connections 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.719+0000 7f8291683700 1 -- 172.21.15.3:0/3226780912 wait complete. 2023-10-08T16:06:51.725 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:51.736 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T16:06:49.822266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.578574"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.280053+0000","last_change":"2023-10-08T16:06:40.276055+0000","last_active":"2023-10-08T16:06:40.280053+0000","last_peered":"2023-10-08T16:06:40.280053+0000","last_clean":"2023-10-08T16:06:40.280053+0000","last_became_active":"2023-10-08T16:06:40.275720+0000","last_became_peered":"2023-10-08T16:06:40.275720+0000","last_unstale":"2023-10-08T16:06:40.280053+0000","last_undegraded":"2023-10-08T16:06:40.280053+0000","last_fullsized":"2023-10-08T16:06:40.280053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271636+0000","last_change":"2023-10-08T16:06:40.270216+0000","last_active":"2023-10-08T16:06:40.271636+0000","last_peered":"2023-10-08T16:06:40.271636+0000","last_clean":"2023-10-08T16:06:40.271636+0000","last_became_active":"2023-10-08T16:06:40.269903+0000","last_became_peered":"2023-10-08T16:06:40.269903+0000","last_unstale":"2023-10-08T16:06:40.271636+0000","last_undegraded":"2023-10-08T16:06:40.271636+0000","last_fullsized":"2023-10-08T16:06:40.271636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269395+0000","last_change":"2023-10-08T16:06:40.258935+0000","last_active":"2023-10-08T16:06:40.269395+0000","last_peered":"2023-10-08T16:06:40.269395+0000","last_clean":"2023-10-08T16:06:40.269395+0000","last_became_active":"2023-10-08T16:06:40.256957+0000","last_became_peered":"2023-10-08T16:06:40.256957+0000","last_unstale":"2023-10-08T16:06:40.269395+0000","last_undegraded":"2023-10-08T16:06:40.269395+0000","last_fullsized":"2023-10-08T16:06:40.269395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282471+0000","last_change":"2023-10-08T16:06:40.275472+0000","last_active":"2023-10-08T16:06:40.282471+0000","last_peered":"2023-10-08T16:06:40.282471+0000","last_clean":"2023-10-08T16:06:40.282471+0000","last_became_active":"2023-10-08T16:06:40.275178+0000","last_became_peered":"2023-10-08T16:06:40.275178+0000","last_unstale":"2023-10-08T16:06:40.282471+0000","last_undegraded":"2023-10-08T16:06:40.282471+0000","last_fullsized":"2023-10-08T16:06:40.282471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276523+0000","last_change":"2023-10-08T16:06:40.270577+0000","last_active":"2023-10-08T16:06:40.276523+0000","last_peered":"2023-10-08T16:06:40.276523+0000","last_clean":"2023-10-08T16:06:40.276523+0000","last_became_active":"2023-10-08T16:06:40.270269+0000","last_became_peered":"2023-10-08T16:06:40.270269+0000","last_unstale":"2023-10-08T16:06:40.276523+0000","last_undegraded":"2023-10-08T16:06:40.276523+0000","last_fullsized":"2023-10-08T16:06:40.276523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279700+0000","last_change":"2023-10-08T16:06:40.272575+0000","last_active":"2023-10-08T16:06:40.279700+0000","last_peered":"2023-10-08T16:06:40.279700+0000","last_clean":"2023-10-08T16:06:40.279700+0000","last_became_active":"2023-10-08T16:06:40.272126+0000","last_became_peered":"2023-10-08T16:06:40.272126+0000","last_unstale":"2023-10-08T16:06:40.279700+0000","last_undegraded":"2023-10-08T16:06:40.279700+0000","last_fullsized":"2023-10-08T16:06:40.279700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279736+0000","last_change":"2023-10-08T16:06:40.277232+0000","last_active":"2023-10-08T16:06:40.279736+0000","last_peered":"2023-10-08T16:06:40.279736+0000","last_clean":"2023-10-08T16:06:40.279736+0000","last_became_active":"2023-10-08T16:06:40.276903+0000","last_became_peered":"2023-10-08T16:06:40.276903+0000","last_unstale":"2023-10-08T16:06:40.279736+0000","last_undegraded":"2023-10-08T16:06:40.279736+0000","last_fullsized":"2023-10-08T16:06:40.279736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281289+0000","last_change":"2023-10-08T16:06:40.279113+0000","last_active":"2023-10-08T16:06:40.281289+0000","last_peered":"2023-10-08T16:06:40.281289+0000","last_clean":"2023-10-08T16:06:40.281289+0000","last_became_active":"2023-10-08T16:06:40.278772+0000","last_became_peered":"2023-10-08T16:06:40.278772+0000","last_unstale":"2023-10-08T16:06:40.281289+0000","last_undegraded":"2023-10-08T16:06:40.281289+0000","last_fullsized":"2023-10-08T16:06:40.281289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.284590+0000","last_change":"2023-10-08T16:06:40.280182+0000","last_active":"2023-10-08T16:06:40.284590+0000","last_peered":"2023-10-08T16:06:40.284590+0000","last_clean":"2023-10-08T16:06:40.284590+0000","last_became_active":"2023-10-08T16:06:40.279850+0000","last_became_peered":"2023-10-08T16:06:40.279850+0000","last_unstale":"2023-10-08T16:06:40.284590+0000","last_undegraded":"2023-10-08T16:06:40.284590+0000","last_fullsized":"2023-10-08T16:06:40.284590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:54.574906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279582+0000","last_change":"2023-10-08T16:06:40.275718+0000","last_active":"2023-10-08T16:06:40.279582+0000","last_peered":"2023-10-08T16:06:40.279582+0000","last_clean":"2023-10-08T16:06:40.279582+0000","last_became_active":"2023-10-08T16:06:40.275419+0000","last_became_peered":"2023-10-08T16:06:40.275419+0000","last_unstale":"2023-10-08T16:06:40.279582+0000","last_undegraded":"2023-10-08T16:06:40.279582+0000","last_fullsized":"2023-10-08T16:06:40.279582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281916+0000","last_change":"2023-10-08T16:06:40.276225+0000","last_active":"2023-10-08T16:06:40.281916+0000","last_peered":"2023-10-08T16:06:40.281916+0000","last_clean":"2023-10-08T16:06:40.281916+0000","last_became_active":"2023-10-08T16:06:40.275876+0000","last_became_peered":"2023-10-08T16:06:40.275876+0000","last_unstale":"2023-10-08T16:06:40.281916+0000","last_undegraded":"2023-10-08T16:06:40.281916+0000","last_fullsized":"2023-10-08T16:06:40.281916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270998+0000","last_change":"2023-10-08T16:06:40.264918+0000","last_active":"2023-10-08T16:06:40.270998+0000","last_peered":"2023-10-08T16:06:40.270998+0000","last_clean":"2023-10-08T16:06:40.270998+0000","last_became_active":"2023-10-08T16:06:40.264124+0000","last_became_peered":"2023-10-08T16:06:40.264124+0000","last_unstale":"2023-10-08T16:06:40.270998+0000","last_undegraded":"2023-10-08T16:06:40.270998+0000","last_fullsized":"2023-10-08T16:06:40.270998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273343+0000","last_change":"2023-10-08T16:06:40.269867+0000","last_active":"2023-10-08T16:06:40.273343+0000","last_peered":"2023-10-08T16:06:40.273343+0000","last_clean":"2023-10-08T16:06:40.273343+0000","last_became_active":"2023-10-08T16:06:40.268208+0000","last_became_peered":"2023-10-08T16:06:40.268208+0000","last_unstale":"2023-10-08T16:06:40.273343+0000","last_undegraded":"2023-10-08T16:06:40.273343+0000","last_fullsized":"2023-10-08T16:06:40.273343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275554+0000","last_change":"2023-10-08T16:06:40.264028+0000","last_active":"2023-10-08T16:06:40.275554+0000","last_peered":"2023-10-08T16:06:40.275554+0000","last_clean":"2023-10-08T16:06:40.275554+0000","last_became_active":"2023-10-08T16:06:40.263715+0000","last_became_peered":"2023-10-08T16:06:40.263715+0000","last_unstale":"2023-10-08T16:06:40.275554+0000","last_undegraded":"2023-10-08T16:06:40.275554+0000","last_fullsized":"2023-10-08T16:06:40.275554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:55.266658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271470+0000","last_change":"2023-10-08T16:06:40.269258+0000","last_active":"2023-10-08T16:06:40.271470+0000","last_peered":"2023-10-08T16:06:40.271470+0000","last_clean":"2023-10-08T16:06:40.271470+0000","last_became_active":"2023-10-08T16:06:40.268883+0000","last_became_peered":"2023-10-08T16:06:40.268883+0000","last_unstale":"2023-10-08T16:06:40.271470+0000","last_undegraded":"2023-10-08T16:06:40.271470+0000","last_fullsized":"2023-10-08T16:06:40.271470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282671+0000","last_change":"2023-10-08T16:06:40.278397+0000","last_active":"2023-10-08T16:06:40.282671+0000","last_peered":"2023-10-08T16:06:40.282671+0000","last_clean":"2023-10-08T16:06:40.282671+0000","last_became_active":"2023-10-08T16:06:40.277981+0000","last_became_peered":"2023-10-08T16:06:40.277981+0000","last_unstale":"2023-10-08T16:06:40.282671+0000","last_undegraded":"2023-10-08T16:06:40.282671+0000","last_fullsized":"2023-10-08T16:06:40.282671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282436+0000","last_change":"2023-10-08T16:06:40.276109+0000","last_active":"2023-10-08T16:06:40.282436+0000","last_peered":"2023-10-08T16:06:40.282436+0000","last_clean":"2023-10-08T16:06:40.282436+0000","last_became_active":"2023-10-08T16:06:40.275481+0000","last_became_peered":"2023-10-08T16:06:40.275481+0000","last_unstale":"2023-10-08T16:06:40.282436+0000","last_undegraded":"2023-10-08T16:06:40.282436+0000","last_fullsized":"2023-10-08T16:06:40.282436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267040+0000","last_change":"2023-10-08T16:06:40.261754+0000","last_active":"2023-10-08T16:06:40.267040+0000","last_peered":"2023-10-08T16:06:40.267040+0000","last_clean":"2023-10-08T16:06:40.267040+0000","last_became_active":"2023-10-08T16:06:40.261437+0000","last_became_peered":"2023-10-08T16:06:40.261437+0000","last_unstale":"2023-10-08T16:06:40.267040+0000","last_undegraded":"2023-10-08T16:06:40.267040+0000","last_fullsized":"2023-10-08T16:06:40.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277114+0000","last_change":"2023-10-08T16:06:40.271380+0000","last_active":"2023-10-08T16:06:40.277114+0000","last_peered":"2023-10-08T16:06:40.277114+0000","last_clean":"2023-10-08T16:06:40.277114+0000","last_became_active":"2023-10-08T16:06:40.271014+0000","last_became_peered":"2023-10-08T16:06:40.271014+0000","last_unstale":"2023-10-08T16:06:40.277114+0000","last_undegraded":"2023-10-08T16:06:40.277114+0000","last_fullsized":"2023-10-08T16:06:40.277114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275113+0000","last_change":"2023-10-08T16:06:40.264967+0000","last_active":"2023-10-08T16:06:40.275113+0000","last_peered":"2023-10-08T16:06:40.275113+0000","last_clean":"2023-10-08T16:06:40.275113+0000","last_became_active":"2023-10-08T16:06:40.264522+0000","last_became_peered":"2023-10-08T16:06:40.264522+0000","last_unstale":"2023-10-08T16:06:40.275113+0000","last_undegraded":"2023-10-08T16:06:40.275113+0000","last_fullsized":"2023-10-08T16:06:40.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275758+0000","last_change":"2023-10-08T16:06:40.266852+0000","last_active":"2023-10-08T16:06:40.275758+0000","last_peered":"2023-10-08T16:06:40.275758+0000","last_clean":"2023-10-08T16:06:40.275758+0000","last_became_active":"2023-10-08T16:06:40.266394+0000","last_became_peered":"2023-10-08T16:06:40.266394+0000","last_unstale":"2023-10-08T16:06:40.275758+0000","last_undegraded":"2023-10-08T16:06:40.275758+0000","last_fullsized":"2023-10-08T16:06:40.275758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279658+0000","last_change":"2023-10-08T16:06:40.272299+0000","last_active":"2023-10-08T16:06:40.279658+0000","last_peered":"2023-10-08T16:06:40.279658+0000","last_clean":"2023-10-08T16:06:40.279658+0000","last_became_active":"2023-10-08T16:06:40.271714+0000","last_became_peered":"2023-10-08T16:06:40.271714+0000","last_unstale":"2023-10-08T16:06:40.279658+0000","last_undegraded":"2023-10-08T16:06:40.279658+0000","last_fullsized":"2023-10-08T16:06:40.279658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268225+0000","last_change":"2023-10-08T16:06:40.266098+0000","last_active":"2023-10-08T16:06:40.268225+0000","last_peered":"2023-10-08T16:06:40.268225+0000","last_clean":"2023-10-08T16:06:40.268225+0000","last_became_active":"2023-10-08T16:06:40.265779+0000","last_became_peered":"2023-10-08T16:06:40.265779+0000","last_unstale":"2023-10-08T16:06:40.268225+0000","last_undegraded":"2023-10-08T16:06:40.268225+0000","last_fullsized":"2023-10-08T16:06:40.268225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279321+0000","last_change":"2023-10-08T16:06:40.269099+0000","last_active":"2023-10-08T16:06:40.279321+0000","last_peered":"2023-10-08T16:06:40.279321+0000","last_clean":"2023-10-08T16:06:40.279321+0000","last_became_active":"2023-10-08T16:06:40.268796+0000","last_became_peered":"2023-10-08T16:06:40.268796+0000","last_unstale":"2023-10-08T16:06:40.279321+0000","last_undegraded":"2023-10-08T16:06:40.279321+0000","last_fullsized":"2023-10-08T16:06:40.279321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268296+0000","last_change":"2023-10-08T16:06:40.264696+0000","last_active":"2023-10-08T16:06:40.268296+0000","last_peered":"2023-10-08T16:06:40.268296+0000","last_clean":"2023-10-08T16:06:40.268296+0000","last_became_active":"2023-10-08T16:06:40.264322+0000","last_became_peered":"2023-10-08T16:06:40.264322+0000","last_unstale":"2023-10-08T16:06:40.268296+0000","last_undegraded":"2023-10-08T16:06:40.268296+0000","last_fullsized":"2023-10-08T16:06:40.268296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275189+0000","last_change":"2023-10-08T16:06:40.266542+0000","last_active":"2023-10-08T16:06:40.275189+0000","last_peered":"2023-10-08T16:06:40.275189+0000","last_clean":"2023-10-08T16:06:40.275189+0000","last_became_active":"2023-10-08T16:06:40.266258+0000","last_became_peered":"2023-10-08T16:06:40.266258+0000","last_unstale":"2023-10-08T16:06:40.275189+0000","last_undegraded":"2023-10-08T16:06:40.275189+0000","last_fullsized":"2023-10-08T16:06:40.275189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270627+0000","last_change":"2023-10-08T16:06:40.268954+0000","last_active":"2023-10-08T16:06:40.270627+0000","last_peered":"2023-10-08T16:06:40.270627+0000","last_clean":"2023-10-08T16:06:40.270627+0000","last_became_active":"2023-10-08T16:06:40.268456+0000","last_became_peered":"2023-10-08T16:06:40.268456+0000","last_unstale":"2023-10-08T16:06:40.270627+0000","last_undegraded":"2023-10-08T16:06:40.270627+0000","last_fullsized":"2023-10-08T16:06:40.270627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273146+0000","last_change":"2023-10-08T16:06:40.268821+0000","last_active":"2023-10-08T16:06:40.273146+0000","last_peered":"2023-10-08T16:06:40.273146+0000","last_clean":"2023-10-08T16:06:40.273146+0000","last_became_active":"2023-10-08T16:06:40.268485+0000","last_became_peered":"2023-10-08T16:06:40.268485+0000","last_unstale":"2023-10-08T16:06:40.273146+0000","last_undegraded":"2023-10-08T16:06:40.273146+0000","last_fullsized":"2023-10-08T16:06:40.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275805+0000","last_change":"2023-10-08T16:06:40.267487+0000","last_active":"2023-10-08T16:06:40.275805+0000","last_peered":"2023-10-08T16:06:40.275805+0000","last_clean":"2023-10-08T16:06:40.275805+0000","last_became_active":"2023-10-08T16:06:40.267198+0000","last_became_peered":"2023-10-08T16:06:40.267198+0000","last_unstale":"2023-10-08T16:06:40.275805+0000","last_undegraded":"2023-10-08T16:06:40.275805+0000","last_fullsized":"2023-10-08T16:06:40.275805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279681+0000","last_change":"2023-10-08T16:06:40.272431+0000","last_active":"2023-10-08T16:06:40.279681+0000","last_peered":"2023-10-08T16:06:40.279681+0000","last_clean":"2023-10-08T16:06:40.279681+0000","last_became_active":"2023-10-08T16:06:40.271999+0000","last_became_peered":"2023-10-08T16:06:40.271999+0000","last_unstale":"2023-10-08T16:06:40.279681+0000","last_undegraded":"2023-10-08T16:06:40.279681+0000","last_fullsized":"2023-10-08T16:06:40.279681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278116+0000","last_change":"2023-10-08T16:06:40.273286+0000","last_active":"2023-10-08T16:06:40.278116+0000","last_peered":"2023-10-08T16:06:40.278116+0000","last_clean":"2023-10-08T16:06:40.278116+0000","last_became_active":"2023-10-08T16:06:40.272933+0000","last_became_peered":"2023-10-08T16:06:40.272933+0000","last_unstale":"2023-10-08T16:06:40.278116+0000","last_undegraded":"2023-10-08T16:06:40.278116+0000","last_fullsized":"2023-10-08T16:06:40.278116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275156+0000","last_change":"2023-10-08T16:06:40.265329+0000","last_active":"2023-10-08T16:06:40.275156+0000","last_peered":"2023-10-08T16:06:40.275156+0000","last_clean":"2023-10-08T16:06:40.275156+0000","last_became_active":"2023-10-08T16:06:40.264972+0000","last_became_peered":"2023-10-08T16:06:40.264972+0000","last_unstale":"2023-10-08T16:06:40.275156+0000","last_undegraded":"2023-10-08T16:06:40.275156+0000","last_fullsized":"2023-10-08T16:06:40.275156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268526+0000","last_change":"2023-10-08T16:06:40.263993+0000","last_active":"2023-10-08T16:06:40.268526+0000","last_peered":"2023-10-08T16:06:40.268526+0000","last_clean":"2023-10-08T16:06:40.268526+0000","last_became_active":"2023-10-08T16:06:40.263538+0000","last_became_peered":"2023-10-08T16:06:40.263538+0000","last_unstale":"2023-10-08T16:06:40.268526+0000","last_undegraded":"2023-10-08T16:06:40.268526+0000","last_fullsized":"2023-10-08T16:06:40.268526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:29.217008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301721+0000","last_change":"2023-10-08T16:06:39.297623+0000","last_active":"2023-10-08T16:06:40.301721+0000","last_peered":"2023-10-08T16:06:40.301721+0000","last_clean":"2023-10-08T16:06:40.301721+0000","last_became_active":"2023-10-08T16:06:39.292440+0000","last_became_peered":"2023-10-08T16:06:39.292440+0000","last_unstale":"2023-10-08T16:06:40.301721+0000","last_undegraded":"2023-10-08T16:06:40.301721+0000","last_fullsized":"2023-10-08T16:06:40.301721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269305+0000","last_change":"2023-10-08T16:06:40.258340+0000","last_active":"2023-10-08T16:06:40.269305+0000","last_peered":"2023-10-08T16:06:40.269305+0000","last_clean":"2023-10-08T16:06:40.269305+0000","last_became_active":"2023-10-08T16:06:40.257980+0000","last_became_peered":"2023-10-08T16:06:40.257980+0000","last_unstale":"2023-10-08T16:06:40.269305+0000","last_undegraded":"2023-10-08T16:06:40.269305+0000","last_fullsized":"2023-10-08T16:06:40.269305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301568+0000","last_change":"2023-10-08T16:06:39.291777+0000","last_active":"2023-10-08T16:06:40.301568+0000","last_peered":"2023-10-08T16:06:40.301568+0000","last_clean":"2023-10-08T16:06:40.301568+0000","last_became_active":"2023-10-08T16:06:39.290855+0000","last_became_peered":"2023-10-08T16:06:39.290855+0000","last_unstale":"2023-10-08T16:06:40.301568+0000","last_undegraded":"2023-10-08T16:06:40.301568+0000","last_fullsized":"2023-10-08T16:06:40.301568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.255042+0000","last_change":"2023-10-08T16:06:39.301682+0000","last_active":"2023-10-08T16:06:40.255042+0000","last_peered":"2023-10-08T16:06:40.255042+0000","last_clean":"2023-10-08T16:06:40.255042+0000","last_became_active":"2023-10-08T16:06:39.300996+0000","last_became_peered":"2023-10-08T16:06:39.300996+0000","last_unstale":"2023-10-08T16:06:40.255042+0000","last_undegraded":"2023-10-08T16:06:40.255042+0000","last_fullsized":"2023-10-08T16:06:40.255042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270724+0000","last_change":"2023-10-08T16:06:40.266918+0000","last_active":"2023-10-08T16:06:40.270724+0000","last_peered":"2023-10-08T16:06:40.270724+0000","last_clean":"2023-10-08T16:06:40.270724+0000","last_became_active":"2023-10-08T16:06:40.266574+0000","last_became_peered":"2023-10-08T16:06:40.266574+0000","last_unstale":"2023-10-08T16:06:40.270724+0000","last_undegraded":"2023-10-08T16:06:40.270724+0000","last_fullsized":"2023-10-08T16:06:40.270724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269496+0000","last_change":"2023-10-08T16:06:39.294887+0000","last_active":"2023-10-08T16:06:40.269496+0000","last_peered":"2023-10-08T16:06:40.269496+0000","last_clean":"2023-10-08T16:06:40.269496+0000","last_became_active":"2023-10-08T16:06:39.294362+0000","last_became_peered":"2023-10-08T16:06:39.294362+0000","last_unstale":"2023-10-08T16:06:40.269496+0000","last_undegraded":"2023-10-08T16:06:40.269496+0000","last_fullsized":"2023-10-08T16:06:40.269496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270647+0000","last_change":"2023-10-08T16:06:40.269161+0000","last_active":"2023-10-08T16:06:40.270647+0000","last_peered":"2023-10-08T16:06:40.270647+0000","last_clean":"2023-10-08T16:06:40.270647+0000","last_became_active":"2023-10-08T16:06:40.268258+0000","last_became_peered":"2023-10-08T16:06:40.268258+0000","last_unstale":"2023-10-08T16:06:40.270647+0000","last_undegraded":"2023-10-08T16:06:40.270647+0000","last_fullsized":"2023-10-08T16:06:40.270647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253455+0000","last_change":"2023-10-08T16:06:39.298780+0000","last_active":"2023-10-08T16:06:40.253455+0000","last_peered":"2023-10-08T16:06:40.253455+0000","last_clean":"2023-10-08T16:06:40.253455+0000","last_became_active":"2023-10-08T16:06:39.298461+0000","last_became_peered":"2023-10-08T16:06:39.298461+0000","last_unstale":"2023-10-08T16:06:40.253455+0000","last_undegraded":"2023-10-08T16:06:40.253455+0000","last_fullsized":"2023-10-08T16:06:40.253455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282263+0000","last_change":"2023-10-08T16:06:40.275019+0000","last_active":"2023-10-08T16:06:40.282263+0000","last_peered":"2023-10-08T16:06:40.282263+0000","last_clean":"2023-10-08T16:06:40.282263+0000","last_became_active":"2023-10-08T16:06:40.269866+0000","last_became_peered":"2023-10-08T16:06:40.269866+0000","last_unstale":"2023-10-08T16:06:40.282263+0000","last_undegraded":"2023-10-08T16:06:40.282263+0000","last_fullsized":"2023-10-08T16:06:40.282263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.274887+0000","last_change":"2023-10-08T16:06:39.302453+0000","last_active":"2023-10-08T16:06:40.274887+0000","last_peered":"2023-10-08T16:06:40.274887+0000","last_clean":"2023-10-08T16:06:40.274887+0000","last_became_active":"2023-10-08T16:06:39.302108+0000","last_became_peered":"2023-10-08T16:06:39.302108+0000","last_unstale":"2023-10-08T16:06:40.274887+0000","last_undegraded":"2023-10-08T16:06:40.274887+0000","last_fullsized":"2023-10-08T16:06:40.274887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278252+0000","last_change":"2023-10-08T16:06:40.273266+0000","last_active":"2023-10-08T16:06:40.278252+0000","last_peered":"2023-10-08T16:06:40.278252+0000","last_clean":"2023-10-08T16:06:40.278252+0000","last_became_active":"2023-10-08T16:06:40.272860+0000","last_became_peered":"2023-10-08T16:06:40.272860+0000","last_unstale":"2023-10-08T16:06:40.278252+0000","last_undegraded":"2023-10-08T16:06:40.278252+0000","last_fullsized":"2023-10-08T16:06:40.278252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300737+0000","last_change":"2023-10-08T16:06:39.293871+0000","last_active":"2023-10-08T16:06:40.300737+0000","last_peered":"2023-10-08T16:06:40.300737+0000","last_clean":"2023-10-08T16:06:40.300737+0000","last_became_active":"2023-10-08T16:06:39.293517+0000","last_became_peered":"2023-10-08T16:06:39.293517+0000","last_unstale":"2023-10-08T16:06:40.300737+0000","last_undegraded":"2023-10-08T16:06:40.300737+0000","last_fullsized":"2023-10-08T16:06:40.300737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271405+0000","last_change":"2023-10-08T16:06:40.266413+0000","last_active":"2023-10-08T16:06:40.271405+0000","last_peered":"2023-10-08T16:06:40.271405+0000","last_clean":"2023-10-08T16:06:40.271405+0000","last_became_active":"2023-10-08T16:06:40.266098+0000","last_became_peered":"2023-10-08T16:06:40.266098+0000","last_unstale":"2023-10-08T16:06:40.271405+0000","last_undegraded":"2023-10-08T16:06:40.271405+0000","last_fullsized":"2023-10-08T16:06:40.271405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:25.752461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.307815+0000","last_change":"2023-10-08T16:06:39.296406+0000","last_active":"2023-10-08T16:06:40.307815+0000","last_peered":"2023-10-08T16:06:40.307815+0000","last_clean":"2023-10-08T16:06:40.307815+0000","last_became_active":"2023-10-08T16:06:39.296075+0000","last_became_peered":"2023-10-08T16:06:39.296075+0000","last_unstale":"2023-10-08T16:06:40.307815+0000","last_undegraded":"2023-10-08T16:06:40.307815+0000","last_fullsized":"2023-10-08T16:06:40.307815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275787+0000","last_change":"2023-10-08T16:06:40.270048+0000","last_active":"2023-10-08T16:06:40.275787+0000","last_peered":"2023-10-08T16:06:40.275787+0000","last_clean":"2023-10-08T16:06:40.275787+0000","last_became_active":"2023-10-08T16:06:40.269726+0000","last_became_peered":"2023-10-08T16:06:40.269726+0000","last_unstale":"2023-10-08T16:06:40.275787+0000","last_undegraded":"2023-10-08T16:06:40.275787+0000","last_fullsized":"2023-10-08T16:06:40.275787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301282+0000","last_change":"2023-10-08T16:06:39.294192+0000","last_active":"2023-10-08T16:06:40.301282+0000","last_peered":"2023-10-08T16:06:40.301282+0000","last_clean":"2023-10-08T16:06:40.301282+0000","last_became_active":"2023-10-08T16:06:39.293881+0000","last_became_peered":"2023-10-08T16:06:39.293881+0000","last_unstale":"2023-10-08T16:06:40.301282+0000","last_undegraded":"2023-10-08T16:06:40.301282+0000","last_fullsized":"2023-10-08T16:06:40.301282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:43.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275717+0000","last_change":"2023-10-08T16:06:40.266213+0000","last_active":"2023-10-08T16:06:40.275717+0000","last_peered":"2023-10-08T16:06:40.275717+0000","last_clean":"2023-10-08T16:06:40.275717+0000","last_became_active":"2023-10-08T16:06:40.265860+0000","last_became_peered":"2023-10-08T16:06:40.265860+0000","last_unstale":"2023-10-08T16:06:40.275717+0000","last_undegraded":"2023-10-08T16:06:40.275717+0000","last_fullsized":"2023-10-08T16:06:40.275717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269558+0000","last_change":"2023-10-08T16:06:39.300216+0000","last_active":"2023-10-08T16:06:40.269558+0000","last_peered":"2023-10-08T16:06:40.269558+0000","last_clean":"2023-10-08T16:06:40.269558+0000","last_became_active":"2023-10-08T16:06:39.299914+0000","last_became_peered":"2023-10-08T16:06:39.299914+0000","last_unstale":"2023-10-08T16:06:40.269558+0000","last_undegraded":"2023-10-08T16:06:40.269558+0000","last_fullsized":"2023-10-08T16:06:40.269558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277069+0000","last_change":"2023-10-08T16:06:40.272059+0000","last_active":"2023-10-08T16:06:40.277069+0000","last_peered":"2023-10-08T16:06:40.277069+0000","last_clean":"2023-10-08T16:06:40.277069+0000","last_became_active":"2023-10-08T16:06:40.271730+0000","last_became_peered":"2023-10-08T16:06:40.271730+0000","last_unstale":"2023-10-08T16:06:40.277069+0000","last_undegraded":"2023-10-08T16:06:40.277069+0000","last_fullsized":"2023-10-08T16:06:40.277069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.251622+0000","last_change":"2023-10-08T16:06:39.291194+0000","last_active":"2023-10-08T16:06:40.251622+0000","last_peered":"2023-10-08T16:06:40.251622+0000","last_clean":"2023-10-08T16:06:40.251622+0000","last_became_active":"2023-10-08T16:06:39.290849+0000","last_became_peered":"2023-10-08T16:06:39.290849+0000","last_unstale":"2023-10-08T16:06:40.251622+0000","last_undegraded":"2023-10-08T16:06:40.251622+0000","last_fullsized":"2023-10-08T16:06:40.251622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267696+0000","last_change":"2023-10-08T16:06:40.259709+0000","last_active":"2023-10-08T16:06:40.267696+0000","last_peered":"2023-10-08T16:06:40.267696+0000","last_clean":"2023-10-08T16:06:40.267696+0000","last_became_active":"2023-10-08T16:06:40.259122+0000","last_became_peered":"2023-10-08T16:06:40.259122+0000","last_unstale":"2023-10-08T16:06:40.267696+0000","last_undegraded":"2023-10-08T16:06:40.267696+0000","last_fullsized":"2023-10-08T16:06:40.267696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.306618+0000","last_change":"2023-10-08T16:06:39.291829+0000","last_active":"2023-10-08T16:06:40.306618+0000","last_peered":"2023-10-08T16:06:40.306618+0000","last_clean":"2023-10-08T16:06:40.306618+0000","last_became_active":"2023-10-08T16:06:39.291331+0000","last_became_peered":"2023-10-08T16:06:39.291331+0000","last_unstale":"2023-10-08T16:06:40.306618+0000","last_undegraded":"2023-10-08T16:06:40.306618+0000","last_fullsized":"2023-10-08T16:06:40.306618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277354+0000","last_change":"2023-10-08T16:06:40.270693+0000","last_active":"2023-10-08T16:06:40.277354+0000","last_peered":"2023-10-08T16:06:40.277354+0000","last_clean":"2023-10-08T16:06:40.277354+0000","last_became_active":"2023-10-08T16:06:40.269238+0000","last_became_peered":"2023-10-08T16:06:40.269238+0000","last_unstale":"2023-10-08T16:06:40.277354+0000","last_undegraded":"2023-10-08T16:06:40.277354+0000","last_fullsized":"2023-10-08T16:06:40.277354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.302954+0000","last_change":"2023-10-08T16:06:39.294859+0000","last_active":"2023-10-08T16:06:40.302954+0000","last_peered":"2023-10-08T16:06:40.302954+0000","last_clean":"2023-10-08T16:06:40.302954+0000","last_became_active":"2023-10-08T16:06:39.294549+0000","last_became_peered":"2023-10-08T16:06:39.294549+0000","last_unstale":"2023-10-08T16:06:40.302954+0000","last_undegraded":"2023-10-08T16:06:40.302954+0000","last_fullsized":"2023-10-08T16:06:40.302954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:30.419636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276379+0000","last_change":"2023-10-08T16:06:40.270175+0000","last_active":"2023-10-08T16:06:40.276379+0000","last_peered":"2023-10-08T16:06:40.276379+0000","last_clean":"2023-10-08T16:06:40.276379+0000","last_became_active":"2023-10-08T16:06:40.269029+0000","last_became_peered":"2023-10-08T16:06:40.269029+0000","last_unstale":"2023-10-08T16:06:40.276379+0000","last_undegraded":"2023-10-08T16:06:40.276379+0000","last_fullsized":"2023-10-08T16:06:40.276379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301969+0000","last_change":"2023-10-08T16:06:39.299037+0000","last_active":"2023-10-08T16:06:40.301969+0000","last_peered":"2023-10-08T16:06:40.301969+0000","last_clean":"2023-10-08T16:06:40.301969+0000","last_became_active":"2023-10-08T16:06:39.298664+0000","last_became_peered":"2023-10-08T16:06:39.298664+0000","last_unstale":"2023-10-08T16:06:40.301969+0000","last_undegraded":"2023-10-08T16:06:40.301969+0000","last_fullsized":"2023-10-08T16:06:40.301969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277144+0000","last_change":"2023-10-08T16:06:40.272886+0000","last_active":"2023-10-08T16:06:40.277144+0000","last_peered":"2023-10-08T16:06:40.277144+0000","last_clean":"2023-10-08T16:06:40.277144+0000","last_became_active":"2023-10-08T16:06:40.272556+0000","last_became_peered":"2023-10-08T16:06:40.272556+0000","last_unstale":"2023-10-08T16:06:40.277144+0000","last_undegraded":"2023-10-08T16:06:40.277144+0000","last_fullsized":"2023-10-08T16:06:40.277144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300889+0000","last_change":"2023-10-08T16:06:39.293894+0000","last_active":"2023-10-08T16:06:40.300889+0000","last_peered":"2023-10-08T16:06:40.300889+0000","last_clean":"2023-10-08T16:06:40.300889+0000","last_became_active":"2023-10-08T16:06:39.293562+0000","last_became_peered":"2023-10-08T16:06:39.293562+0000","last_unstale":"2023-10-08T16:06:40.300889+0000","last_undegraded":"2023-10-08T16:06:40.300889+0000","last_fullsized":"2023-10-08T16:06:40.300889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282094+0000","last_change":"2023-10-08T16:06:40.273176+0000","last_active":"2023-10-08T16:06:40.282094+0000","last_peered":"2023-10-08T16:06:40.282094+0000","last_clean":"2023-10-08T16:06:40.282094+0000","last_became_active":"2023-10-08T16:06:40.272791+0000","last_became_peered":"2023-10-08T16:06:40.272791+0000","last_unstale":"2023-10-08T16:06:40.282094+0000","last_undegraded":"2023-10-08T16:06:40.282094+0000","last_fullsized":"2023-10-08T16:06:40.282094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.254116+0000","last_change":"2023-10-08T16:06:39.293390+0000","last_active":"2023-10-08T16:06:40.254116+0000","last_peered":"2023-10-08T16:06:40.254116+0000","last_clean":"2023-10-08T16:06:40.254116+0000","last_became_active":"2023-10-08T16:06:39.293063+0000","last_became_peered":"2023-10-08T16:06:39.293063+0000","last_unstale":"2023-10-08T16:06:40.254116+0000","last_undegraded":"2023-10-08T16:06:40.254116+0000","last_fullsized":"2023-10-08T16:06:40.254116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279769+0000","last_change":"2023-10-08T16:06:40.276714+0000","last_active":"2023-10-08T16:06:40.279769+0000","last_peered":"2023-10-08T16:06:40.279769+0000","last_clean":"2023-10-08T16:06:40.279769+0000","last_became_active":"2023-10-08T16:06:40.276322+0000","last_became_peered":"2023-10-08T16:06:40.276322+0000","last_unstale":"2023-10-08T16:06:40.279769+0000","last_undegraded":"2023-10-08T16:06:40.279769+0000","last_fullsized":"2023-10-08T16:06:40.279769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:28.338803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259410+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:40.259410+0000","last_peered":"2023-10-08T16:06:40.259410+0000","last_clean":"2023-10-08T16:06:40.259410+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:40.259410+0000","last_undegraded":"2023-10-08T16:06:40.259410+0000","last_fullsized":"2023-10-08T16:06:40.259410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269492+0000","last_change":"2023-10-08T16:06:39.293223+0000","last_active":"2023-10-08T16:06:40.269492+0000","last_peered":"2023-10-08T16:06:40.269492+0000","last_clean":"2023-10-08T16:06:40.269492+0000","last_became_active":"2023-10-08T16:06:39.292861+0000","last_became_peered":"2023-10-08T16:06:39.292861+0000","last_unstale":"2023-10-08T16:06:40.269492+0000","last_undegraded":"2023-10-08T16:06:40.269492+0000","last_fullsized":"2023-10-08T16:06:40.269492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281318+0000","last_change":"2023-10-08T16:06:40.279550+0000","last_active":"2023-10-08T16:06:40.281318+0000","last_peered":"2023-10-08T16:06:40.281318+0000","last_clean":"2023-10-08T16:06:40.281318+0000","last_became_active":"2023-10-08T16:06:40.279258+0000","last_became_peered":"2023-10-08T16:06:40.279258+0000","last_unstale":"2023-10-08T16:06:40.281318+0000","last_undegraded":"2023-10-08T16:06:40.281318+0000","last_fullsized":"2023-10-08T16:06:40.281318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259307+0000","last_change":"2023-10-08T16:06:39.303341+0000","last_active":"2023-10-08T16:06:40.259307+0000","last_peered":"2023-10-08T16:06:40.259307+0000","last_clean":"2023-10-08T16:06:40.259307+0000","last_became_active":"2023-10-08T16:06:39.303000+0000","last_became_peered":"2023-10-08T16:06:39.303000+0000","last_unstale":"2023-10-08T16:06:40.259307+0000","last_undegraded":"2023-10-08T16:06:40.259307+0000","last_fullsized":"2023-10-08T16:06:40.259307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:46.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269369+0000","last_change":"2023-10-08T16:06:40.259545+0000","last_active":"2023-10-08T16:06:40.269369+0000","last_peered":"2023-10-08T16:06:40.269369+0000","last_clean":"2023-10-08T16:06:40.269369+0000","last_became_active":"2023-10-08T16:06:40.259191+0000","last_became_peered":"2023-10-08T16:06:40.259191+0000","last_unstale":"2023-10-08T16:06:40.269369+0000","last_undegraded":"2023-10-08T16:06:40.269369+0000","last_fullsized":"2023-10-08T16:06:40.269369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253367+0000","last_change":"2023-10-08T16:06:39.299839+0000","last_active":"2023-10-08T16:06:40.253367+0000","last_peered":"2023-10-08T16:06:40.253367+0000","last_clean":"2023-10-08T16:06:40.253367+0000","last_became_active":"2023-10-08T16:06:39.299351+0000","last_became_peered":"2023-10-08T16:06:39.299351+0000","last_unstale":"2023-10-08T16:06:40.253367+0000","last_undegraded":"2023-10-08T16:06:40.253367+0000","last_fullsized":"2023-10-08T16:06:40.253367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269108+0000","last_change":"2023-10-08T16:06:40.263602+0000","last_active":"2023-10-08T16:06:40.269108+0000","last_peered":"2023-10-08T16:06:40.269108+0000","last_clean":"2023-10-08T16:06:40.269108+0000","last_became_active":"2023-10-08T16:06:40.263275+0000","last_became_peered":"2023-10-08T16:06:40.263275+0000","last_unstale":"2023-10-08T16:06:40.269108+0000","last_undegraded":"2023-10-08T16:06:40.269108+0000","last_fullsized":"2023-10-08T16:06:40.269108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269681+0000","last_change":"2023-10-08T16:06:39.298167+0000","last_active":"2023-10-08T16:06:40.269681+0000","last_peered":"2023-10-08T16:06:40.269681+0000","last_clean":"2023-10-08T16:06:40.269681+0000","last_became_active":"2023-10-08T16:06:39.297678+0000","last_became_peered":"2023-10-08T16:06:39.297678+0000","last_unstale":"2023-10-08T16:06:40.269681+0000","last_undegraded":"2023-10-08T16:06:40.269681+0000","last_fullsized":"2023-10-08T16:06:40.269681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276831+0000","last_change":"2023-10-08T16:06:40.271343+0000","last_active":"2023-10-08T16:06:40.276831+0000","last_peered":"2023-10-08T16:06:40.276831+0000","last_clean":"2023-10-08T16:06:40.276831+0000","last_became_active":"2023-10-08T16:06:40.270882+0000","last_became_peered":"2023-10-08T16:06:40.270882+0000","last_unstale":"2023-10-08T16:06:40.276831+0000","last_undegraded":"2023-10-08T16:06:40.276831+0000","last_fullsized":"2023-10-08T16:06:40.276831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258762+0000","last_change":"2023-10-08T16:06:39.293588+0000","last_active":"2023-10-08T16:06:40.258762+0000","last_peered":"2023-10-08T16:06:40.258762+0000","last_clean":"2023-10-08T16:06:40.258762+0000","last_became_active":"2023-10-08T16:06:39.293209+0000","last_became_peered":"2023-10-08T16:06:39.293209+0000","last_unstale":"2023-10-08T16:06:40.258762+0000","last_undegraded":"2023-10-08T16:06:40.258762+0000","last_fullsized":"2023-10-08T16:06:40.258762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282337+0000","last_change":"2023-10-08T16:06:40.275327+0000","last_active":"2023-10-08T16:06:40.282337+0000","last_peered":"2023-10-08T16:06:40.282337+0000","last_clean":"2023-10-08T16:06:40.282337+0000","last_became_active":"2023-10-08T16:06:40.274778+0000","last_became_peered":"2023-10-08T16:06:40.274778+0000","last_unstale":"2023-10-08T16:06:40.282337+0000","last_undegraded":"2023-10-08T16:06:40.282337+0000","last_fullsized":"2023-10-08T16:06:40.282337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:24.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.262394+0000","last_change":"2023-10-08T16:06:39.303540+0000","last_active":"2023-10-08T16:06:40.262394+0000","last_peered":"2023-10-08T16:06:40.262394+0000","last_clean":"2023-10-08T16:06:40.262394+0000","last_became_active":"2023-10-08T16:06:39.303264+0000","last_became_peered":"2023-10-08T16:06:39.303264+0000","last_unstale":"2023-10-08T16:06:40.262394+0000","last_undegraded":"2023-10-08T16:06:40.262394+0000","last_fullsized":"2023-10-08T16:06:40.262394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269828+0000","last_change":"2023-10-08T16:06:40.263957+0000","last_active":"2023-10-08T16:06:40.269828+0000","last_peered":"2023-10-08T16:06:40.269828+0000","last_clean":"2023-10-08T16:06:40.269828+0000","last_became_active":"2023-10-08T16:06:40.263566+0000","last_became_peered":"2023-10-08T16:06:40.263566+0000","last_unstale":"2023-10-08T16:06:40.269828+0000","last_undegraded":"2023-10-08T16:06:40.269828+0000","last_fullsized":"2023-10-08T16:06:40.269828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:06:41.252063+0000","last_change":"2023-10-08T16:06:39.301605+0000","last_active":"2023-10-08T16:06:41.252063+0000","last_peered":"2023-10-08T16:06:41.252063+0000","last_clean":"2023-10-08T16:06:41.252063+0000","last_became_active":"2023-10-08T16:06:39.301289+0000","last_became_peered":"2023-10-08T16:06:39.301289+0000","last_unstale":"2023-10-08T16:06:41.252063+0000","last_undegraded":"2023-10-08T16:06:41.252063+0000","last_fullsized":"2023-10-08T16:06:41.252063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273159+0000","last_change":"2023-10-08T16:06:40.268834+0000","last_active":"2023-10-08T16:06:40.273159+0000","last_peered":"2023-10-08T16:06:40.273159+0000","last_clean":"2023-10-08T16:06:40.273159+0000","last_became_active":"2023-10-08T16:06:40.268449+0000","last_became_peered":"2023-10-08T16:06:40.268449+0000","last_unstale":"2023-10-08T16:06:40.273159+0000","last_undegraded":"2023-10-08T16:06:40.273159+0000","last_fullsized":"2023-10-08T16:06:40.273159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300880+0000","last_change":"2023-10-08T16:06:39.300940+0000","last_active":"2023-10-08T16:06:40.300880+0000","last_peered":"2023-10-08T16:06:40.300880+0000","last_clean":"2023-10-08T16:06:40.300880+0000","last_became_active":"2023-10-08T16:06:39.300556+0000","last_became_peered":"2023-10-08T16:06:39.300556+0000","last_unstale":"2023-10-08T16:06:40.300880+0000","last_undegraded":"2023-10-08T16:06:40.300880+0000","last_fullsized":"2023-10-08T16:06:40.300880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275841+0000","last_change":"2023-10-08T16:06:40.267528+0000","last_active":"2023-10-08T16:06:40.275841+0000","last_peered":"2023-10-08T16:06:40.275841+0000","last_clean":"2023-10-08T16:06:40.275841+0000","last_became_active":"2023-10-08T16:06:40.266866+0000","last_became_peered":"2023-10-08T16:06:40.266866+0000","last_unstale":"2023-10-08T16:06:40.275841+0000","last_undegraded":"2023-10-08T16:06:40.275841+0000","last_fullsized":"2023-10-08T16:06:40.275841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:53.878852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258987+0000","last_change":"2023-10-08T16:06:39.302711+0000","last_active":"2023-10-08T16:06:40.258987+0000","last_peered":"2023-10-08T16:06:40.258987+0000","last_clean":"2023-10-08T16:06:40.258987+0000","last_became_active":"2023-10-08T16:06:39.302404+0000","last_became_peered":"2023-10-08T16:06:39.302404+0000","last_unstale":"2023-10-08T16:06:40.258987+0000","last_undegraded":"2023-10-08T16:06:40.258987+0000","last_fullsized":"2023-10-08T16:06:40.258987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268533+0000","last_change":"2023-10-08T16:06:40.263548+0000","last_active":"2023-10-08T16:06:40.268533+0000","last_peered":"2023-10-08T16:06:40.268533+0000","last_clean":"2023-10-08T16:06:40.268533+0000","last_became_active":"2023-10-08T16:06:40.263230+0000","last_became_peered":"2023-10-08T16:06:40.263230+0000","last_unstale":"2023-10-08T16:06:40.268533+0000","last_undegraded":"2023-10-08T16:06:40.268533+0000","last_fullsized":"2023-10-08T16:06:40.268533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:50.492409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258991+0000","last_change":"2023-10-08T16:06:39.299840+0000","last_active":"2023-10-08T16:06:40.258991+0000","last_peered":"2023-10-08T16:06:40.258991+0000","last_clean":"2023-10-08T16:06:40.258991+0000","last_became_active":"2023-10-08T16:06:39.299502+0000","last_became_peered":"2023-10-08T16:06:39.299502+0000","last_unstale":"2023-10-08T16:06:40.258991+0000","last_undegraded":"2023-10-08T16:06:40.258991+0000","last_fullsized":"2023-10-08T16:06:40.258991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268950+0000","last_change":"2023-10-08T16:06:40.263516+0000","last_active":"2023-10-08T16:06:40.268950+0000","last_peered":"2023-10-08T16:06:40.268950+0000","last_clean":"2023-10-08T16:06:40.268950+0000","last_became_active":"2023-10-08T16:06:40.263180+0000","last_became_peered":"2023-10-08T16:06:40.263180+0000","last_unstale":"2023-10-08T16:06:40.268950+0000","last_undegraded":"2023-10-08T16:06:40.268950+0000","last_fullsized":"2023-10-08T16:06:40.268950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260056+0000","last_change":"2023-10-08T16:06:39.302588+0000","last_active":"2023-10-08T16:06:40.260056+0000","last_peered":"2023-10-08T16:06:40.260056+0000","last_clean":"2023-10-08T16:06:40.260056+0000","last_became_active":"2023-10-08T16:06:39.302361+0000","last_became_peered":"2023-10-08T16:06:39.302361+0000","last_unstale":"2023-10-08T16:06:40.260056+0000","last_undegraded":"2023-10-08T16:06:40.260056+0000","last_fullsized":"2023-10-08T16:06:40.260056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267686+0000","last_change":"2023-10-08T16:06:40.262950+0000","last_active":"2023-10-08T16:06:40.267686+0000","last_peered":"2023-10-08T16:06:40.267686+0000","last_clean":"2023-10-08T16:06:40.267686+0000","last_became_active":"2023-10-08T16:06:40.262620+0000","last_became_peered":"2023-10-08T16:06:40.262620+0000","last_unstale":"2023-10-08T16:06:40.267686+0000","last_undegraded":"2023-10-08T16:06:40.267686+0000","last_fullsized":"2023-10-08T16:06:40.267686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301577+0000","last_change":"2023-10-08T16:06:39.304109+0000","last_active":"2023-10-08T16:06:40.301577+0000","last_peered":"2023-10-08T16:06:40.301577+0000","last_clean":"2023-10-08T16:06:40.301577+0000","last_became_active":"2023-10-08T16:06:39.303757+0000","last_became_peered":"2023-10-08T16:06:39.303757+0000","last_unstale":"2023-10-08T16:06:40.301577+0000","last_undegraded":"2023-10-08T16:06:40.301577+0000","last_fullsized":"2023-10-08T16:06:40.301577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267750+0000","last_change":"2023-10-08T16:06:40.259475+0000","last_active":"2023-10-08T16:06:40.267750+0000","last_peered":"2023-10-08T16:06:40.267750+0000","last_clean":"2023-10-08T16:06:40.267750+0000","last_became_active":"2023-10-08T16:06:40.259042+0000","last_became_peered":"2023-10-08T16:06:40.259042+0000","last_unstale":"2023-10-08T16:06:40.267750+0000","last_undegraded":"2023-10-08T16:06:40.267750+0000","last_fullsized":"2023-10-08T16:06:40.267750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282564+0000","last_change":"2023-10-08T16:06:40.276456+0000","last_active":"2023-10-08T16:06:40.282564+0000","last_peered":"2023-10-08T16:06:40.282564+0000","last_clean":"2023-10-08T16:06:40.282564+0000","last_became_active":"2023-10-08T16:06:40.276127+0000","last_became_peered":"2023-10-08T16:06:40.276127+0000","last_unstale":"2023-10-08T16:06:40.282564+0000","last_undegraded":"2023-10-08T16:06:40.282564+0000","last_fullsized":"2023-10-08T16:06:40.282564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.299639+0000","last_change":"2023-10-08T16:06:39.302950+0000","last_active":"2023-10-08T16:06:40.299639+0000","last_peered":"2023-10-08T16:06:40.299639+0000","last_clean":"2023-10-08T16:06:40.299639+0000","last_became_active":"2023-10-08T16:06:39.302504+0000","last_became_peered":"2023-10-08T16:06:39.302504+0000","last_unstale":"2023-10-08T16:06:40.299639+0000","last_undegraded":"2023-10-08T16:06:40.299639+0000","last_fullsized":"2023-10-08T16:06:40.299639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279270+0000","last_change":"2023-10-08T16:06:40.269067+0000","last_active":"2023-10-08T16:06:40.279270+0000","last_peered":"2023-10-08T16:06:40.279270+0000","last_clean":"2023-10-08T16:06:40.279270+0000","last_became_active":"2023-10-08T16:06:40.268755+0000","last_became_peered":"2023-10-08T16:06:40.268755+0000","last_unstale":"2023-10-08T16:06:40.279270+0000","last_undegraded":"2023-10-08T16:06:40.279270+0000","last_fullsized":"2023-10-08T16:06:40.279270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300353+0000","last_change":"2023-10-08T16:06:39.305358+0000","last_active":"2023-10-08T16:06:40.300353+0000","last_peered":"2023-10-08T16:06:40.300353+0000","last_clean":"2023-10-08T16:06:40.300353+0000","last_became_active":"2023-10-08T16:06:39.305022+0000","last_became_peered":"2023-10-08T16:06:39.305022+0000","last_unstale":"2023-10-08T16:06:40.300353+0000","last_undegraded":"2023-10-08T16:06:40.300353+0000","last_fullsized":"2023-10-08T16:06:40.300353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:17.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278272+0000","last_change":"2023-10-08T16:06:40.274826+0000","last_active":"2023-10-08T16:06:40.278272+0000","last_peered":"2023-10-08T16:06:40.278272+0000","last_clean":"2023-10-08T16:06:40.278272+0000","last_became_active":"2023-10-08T16:06:40.274506+0000","last_became_peered":"2023-10-08T16:06:40.274506+0000","last_unstale":"2023-10-08T16:06:40.278272+0000","last_undegraded":"2023-10-08T16:06:40.278272+0000","last_fullsized":"2023-10-08T16:06:40.278272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301960+0000","last_change":"2023-10-08T16:06:39.298025+0000","last_active":"2023-10-08T16:06:40.301960+0000","last_peered":"2023-10-08T16:06:40.301960+0000","last_clean":"2023-10-08T16:06:40.301960+0000","last_became_active":"2023-10-08T16:06:39.297643+0000","last_became_peered":"2023-10-08T16:06:39.297643+0000","last_unstale":"2023-10-08T16:06:40.301960+0000","last_undegraded":"2023-10-08T16:06:40.301960+0000","last_fullsized":"2023-10-08T16:06:40.301960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273032+0000","last_change":"2023-10-08T16:06:40.268521+0000","last_active":"2023-10-08T16:06:40.273032+0000","last_peered":"2023-10-08T16:06:40.273032+0000","last_clean":"2023-10-08T16:06:40.273032+0000","last_became_active":"2023-10-08T16:06:40.267613+0000","last_became_peered":"2023-10-08T16:06:40.267613+0000","last_unstale":"2023-10-08T16:06:40.273032+0000","last_undegraded":"2023-10-08T16:06:40.273032+0000","last_fullsized":"2023-10-08T16:06:40.273032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301633+0000","last_change":"2023-10-08T16:06:39.303632+0000","last_active":"2023-10-08T16:06:40.301633+0000","last_peered":"2023-10-08T16:06:40.301633+0000","last_clean":"2023-10-08T16:06:40.301633+0000","last_became_active":"2023-10-08T16:06:39.303353+0000","last_became_peered":"2023-10-08T16:06:39.303353+0000","last_unstale":"2023-10-08T16:06:40.301633+0000","last_undegraded":"2023-10-08T16:06:40.301633+0000","last_fullsized":"2023-10-08T16:06:40.301633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:51.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:51.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.839+0000 7f0bb85a9700 1 Processor -- start 2023-10-08T16:06:51.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.839+0000 7f0bb85a9700 1 -- start start 2023-10-08T16:06:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0bb0154bb0 0x7f0bb006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154f80 0x7f0bb00c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb006aba0 con 0x7f0bb00c7030 2023-10-08T16:06:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb006b720 con 0x7f0bb0154bb0 2023-10-08T16:06:51.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c7470 con 0x7f0bb0154f80 2023-10-08T16:06:51.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6b46700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0bb00c7030 0x7f0bb006c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51582/0 (socket says 172.21.15.3:51582) 2023-10-08T16:06:51.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6345700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0bb0154bb0 0x7f0bb006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6b46700 1 -- 172.21.15.3:0/3338271431 learned_addr learned my addr 172.21.15.3:0/3338271431 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:51.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb5b44700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154f80 0x7f0bb00c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6345700 1 -- 172.21.15.3:0/3338271431 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154f80 msgr2=0x7f0bb00c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:51.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6345700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154f80 0x7f0bb00c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6345700 1 -- 172.21.15.3:0/3338271431 >> v1:172.21.15.3:6789/0 conn(0x7f0bb00c7030 legacy=0x7f0bb006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6345700 1 -- 172.21.15.3:0/3338271431 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb006adf0 con 0x7f0bb0154bb0 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb5b44700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154f80 0x7f0bb00c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb6345700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154bb0 0x7f0bb006bbb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40098e0 tx=0x7f0ba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacb7844fd5fd5ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb5343700 1 -- 172.21.15.3:0/3338271431 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4009e80 con 0x7f0bb0154bb0 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb5343700 1 -- 172.21.15.3:0/3338271431 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400b860 con 0x7f0bb0154bb0 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb5343700 1 -- 172.21.15.3:0/3338271431 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400bbe0 con 0x7f0bb0154bb0 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- 172.21.15.3:0/3338271431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154bb0 msgr2=0x7f0bb006bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154bb0 0x7f0bb006bbb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40098e0 tx=0x7f0ba40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- 172.21.15.3:0/3338271431 shutdown_connections 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154f80 0x7f0bb00c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/3338271431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154bb0 0x7f0bb006bbb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- 172.21.15.3:0/3338271431 >> 172.21.15.3:0/3338271431 conn(0x7f0bb00cc5d0 msgr2=0x7f0bb00c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:51.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- 172.21.15.3:0/3338271431 shutdown_connections 2023-10-08T16:06:51.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.843+0000 7f0bb85a9700 1 -- 172.21.15.3:0/3338271431 wait complete. 2023-10-08T16:06:51.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 Processor -- start 2023-10-08T16:06:51.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 -- start start 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bb00c7030 0x7f0bb00b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154bb0 0x7f0bb00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 0x7f0bb00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01427a0 con 0x7f0bb0154f80 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0142460 con 0x7f0bb00c7030 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00b0b10 con 0x7f0bb0154bb0 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 0x7f0bb00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 0x7f0bb00c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42608/0 (socket says 172.21.15.3:42608) 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 -- 172.21.15.3:0/4068987446 learned_addr learned my addr 172.21.15.3:0/4068987446 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:51.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6345700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bb00c7030 0x7f0bb00b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb5b44700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154bb0 0x7f0bb00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 -- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154bb0 msgr2=0x7f0bb00c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154bb0 0x7f0bb00c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 -- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bb00c7030 msgr2=0x7f0bb00b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bb00c7030 0x7f0bb00b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 -- 172.21.15.3:0/4068987446 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009420 con 0x7f0bb0154f80 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb6b46700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 0x7f0bb00c58e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c4a0 tx=0x7f0ba8007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800ce50 con 0x7f0bb0154f80 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8005b30 con 0x7f0bb0154f80 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb00b0df0 con 0x7f0bb0154f80 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80070d0 con 0x7f0bb0154f80 2023-10-08T16:06:51.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.847+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb00b0740 con 0x7f0bb0154f80 2023-10-08T16:06:51.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.851+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0142910 con 0x7f0bb0154f80 2023-10-08T16:06:51.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.851+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ba80074c0 con 0x7f0bb0154f80 2023-10-08T16:06:51.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.851+0000 7f0ba27fc700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0b94060550 0x7f0b94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:51.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.851+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ba807ba10 con 0x7f0bb0154f80 2023-10-08T16:06:51.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.851+0000 7f0bb6345700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0b94060550 0x7f0b94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:51.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.851+0000 7f0bb6345700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0b94060550 0x7f0b94062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40091e0 tx=0x7f0ba4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:51.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:51.859+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ba804c000 con 0x7f0bb0154f80 2023-10-08T16:06:52.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.011+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bb004be40 con 0x7f0b94060550 2023-10-08T16:06:52.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.015+0000 7f0ba27fc700 1 -- 172.21.15.3:0/4068987446 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264328 (secure 0 0 0) 0x7f0bb004be40 con 0x7f0b94060550 2023-10-08T16:06:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0b94060550 msgr2=0x7f0b94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0b94060550 0x7f0b94062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40091e0 tx=0x7f0ba4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 msgr2=0x7f0bb00c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 0x7f0bb00c58e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c4a0 tx=0x7f0ba8007f10 comp rx=0 tx=0).stop 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 shutdown_connections 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0b94060550 0x7f0b94062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bb0154f80 0x7f0bb00c58e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0bb0154bb0 0x7f0bb00c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 --2- 172.21.15.3:0/4068987446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bb00c7030 0x7f0bb00b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 >> 172.21.15.3:0/4068987446 conn(0x7f0bb00cc5d0 msgr2=0x7f0bb00adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 shutdown_connections 2023-10-08T16:06:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.023+0000 7f0bb85a9700 1 -- 172.21.15.3:0/4068987446 wait complete. 2023-10-08T16:06:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:06:52.037 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T16:06:51.822928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.575188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.280053+0000","last_change":"2023-10-08T16:06:40.276055+0000","last_active":"2023-10-08T16:06:40.280053+0000","last_peered":"2023-10-08T16:06:40.280053+0000","last_clean":"2023-10-08T16:06:40.280053+0000","last_became_active":"2023-10-08T16:06:40.275720+0000","last_became_peered":"2023-10-08T16:06:40.275720+0000","last_unstale":"2023-10-08T16:06:40.280053+0000","last_undegraded":"2023-10-08T16:06:40.280053+0000","last_fullsized":"2023-10-08T16:06:40.280053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271636+0000","last_change":"2023-10-08T16:06:40.270216+0000","last_active":"2023-10-08T16:06:40.271636+0000","last_peered":"2023-10-08T16:06:40.271636+0000","last_clean":"2023-10-08T16:06:40.271636+0000","last_became_active":"2023-10-08T16:06:40.269903+0000","last_became_peered":"2023-10-08T16:06:40.269903+0000","last_unstale":"2023-10-08T16:06:40.271636+0000","last_undegraded":"2023-10-08T16:06:40.271636+0000","last_fullsized":"2023-10-08T16:06:40.271636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269395+0000","last_change":"2023-10-08T16:06:40.258935+0000","last_active":"2023-10-08T16:06:40.269395+0000","last_peered":"2023-10-08T16:06:40.269395+0000","last_clean":"2023-10-08T16:06:40.269395+0000","last_became_active":"2023-10-08T16:06:40.256957+0000","last_became_peered":"2023-10-08T16:06:40.256957+0000","last_unstale":"2023-10-08T16:06:40.269395+0000","last_undegraded":"2023-10-08T16:06:40.269395+0000","last_fullsized":"2023-10-08T16:06:40.269395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282471+0000","last_change":"2023-10-08T16:06:40.275472+0000","last_active":"2023-10-08T16:06:40.282471+0000","last_peered":"2023-10-08T16:06:40.282471+0000","last_clean":"2023-10-08T16:06:40.282471+0000","last_became_active":"2023-10-08T16:06:40.275178+0000","last_became_peered":"2023-10-08T16:06:40.275178+0000","last_unstale":"2023-10-08T16:06:40.282471+0000","last_undegraded":"2023-10-08T16:06:40.282471+0000","last_fullsized":"2023-10-08T16:06:40.282471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:44.516686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276523+0000","last_change":"2023-10-08T16:06:40.270577+0000","last_active":"2023-10-08T16:06:40.276523+0000","last_peered":"2023-10-08T16:06:40.276523+0000","last_clean":"2023-10-08T16:06:40.276523+0000","last_became_active":"2023-10-08T16:06:40.270269+0000","last_became_peered":"2023-10-08T16:06:40.270269+0000","last_unstale":"2023-10-08T16:06:40.276523+0000","last_undegraded":"2023-10-08T16:06:40.276523+0000","last_fullsized":"2023-10-08T16:06:40.276523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279700+0000","last_change":"2023-10-08T16:06:40.272575+0000","last_active":"2023-10-08T16:06:40.279700+0000","last_peered":"2023-10-08T16:06:40.279700+0000","last_clean":"2023-10-08T16:06:40.279700+0000","last_became_active":"2023-10-08T16:06:40.272126+0000","last_became_peered":"2023-10-08T16:06:40.272126+0000","last_unstale":"2023-10-08T16:06:40.279700+0000","last_undegraded":"2023-10-08T16:06:40.279700+0000","last_fullsized":"2023-10-08T16:06:40.279700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279736+0000","last_change":"2023-10-08T16:06:40.277232+0000","last_active":"2023-10-08T16:06:40.279736+0000","last_peered":"2023-10-08T16:06:40.279736+0000","last_clean":"2023-10-08T16:06:40.279736+0000","last_became_active":"2023-10-08T16:06:40.276903+0000","last_became_peered":"2023-10-08T16:06:40.276903+0000","last_unstale":"2023-10-08T16:06:40.279736+0000","last_undegraded":"2023-10-08T16:06:40.279736+0000","last_fullsized":"2023-10-08T16:06:40.279736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281289+0000","last_change":"2023-10-08T16:06:40.279113+0000","last_active":"2023-10-08T16:06:40.281289+0000","last_peered":"2023-10-08T16:06:40.281289+0000","last_clean":"2023-10-08T16:06:40.281289+0000","last_became_active":"2023-10-08T16:06:40.278772+0000","last_became_peered":"2023-10-08T16:06:40.278772+0000","last_unstale":"2023-10-08T16:06:40.281289+0000","last_undegraded":"2023-10-08T16:06:40.281289+0000","last_fullsized":"2023-10-08T16:06:40.281289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.284590+0000","last_change":"2023-10-08T16:06:40.280182+0000","last_active":"2023-10-08T16:06:40.284590+0000","last_peered":"2023-10-08T16:06:40.284590+0000","last_clean":"2023-10-08T16:06:40.284590+0000","last_became_active":"2023-10-08T16:06:40.279850+0000","last_became_peered":"2023-10-08T16:06:40.279850+0000","last_unstale":"2023-10-08T16:06:40.284590+0000","last_undegraded":"2023-10-08T16:06:40.284590+0000","last_fullsized":"2023-10-08T16:06:40.284590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:54.574906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279582+0000","last_change":"2023-10-08T16:06:40.275718+0000","last_active":"2023-10-08T16:06:40.279582+0000","last_peered":"2023-10-08T16:06:40.279582+0000","last_clean":"2023-10-08T16:06:40.279582+0000","last_became_active":"2023-10-08T16:06:40.275419+0000","last_became_peered":"2023-10-08T16:06:40.275419+0000","last_unstale":"2023-10-08T16:06:40.279582+0000","last_undegraded":"2023-10-08T16:06:40.279582+0000","last_fullsized":"2023-10-08T16:06:40.279582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281916+0000","last_change":"2023-10-08T16:06:40.276225+0000","last_active":"2023-10-08T16:06:40.281916+0000","last_peered":"2023-10-08T16:06:40.281916+0000","last_clean":"2023-10-08T16:06:40.281916+0000","last_became_active":"2023-10-08T16:06:40.275876+0000","last_became_peered":"2023-10-08T16:06:40.275876+0000","last_unstale":"2023-10-08T16:06:40.281916+0000","last_undegraded":"2023-10-08T16:06:40.281916+0000","last_fullsized":"2023-10-08T16:06:40.281916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270998+0000","last_change":"2023-10-08T16:06:40.264918+0000","last_active":"2023-10-08T16:06:40.270998+0000","last_peered":"2023-10-08T16:06:40.270998+0000","last_clean":"2023-10-08T16:06:40.270998+0000","last_became_active":"2023-10-08T16:06:40.264124+0000","last_became_peered":"2023-10-08T16:06:40.264124+0000","last_unstale":"2023-10-08T16:06:40.270998+0000","last_undegraded":"2023-10-08T16:06:40.270998+0000","last_fullsized":"2023-10-08T16:06:40.270998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273343+0000","last_change":"2023-10-08T16:06:40.269867+0000","last_active":"2023-10-08T16:06:40.273343+0000","last_peered":"2023-10-08T16:06:40.273343+0000","last_clean":"2023-10-08T16:06:40.273343+0000","last_became_active":"2023-10-08T16:06:40.268208+0000","last_became_peered":"2023-10-08T16:06:40.268208+0000","last_unstale":"2023-10-08T16:06:40.273343+0000","last_undegraded":"2023-10-08T16:06:40.273343+0000","last_fullsized":"2023-10-08T16:06:40.273343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275554+0000","last_change":"2023-10-08T16:06:40.264028+0000","last_active":"2023-10-08T16:06:40.275554+0000","last_peered":"2023-10-08T16:06:40.275554+0000","last_clean":"2023-10-08T16:06:40.275554+0000","last_became_active":"2023-10-08T16:06:40.263715+0000","last_became_peered":"2023-10-08T16:06:40.263715+0000","last_unstale":"2023-10-08T16:06:40.275554+0000","last_undegraded":"2023-10-08T16:06:40.275554+0000","last_fullsized":"2023-10-08T16:06:40.275554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:55.266658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271470+0000","last_change":"2023-10-08T16:06:40.269258+0000","last_active":"2023-10-08T16:06:40.271470+0000","last_peered":"2023-10-08T16:06:40.271470+0000","last_clean":"2023-10-08T16:06:40.271470+0000","last_became_active":"2023-10-08T16:06:40.268883+0000","last_became_peered":"2023-10-08T16:06:40.268883+0000","last_unstale":"2023-10-08T16:06:40.271470+0000","last_undegraded":"2023-10-08T16:06:40.271470+0000","last_fullsized":"2023-10-08T16:06:40.271470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282671+0000","last_change":"2023-10-08T16:06:40.278397+0000","last_active":"2023-10-08T16:06:40.282671+0000","last_peered":"2023-10-08T16:06:40.282671+0000","last_clean":"2023-10-08T16:06:40.282671+0000","last_became_active":"2023-10-08T16:06:40.277981+0000","last_became_peered":"2023-10-08T16:06:40.277981+0000","last_unstale":"2023-10-08T16:06:40.282671+0000","last_undegraded":"2023-10-08T16:06:40.282671+0000","last_fullsized":"2023-10-08T16:06:40.282671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282436+0000","last_change":"2023-10-08T16:06:40.276109+0000","last_active":"2023-10-08T16:06:40.282436+0000","last_peered":"2023-10-08T16:06:40.282436+0000","last_clean":"2023-10-08T16:06:40.282436+0000","last_became_active":"2023-10-08T16:06:40.275481+0000","last_became_peered":"2023-10-08T16:06:40.275481+0000","last_unstale":"2023-10-08T16:06:40.282436+0000","last_undegraded":"2023-10-08T16:06:40.282436+0000","last_fullsized":"2023-10-08T16:06:40.282436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267040+0000","last_change":"2023-10-08T16:06:40.261754+0000","last_active":"2023-10-08T16:06:40.267040+0000","last_peered":"2023-10-08T16:06:40.267040+0000","last_clean":"2023-10-08T16:06:40.267040+0000","last_became_active":"2023-10-08T16:06:40.261437+0000","last_became_peered":"2023-10-08T16:06:40.261437+0000","last_unstale":"2023-10-08T16:06:40.267040+0000","last_undegraded":"2023-10-08T16:06:40.267040+0000","last_fullsized":"2023-10-08T16:06:40.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277114+0000","last_change":"2023-10-08T16:06:40.271380+0000","last_active":"2023-10-08T16:06:40.277114+0000","last_peered":"2023-10-08T16:06:40.277114+0000","last_clean":"2023-10-08T16:06:40.277114+0000","last_became_active":"2023-10-08T16:06:40.271014+0000","last_became_peered":"2023-10-08T16:06:40.271014+0000","last_unstale":"2023-10-08T16:06:40.277114+0000","last_undegraded":"2023-10-08T16:06:40.277114+0000","last_fullsized":"2023-10-08T16:06:40.277114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:46.876039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275113+0000","last_change":"2023-10-08T16:06:40.264967+0000","last_active":"2023-10-08T16:06:40.275113+0000","last_peered":"2023-10-08T16:06:40.275113+0000","last_clean":"2023-10-08T16:06:40.275113+0000","last_became_active":"2023-10-08T16:06:40.264522+0000","last_became_peered":"2023-10-08T16:06:40.264522+0000","last_unstale":"2023-10-08T16:06:40.275113+0000","last_undegraded":"2023-10-08T16:06:40.275113+0000","last_fullsized":"2023-10-08T16:06:40.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275758+0000","last_change":"2023-10-08T16:06:40.266852+0000","last_active":"2023-10-08T16:06:40.275758+0000","last_peered":"2023-10-08T16:06:40.275758+0000","last_clean":"2023-10-08T16:06:40.275758+0000","last_became_active":"2023-10-08T16:06:40.266394+0000","last_became_peered":"2023-10-08T16:06:40.266394+0000","last_unstale":"2023-10-08T16:06:40.275758+0000","last_undegraded":"2023-10-08T16:06:40.275758+0000","last_fullsized":"2023-10-08T16:06:40.275758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279658+0000","last_change":"2023-10-08T16:06:40.272299+0000","last_active":"2023-10-08T16:06:40.279658+0000","last_peered":"2023-10-08T16:06:40.279658+0000","last_clean":"2023-10-08T16:06:40.279658+0000","last_became_active":"2023-10-08T16:06:40.271714+0000","last_became_peered":"2023-10-08T16:06:40.271714+0000","last_unstale":"2023-10-08T16:06:40.279658+0000","last_undegraded":"2023-10-08T16:06:40.279658+0000","last_fullsized":"2023-10-08T16:06:40.279658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:33.308266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268225+0000","last_change":"2023-10-08T16:06:40.266098+0000","last_active":"2023-10-08T16:06:40.268225+0000","last_peered":"2023-10-08T16:06:40.268225+0000","last_clean":"2023-10-08T16:06:40.268225+0000","last_became_active":"2023-10-08T16:06:40.265779+0000","last_became_peered":"2023-10-08T16:06:40.265779+0000","last_unstale":"2023-10-08T16:06:40.268225+0000","last_undegraded":"2023-10-08T16:06:40.268225+0000","last_fullsized":"2023-10-08T16:06:40.268225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279321+0000","last_change":"2023-10-08T16:06:40.269099+0000","last_active":"2023-10-08T16:06:40.279321+0000","last_peered":"2023-10-08T16:06:40.279321+0000","last_clean":"2023-10-08T16:06:40.279321+0000","last_became_active":"2023-10-08T16:06:40.268796+0000","last_became_peered":"2023-10-08T16:06:40.268796+0000","last_unstale":"2023-10-08T16:06:40.279321+0000","last_undegraded":"2023-10-08T16:06:40.279321+0000","last_fullsized":"2023-10-08T16:06:40.279321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268296+0000","last_change":"2023-10-08T16:06:40.264696+0000","last_active":"2023-10-08T16:06:40.268296+0000","last_peered":"2023-10-08T16:06:40.268296+0000","last_clean":"2023-10-08T16:06:40.268296+0000","last_became_active":"2023-10-08T16:06:40.264322+0000","last_became_peered":"2023-10-08T16:06:40.264322+0000","last_unstale":"2023-10-08T16:06:40.268296+0000","last_undegraded":"2023-10-08T16:06:40.268296+0000","last_fullsized":"2023-10-08T16:06:40.268296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275189+0000","last_change":"2023-10-08T16:06:40.266542+0000","last_active":"2023-10-08T16:06:40.275189+0000","last_peered":"2023-10-08T16:06:40.275189+0000","last_clean":"2023-10-08T16:06:40.275189+0000","last_became_active":"2023-10-08T16:06:40.266258+0000","last_became_peered":"2023-10-08T16:06:40.266258+0000","last_unstale":"2023-10-08T16:06:40.275189+0000","last_undegraded":"2023-10-08T16:06:40.275189+0000","last_fullsized":"2023-10-08T16:06:40.275189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270627+0000","last_change":"2023-10-08T16:06:40.268954+0000","last_active":"2023-10-08T16:06:40.270627+0000","last_peered":"2023-10-08T16:06:40.270627+0000","last_clean":"2023-10-08T16:06:40.270627+0000","last_became_active":"2023-10-08T16:06:40.268456+0000","last_became_peered":"2023-10-08T16:06:40.268456+0000","last_unstale":"2023-10-08T16:06:40.270627+0000","last_undegraded":"2023-10-08T16:06:40.270627+0000","last_fullsized":"2023-10-08T16:06:40.270627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273146+0000","last_change":"2023-10-08T16:06:40.268821+0000","last_active":"2023-10-08T16:06:40.273146+0000","last_peered":"2023-10-08T16:06:40.273146+0000","last_clean":"2023-10-08T16:06:40.273146+0000","last_became_active":"2023-10-08T16:06:40.268485+0000","last_became_peered":"2023-10-08T16:06:40.268485+0000","last_unstale":"2023-10-08T16:06:40.273146+0000","last_undegraded":"2023-10-08T16:06:40.273146+0000","last_fullsized":"2023-10-08T16:06:40.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275805+0000","last_change":"2023-10-08T16:06:40.267487+0000","last_active":"2023-10-08T16:06:40.275805+0000","last_peered":"2023-10-08T16:06:40.275805+0000","last_clean":"2023-10-08T16:06:40.275805+0000","last_became_active":"2023-10-08T16:06:40.267198+0000","last_became_peered":"2023-10-08T16:06:40.267198+0000","last_unstale":"2023-10-08T16:06:40.275805+0000","last_undegraded":"2023-10-08T16:06:40.275805+0000","last_fullsized":"2023-10-08T16:06:40.275805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:02.789138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279681+0000","last_change":"2023-10-08T16:06:40.272431+0000","last_active":"2023-10-08T16:06:40.279681+0000","last_peered":"2023-10-08T16:06:40.279681+0000","last_clean":"2023-10-08T16:06:40.279681+0000","last_became_active":"2023-10-08T16:06:40.271999+0000","last_became_peered":"2023-10-08T16:06:40.271999+0000","last_unstale":"2023-10-08T16:06:40.279681+0000","last_undegraded":"2023-10-08T16:06:40.279681+0000","last_fullsized":"2023-10-08T16:06:40.279681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.123518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278116+0000","last_change":"2023-10-08T16:06:40.273286+0000","last_active":"2023-10-08T16:06:40.278116+0000","last_peered":"2023-10-08T16:06:40.278116+0000","last_clean":"2023-10-08T16:06:40.278116+0000","last_became_active":"2023-10-08T16:06:40.272933+0000","last_became_peered":"2023-10-08T16:06:40.272933+0000","last_unstale":"2023-10-08T16:06:40.278116+0000","last_undegraded":"2023-10-08T16:06:40.278116+0000","last_fullsized":"2023-10-08T16:06:40.278116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275156+0000","last_change":"2023-10-08T16:06:40.265329+0000","last_active":"2023-10-08T16:06:40.275156+0000","last_peered":"2023-10-08T16:06:40.275156+0000","last_clean":"2023-10-08T16:06:40.275156+0000","last_became_active":"2023-10-08T16:06:40.264972+0000","last_became_peered":"2023-10-08T16:06:40.264972+0000","last_unstale":"2023-10-08T16:06:40.275156+0000","last_undegraded":"2023-10-08T16:06:40.275156+0000","last_fullsized":"2023-10-08T16:06:40.275156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268526+0000","last_change":"2023-10-08T16:06:40.263993+0000","last_active":"2023-10-08T16:06:40.268526+0000","last_peered":"2023-10-08T16:06:40.268526+0000","last_clean":"2023-10-08T16:06:40.268526+0000","last_became_active":"2023-10-08T16:06:40.263538+0000","last_became_peered":"2023-10-08T16:06:40.263538+0000","last_unstale":"2023-10-08T16:06:40.268526+0000","last_undegraded":"2023-10-08T16:06:40.268526+0000","last_fullsized":"2023-10-08T16:06:40.268526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:29.217008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301721+0000","last_change":"2023-10-08T16:06:39.297623+0000","last_active":"2023-10-08T16:06:40.301721+0000","last_peered":"2023-10-08T16:06:40.301721+0000","last_clean":"2023-10-08T16:06:40.301721+0000","last_became_active":"2023-10-08T16:06:39.292440+0000","last_became_peered":"2023-10-08T16:06:39.292440+0000","last_unstale":"2023-10-08T16:06:40.301721+0000","last_undegraded":"2023-10-08T16:06:40.301721+0000","last_fullsized":"2023-10-08T16:06:40.301721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269305+0000","last_change":"2023-10-08T16:06:40.258340+0000","last_active":"2023-10-08T16:06:40.269305+0000","last_peered":"2023-10-08T16:06:40.269305+0000","last_clean":"2023-10-08T16:06:40.269305+0000","last_became_active":"2023-10-08T16:06:40.257980+0000","last_became_peered":"2023-10-08T16:06:40.257980+0000","last_unstale":"2023-10-08T16:06:40.269305+0000","last_undegraded":"2023-10-08T16:06:40.269305+0000","last_fullsized":"2023-10-08T16:06:40.269305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301568+0000","last_change":"2023-10-08T16:06:39.291777+0000","last_active":"2023-10-08T16:06:40.301568+0000","last_peered":"2023-10-08T16:06:40.301568+0000","last_clean":"2023-10-08T16:06:40.301568+0000","last_became_active":"2023-10-08T16:06:39.290855+0000","last_became_peered":"2023-10-08T16:06:39.290855+0000","last_unstale":"2023-10-08T16:06:40.301568+0000","last_undegraded":"2023-10-08T16:06:40.301568+0000","last_fullsized":"2023-10-08T16:06:40.301568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.255042+0000","last_change":"2023-10-08T16:06:39.301682+0000","last_active":"2023-10-08T16:06:40.255042+0000","last_peered":"2023-10-08T16:06:40.255042+0000","last_clean":"2023-10-08T16:06:40.255042+0000","last_became_active":"2023-10-08T16:06:39.300996+0000","last_became_peered":"2023-10-08T16:06:39.300996+0000","last_unstale":"2023-10-08T16:06:40.255042+0000","last_undegraded":"2023-10-08T16:06:40.255042+0000","last_fullsized":"2023-10-08T16:06:40.255042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270724+0000","last_change":"2023-10-08T16:06:40.266918+0000","last_active":"2023-10-08T16:06:40.270724+0000","last_peered":"2023-10-08T16:06:40.270724+0000","last_clean":"2023-10-08T16:06:40.270724+0000","last_became_active":"2023-10-08T16:06:40.266574+0000","last_became_peered":"2023-10-08T16:06:40.266574+0000","last_unstale":"2023-10-08T16:06:40.270724+0000","last_undegraded":"2023-10-08T16:06:40.270724+0000","last_fullsized":"2023-10-08T16:06:40.270724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:18.467147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269496+0000","last_change":"2023-10-08T16:06:39.294887+0000","last_active":"2023-10-08T16:06:40.269496+0000","last_peered":"2023-10-08T16:06:40.269496+0000","last_clean":"2023-10-08T16:06:40.269496+0000","last_became_active":"2023-10-08T16:06:39.294362+0000","last_became_peered":"2023-10-08T16:06:39.294362+0000","last_unstale":"2023-10-08T16:06:40.269496+0000","last_undegraded":"2023-10-08T16:06:40.269496+0000","last_fullsized":"2023-10-08T16:06:40.269496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.270647+0000","last_change":"2023-10-08T16:06:40.269161+0000","last_active":"2023-10-08T16:06:40.270647+0000","last_peered":"2023-10-08T16:06:40.270647+0000","last_clean":"2023-10-08T16:06:40.270647+0000","last_became_active":"2023-10-08T16:06:40.268258+0000","last_became_peered":"2023-10-08T16:06:40.268258+0000","last_unstale":"2023-10-08T16:06:40.270647+0000","last_undegraded":"2023-10-08T16:06:40.270647+0000","last_fullsized":"2023-10-08T16:06:40.270647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253455+0000","last_change":"2023-10-08T16:06:39.298780+0000","last_active":"2023-10-08T16:06:40.253455+0000","last_peered":"2023-10-08T16:06:40.253455+0000","last_clean":"2023-10-08T16:06:40.253455+0000","last_became_active":"2023-10-08T16:06:39.298461+0000","last_became_peered":"2023-10-08T16:06:39.298461+0000","last_unstale":"2023-10-08T16:06:40.253455+0000","last_undegraded":"2023-10-08T16:06:40.253455+0000","last_fullsized":"2023-10-08T16:06:40.253455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282263+0000","last_change":"2023-10-08T16:06:40.275019+0000","last_active":"2023-10-08T16:06:40.282263+0000","last_peered":"2023-10-08T16:06:40.282263+0000","last_clean":"2023-10-08T16:06:40.282263+0000","last_became_active":"2023-10-08T16:06:40.269866+0000","last_became_peered":"2023-10-08T16:06:40.269866+0000","last_unstale":"2023-10-08T16:06:40.282263+0000","last_undegraded":"2023-10-08T16:06:40.282263+0000","last_fullsized":"2023-10-08T16:06:40.282263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:45.504086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.274887+0000","last_change":"2023-10-08T16:06:39.302453+0000","last_active":"2023-10-08T16:06:40.274887+0000","last_peered":"2023-10-08T16:06:40.274887+0000","last_clean":"2023-10-08T16:06:40.274887+0000","last_became_active":"2023-10-08T16:06:39.302108+0000","last_became_peered":"2023-10-08T16:06:39.302108+0000","last_unstale":"2023-10-08T16:06:40.274887+0000","last_undegraded":"2023-10-08T16:06:40.274887+0000","last_fullsized":"2023-10-08T16:06:40.274887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278252+0000","last_change":"2023-10-08T16:06:40.273266+0000","last_active":"2023-10-08T16:06:40.278252+0000","last_peered":"2023-10-08T16:06:40.278252+0000","last_clean":"2023-10-08T16:06:40.278252+0000","last_became_active":"2023-10-08T16:06:40.272860+0000","last_became_peered":"2023-10-08T16:06:40.272860+0000","last_unstale":"2023-10-08T16:06:40.278252+0000","last_undegraded":"2023-10-08T16:06:40.278252+0000","last_fullsized":"2023-10-08T16:06:40.278252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300737+0000","last_change":"2023-10-08T16:06:39.293871+0000","last_active":"2023-10-08T16:06:40.300737+0000","last_peered":"2023-10-08T16:06:40.300737+0000","last_clean":"2023-10-08T16:06:40.300737+0000","last_became_active":"2023-10-08T16:06:39.293517+0000","last_became_peered":"2023-10-08T16:06:39.293517+0000","last_unstale":"2023-10-08T16:06:40.300737+0000","last_undegraded":"2023-10-08T16:06:40.300737+0000","last_fullsized":"2023-10-08T16:06:40.300737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.271405+0000","last_change":"2023-10-08T16:06:40.266413+0000","last_active":"2023-10-08T16:06:40.271405+0000","last_peered":"2023-10-08T16:06:40.271405+0000","last_clean":"2023-10-08T16:06:40.271405+0000","last_became_active":"2023-10-08T16:06:40.266098+0000","last_became_peered":"2023-10-08T16:06:40.266098+0000","last_unstale":"2023-10-08T16:06:40.271405+0000","last_undegraded":"2023-10-08T16:06:40.271405+0000","last_fullsized":"2023-10-08T16:06:40.271405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:25.752461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.307815+0000","last_change":"2023-10-08T16:06:39.296406+0000","last_active":"2023-10-08T16:06:40.307815+0000","last_peered":"2023-10-08T16:06:40.307815+0000","last_clean":"2023-10-08T16:06:40.307815+0000","last_became_active":"2023-10-08T16:06:39.296075+0000","last_became_peered":"2023-10-08T16:06:39.296075+0000","last_unstale":"2023-10-08T16:06:40.307815+0000","last_undegraded":"2023-10-08T16:06:40.307815+0000","last_fullsized":"2023-10-08T16:06:40.307815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275787+0000","last_change":"2023-10-08T16:06:40.270048+0000","last_active":"2023-10-08T16:06:40.275787+0000","last_peered":"2023-10-08T16:06:40.275787+0000","last_clean":"2023-10-08T16:06:40.275787+0000","last_became_active":"2023-10-08T16:06:40.269726+0000","last_became_peered":"2023-10-08T16:06:40.269726+0000","last_unstale":"2023-10-08T16:06:40.275787+0000","last_undegraded":"2023-10-08T16:06:40.275787+0000","last_fullsized":"2023-10-08T16:06:40.275787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:25.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301282+0000","last_change":"2023-10-08T16:06:39.294192+0000","last_active":"2023-10-08T16:06:40.301282+0000","last_peered":"2023-10-08T16:06:40.301282+0000","last_clean":"2023-10-08T16:06:40.301282+0000","last_became_active":"2023-10-08T16:06:39.293881+0000","last_became_peered":"2023-10-08T16:06:39.293881+0000","last_unstale":"2023-10-08T16:06:40.301282+0000","last_undegraded":"2023-10-08T16:06:40.301282+0000","last_fullsized":"2023-10-08T16:06:40.301282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:43.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275717+0000","last_change":"2023-10-08T16:06:40.266213+0000","last_active":"2023-10-08T16:06:40.275717+0000","last_peered":"2023-10-08T16:06:40.275717+0000","last_clean":"2023-10-08T16:06:40.275717+0000","last_became_active":"2023-10-08T16:06:40.265860+0000","last_became_peered":"2023-10-08T16:06:40.265860+0000","last_unstale":"2023-10-08T16:06:40.275717+0000","last_undegraded":"2023-10-08T16:06:40.275717+0000","last_fullsized":"2023-10-08T16:06:40.275717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269558+0000","last_change":"2023-10-08T16:06:39.300216+0000","last_active":"2023-10-08T16:06:40.269558+0000","last_peered":"2023-10-08T16:06:40.269558+0000","last_clean":"2023-10-08T16:06:40.269558+0000","last_became_active":"2023-10-08T16:06:39.299914+0000","last_became_peered":"2023-10-08T16:06:39.299914+0000","last_unstale":"2023-10-08T16:06:40.269558+0000","last_undegraded":"2023-10-08T16:06:40.269558+0000","last_fullsized":"2023-10-08T16:06:40.269558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277069+0000","last_change":"2023-10-08T16:06:40.272059+0000","last_active":"2023-10-08T16:06:40.277069+0000","last_peered":"2023-10-08T16:06:40.277069+0000","last_clean":"2023-10-08T16:06:40.277069+0000","last_became_active":"2023-10-08T16:06:40.271730+0000","last_became_peered":"2023-10-08T16:06:40.271730+0000","last_unstale":"2023-10-08T16:06:40.277069+0000","last_undegraded":"2023-10-08T16:06:40.277069+0000","last_fullsized":"2023-10-08T16:06:40.277069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.251622+0000","last_change":"2023-10-08T16:06:39.291194+0000","last_active":"2023-10-08T16:06:40.251622+0000","last_peered":"2023-10-08T16:06:40.251622+0000","last_clean":"2023-10-08T16:06:40.251622+0000","last_became_active":"2023-10-08T16:06:39.290849+0000","last_became_peered":"2023-10-08T16:06:39.290849+0000","last_unstale":"2023-10-08T16:06:40.251622+0000","last_undegraded":"2023-10-08T16:06:40.251622+0000","last_fullsized":"2023-10-08T16:06:40.251622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267696+0000","last_change":"2023-10-08T16:06:40.259709+0000","last_active":"2023-10-08T16:06:40.267696+0000","last_peered":"2023-10-08T16:06:40.267696+0000","last_clean":"2023-10-08T16:06:40.267696+0000","last_became_active":"2023-10-08T16:06:40.259122+0000","last_became_peered":"2023-10-08T16:06:40.259122+0000","last_unstale":"2023-10-08T16:06:40.267696+0000","last_undegraded":"2023-10-08T16:06:40.267696+0000","last_fullsized":"2023-10-08T16:06:40.267696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.306618+0000","last_change":"2023-10-08T16:06:39.291829+0000","last_active":"2023-10-08T16:06:40.306618+0000","last_peered":"2023-10-08T16:06:40.306618+0000","last_clean":"2023-10-08T16:06:40.306618+0000","last_became_active":"2023-10-08T16:06:39.291331+0000","last_became_peered":"2023-10-08T16:06:39.291331+0000","last_unstale":"2023-10-08T16:06:40.306618+0000","last_undegraded":"2023-10-08T16:06:40.306618+0000","last_fullsized":"2023-10-08T16:06:40.306618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277354+0000","last_change":"2023-10-08T16:06:40.270693+0000","last_active":"2023-10-08T16:06:40.277354+0000","last_peered":"2023-10-08T16:06:40.277354+0000","last_clean":"2023-10-08T16:06:40.277354+0000","last_became_active":"2023-10-08T16:06:40.269238+0000","last_became_peered":"2023-10-08T16:06:40.269238+0000","last_unstale":"2023-10-08T16:06:40.277354+0000","last_undegraded":"2023-10-08T16:06:40.277354+0000","last_fullsized":"2023-10-08T16:06:40.277354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.302954+0000","last_change":"2023-10-08T16:06:39.294859+0000","last_active":"2023-10-08T16:06:40.302954+0000","last_peered":"2023-10-08T16:06:40.302954+0000","last_clean":"2023-10-08T16:06:40.302954+0000","last_became_active":"2023-10-08T16:06:39.294549+0000","last_became_peered":"2023-10-08T16:06:39.294549+0000","last_unstale":"2023-10-08T16:06:40.302954+0000","last_undegraded":"2023-10-08T16:06:40.302954+0000","last_fullsized":"2023-10-08T16:06:40.302954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:30.419636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276379+0000","last_change":"2023-10-08T16:06:40.270175+0000","last_active":"2023-10-08T16:06:40.276379+0000","last_peered":"2023-10-08T16:06:40.276379+0000","last_clean":"2023-10-08T16:06:40.276379+0000","last_became_active":"2023-10-08T16:06:40.269029+0000","last_became_peered":"2023-10-08T16:06:40.269029+0000","last_unstale":"2023-10-08T16:06:40.276379+0000","last_undegraded":"2023-10-08T16:06:40.276379+0000","last_fullsized":"2023-10-08T16:06:40.276379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301969+0000","last_change":"2023-10-08T16:06:39.299037+0000","last_active":"2023-10-08T16:06:40.301969+0000","last_peered":"2023-10-08T16:06:40.301969+0000","last_clean":"2023-10-08T16:06:40.301969+0000","last_became_active":"2023-10-08T16:06:39.298664+0000","last_became_peered":"2023-10-08T16:06:39.298664+0000","last_unstale":"2023-10-08T16:06:40.301969+0000","last_undegraded":"2023-10-08T16:06:40.301969+0000","last_fullsized":"2023-10-08T16:06:40.301969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.273064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.277144+0000","last_change":"2023-10-08T16:06:40.272886+0000","last_active":"2023-10-08T16:06:40.277144+0000","last_peered":"2023-10-08T16:06:40.277144+0000","last_clean":"2023-10-08T16:06:40.277144+0000","last_became_active":"2023-10-08T16:06:40.272556+0000","last_became_peered":"2023-10-08T16:06:40.272556+0000","last_unstale":"2023-10-08T16:06:40.277144+0000","last_undegraded":"2023-10-08T16:06:40.277144+0000","last_fullsized":"2023-10-08T16:06:40.277144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300889+0000","last_change":"2023-10-08T16:06:39.293894+0000","last_active":"2023-10-08T16:06:40.300889+0000","last_peered":"2023-10-08T16:06:40.300889+0000","last_clean":"2023-10-08T16:06:40.300889+0000","last_became_active":"2023-10-08T16:06:39.293562+0000","last_became_peered":"2023-10-08T16:06:39.293562+0000","last_unstale":"2023-10-08T16:06:40.300889+0000","last_undegraded":"2023-10-08T16:06:40.300889+0000","last_fullsized":"2023-10-08T16:06:40.300889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282094+0000","last_change":"2023-10-08T16:06:40.273176+0000","last_active":"2023-10-08T16:06:40.282094+0000","last_peered":"2023-10-08T16:06:40.282094+0000","last_clean":"2023-10-08T16:06:40.282094+0000","last_became_active":"2023-10-08T16:06:40.272791+0000","last_became_peered":"2023-10-08T16:06:40.272791+0000","last_unstale":"2023-10-08T16:06:40.282094+0000","last_undegraded":"2023-10-08T16:06:40.282094+0000","last_fullsized":"2023-10-08T16:06:40.282094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:30.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.254116+0000","last_change":"2023-10-08T16:06:39.293390+0000","last_active":"2023-10-08T16:06:40.254116+0000","last_peered":"2023-10-08T16:06:40.254116+0000","last_clean":"2023-10-08T16:06:40.254116+0000","last_became_active":"2023-10-08T16:06:39.293063+0000","last_became_peered":"2023-10-08T16:06:39.293063+0000","last_unstale":"2023-10-08T16:06:40.254116+0000","last_undegraded":"2023-10-08T16:06:40.254116+0000","last_fullsized":"2023-10-08T16:06:40.254116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279769+0000","last_change":"2023-10-08T16:06:40.276714+0000","last_active":"2023-10-08T16:06:40.279769+0000","last_peered":"2023-10-08T16:06:40.279769+0000","last_clean":"2023-10-08T16:06:40.279769+0000","last_became_active":"2023-10-08T16:06:40.276322+0000","last_became_peered":"2023-10-08T16:06:40.276322+0000","last_unstale":"2023-10-08T16:06:40.279769+0000","last_undegraded":"2023-10-08T16:06:40.279769+0000","last_fullsized":"2023-10-08T16:06:40.279769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:28.338803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259410+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:06:40.259410+0000","last_peered":"2023-10-08T16:06:40.259410+0000","last_clean":"2023-10-08T16:06:40.259410+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:06:40.259410+0000","last_undegraded":"2023-10-08T16:06:40.259410+0000","last_fullsized":"2023-10-08T16:06:40.259410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269492+0000","last_change":"2023-10-08T16:06:39.293223+0000","last_active":"2023-10-08T16:06:40.269492+0000","last_peered":"2023-10-08T16:06:40.269492+0000","last_clean":"2023-10-08T16:06:40.269492+0000","last_became_active":"2023-10-08T16:06:39.292861+0000","last_became_peered":"2023-10-08T16:06:39.292861+0000","last_unstale":"2023-10-08T16:06:40.269492+0000","last_undegraded":"2023-10-08T16:06:40.269492+0000","last_fullsized":"2023-10-08T16:06:40.269492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.281318+0000","last_change":"2023-10-08T16:06:40.279550+0000","last_active":"2023-10-08T16:06:40.281318+0000","last_peered":"2023-10-08T16:06:40.281318+0000","last_clean":"2023-10-08T16:06:40.281318+0000","last_became_active":"2023-10-08T16:06:40.279258+0000","last_became_peered":"2023-10-08T16:06:40.279258+0000","last_unstale":"2023-10-08T16:06:40.281318+0000","last_undegraded":"2023-10-08T16:06:40.281318+0000","last_fullsized":"2023-10-08T16:06:40.281318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.259307+0000","last_change":"2023-10-08T16:06:39.303341+0000","last_active":"2023-10-08T16:06:40.259307+0000","last_peered":"2023-10-08T16:06:40.259307+0000","last_clean":"2023-10-08T16:06:40.259307+0000","last_became_active":"2023-10-08T16:06:39.303000+0000","last_became_peered":"2023-10-08T16:06:39.303000+0000","last_unstale":"2023-10-08T16:06:40.259307+0000","last_undegraded":"2023-10-08T16:06:40.259307+0000","last_fullsized":"2023-10-08T16:06:40.259307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:46.169380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269369+0000","last_change":"2023-10-08T16:06:40.259545+0000","last_active":"2023-10-08T16:06:40.269369+0000","last_peered":"2023-10-08T16:06:40.269369+0000","last_clean":"2023-10-08T16:06:40.269369+0000","last_became_active":"2023-10-08T16:06:40.259191+0000","last_became_peered":"2023-10-08T16:06:40.259191+0000","last_unstale":"2023-10-08T16:06:40.269369+0000","last_undegraded":"2023-10-08T16:06:40.269369+0000","last_fullsized":"2023-10-08T16:06:40.269369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:05.607495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.253367+0000","last_change":"2023-10-08T16:06:39.299839+0000","last_active":"2023-10-08T16:06:40.253367+0000","last_peered":"2023-10-08T16:06:40.253367+0000","last_clean":"2023-10-08T16:06:40.253367+0000","last_became_active":"2023-10-08T16:06:39.299351+0000","last_became_peered":"2023-10-08T16:06:39.299351+0000","last_unstale":"2023-10-08T16:06:40.253367+0000","last_undegraded":"2023-10-08T16:06:40.253367+0000","last_fullsized":"2023-10-08T16:06:40.253367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269108+0000","last_change":"2023-10-08T16:06:40.263602+0000","last_active":"2023-10-08T16:06:40.269108+0000","last_peered":"2023-10-08T16:06:40.269108+0000","last_clean":"2023-10-08T16:06:40.269108+0000","last_became_active":"2023-10-08T16:06:40.263275+0000","last_became_peered":"2023-10-08T16:06:40.263275+0000","last_unstale":"2023-10-08T16:06:40.269108+0000","last_undegraded":"2023-10-08T16:06:40.269108+0000","last_fullsized":"2023-10-08T16:06:40.269108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:18.084600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269681+0000","last_change":"2023-10-08T16:06:39.298167+0000","last_active":"2023-10-08T16:06:40.269681+0000","last_peered":"2023-10-08T16:06:40.269681+0000","last_clean":"2023-10-08T16:06:40.269681+0000","last_became_active":"2023-10-08T16:06:39.297678+0000","last_became_peered":"2023-10-08T16:06:39.297678+0000","last_unstale":"2023-10-08T16:06:40.269681+0000","last_undegraded":"2023-10-08T16:06:40.269681+0000","last_fullsized":"2023-10-08T16:06:40.269681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.276831+0000","last_change":"2023-10-08T16:06:40.271343+0000","last_active":"2023-10-08T16:06:40.276831+0000","last_peered":"2023-10-08T16:06:40.276831+0000","last_clean":"2023-10-08T16:06:40.276831+0000","last_became_active":"2023-10-08T16:06:40.270882+0000","last_became_peered":"2023-10-08T16:06:40.270882+0000","last_unstale":"2023-10-08T16:06:40.276831+0000","last_undegraded":"2023-10-08T16:06:40.276831+0000","last_fullsized":"2023-10-08T16:06:40.276831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:47.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258762+0000","last_change":"2023-10-08T16:06:39.293588+0000","last_active":"2023-10-08T16:06:40.258762+0000","last_peered":"2023-10-08T16:06:40.258762+0000","last_clean":"2023-10-08T16:06:40.258762+0000","last_became_active":"2023-10-08T16:06:39.293209+0000","last_became_peered":"2023-10-08T16:06:39.293209+0000","last_unstale":"2023-10-08T16:06:40.258762+0000","last_undegraded":"2023-10-08T16:06:40.258762+0000","last_fullsized":"2023-10-08T16:06:40.258762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:02.678867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282337+0000","last_change":"2023-10-08T16:06:40.275327+0000","last_active":"2023-10-08T16:06:40.282337+0000","last_peered":"2023-10-08T16:06:40.282337+0000","last_clean":"2023-10-08T16:06:40.282337+0000","last_became_active":"2023-10-08T16:06:40.274778+0000","last_became_peered":"2023-10-08T16:06:40.274778+0000","last_unstale":"2023-10-08T16:06:40.282337+0000","last_undegraded":"2023-10-08T16:06:40.282337+0000","last_fullsized":"2023-10-08T16:06:40.282337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:24.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.262394+0000","last_change":"2023-10-08T16:06:39.303540+0000","last_active":"2023-10-08T16:06:40.262394+0000","last_peered":"2023-10-08T16:06:40.262394+0000","last_clean":"2023-10-08T16:06:40.262394+0000","last_became_active":"2023-10-08T16:06:39.303264+0000","last_became_peered":"2023-10-08T16:06:39.303264+0000","last_unstale":"2023-10-08T16:06:40.262394+0000","last_undegraded":"2023-10-08T16:06:40.262394+0000","last_fullsized":"2023-10-08T16:06:40.262394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.269828+0000","last_change":"2023-10-08T16:06:40.263957+0000","last_active":"2023-10-08T16:06:40.269828+0000","last_peered":"2023-10-08T16:06:40.269828+0000","last_clean":"2023-10-08T16:06:40.269828+0000","last_became_active":"2023-10-08T16:06:40.263566+0000","last_became_peered":"2023-10-08T16:06:40.263566+0000","last_unstale":"2023-10-08T16:06:40.269828+0000","last_undegraded":"2023-10-08T16:06:40.269828+0000","last_fullsized":"2023-10-08T16:06:40.269828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:43.114636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:06:41.252063+0000","last_change":"2023-10-08T16:06:39.301605+0000","last_active":"2023-10-08T16:06:41.252063+0000","last_peered":"2023-10-08T16:06:41.252063+0000","last_clean":"2023-10-08T16:06:41.252063+0000","last_became_active":"2023-10-08T16:06:39.301289+0000","last_became_peered":"2023-10-08T16:06:39.301289+0000","last_unstale":"2023-10-08T16:06:41.252063+0000","last_undegraded":"2023-10-08T16:06:41.252063+0000","last_fullsized":"2023-10-08T16:06:41.252063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:28.206117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273159+0000","last_change":"2023-10-08T16:06:40.268834+0000","last_active":"2023-10-08T16:06:40.273159+0000","last_peered":"2023-10-08T16:06:40.273159+0000","last_clean":"2023-10-08T16:06:40.273159+0000","last_became_active":"2023-10-08T16:06:40.268449+0000","last_became_peered":"2023-10-08T16:06:40.268449+0000","last_unstale":"2023-10-08T16:06:40.273159+0000","last_undegraded":"2023-10-08T16:06:40.273159+0000","last_fullsized":"2023-10-08T16:06:40.273159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:38.376532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300880+0000","last_change":"2023-10-08T16:06:39.300940+0000","last_active":"2023-10-08T16:06:40.300880+0000","last_peered":"2023-10-08T16:06:40.300880+0000","last_clean":"2023-10-08T16:06:40.300880+0000","last_became_active":"2023-10-08T16:06:39.300556+0000","last_became_peered":"2023-10-08T16:06:39.300556+0000","last_unstale":"2023-10-08T16:06:40.300880+0000","last_undegraded":"2023-10-08T16:06:40.300880+0000","last_fullsized":"2023-10-08T16:06:40.300880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:28.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.275841+0000","last_change":"2023-10-08T16:06:40.267528+0000","last_active":"2023-10-08T16:06:40.275841+0000","last_peered":"2023-10-08T16:06:40.275841+0000","last_clean":"2023-10-08T16:06:40.275841+0000","last_became_active":"2023-10-08T16:06:40.266866+0000","last_became_peered":"2023-10-08T16:06:40.266866+0000","last_unstale":"2023-10-08T16:06:40.275841+0000","last_undegraded":"2023-10-08T16:06:40.275841+0000","last_fullsized":"2023-10-08T16:06:40.275841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:53.878852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258987+0000","last_change":"2023-10-08T16:06:39.302711+0000","last_active":"2023-10-08T16:06:40.258987+0000","last_peered":"2023-10-08T16:06:40.258987+0000","last_clean":"2023-10-08T16:06:40.258987+0000","last_became_active":"2023-10-08T16:06:39.302404+0000","last_became_peered":"2023-10-08T16:06:39.302404+0000","last_unstale":"2023-10-08T16:06:40.258987+0000","last_undegraded":"2023-10-08T16:06:40.258987+0000","last_fullsized":"2023-10-08T16:06:40.258987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268533+0000","last_change":"2023-10-08T16:06:40.263548+0000","last_active":"2023-10-08T16:06:40.268533+0000","last_peered":"2023-10-08T16:06:40.268533+0000","last_clean":"2023-10-08T16:06:40.268533+0000","last_became_active":"2023-10-08T16:06:40.263230+0000","last_became_peered":"2023-10-08T16:06:40.263230+0000","last_unstale":"2023-10-08T16:06:40.268533+0000","last_undegraded":"2023-10-08T16:06:40.268533+0000","last_fullsized":"2023-10-08T16:06:40.268533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:50.492409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.258991+0000","last_change":"2023-10-08T16:06:39.299840+0000","last_active":"2023-10-08T16:06:40.258991+0000","last_peered":"2023-10-08T16:06:40.258991+0000","last_clean":"2023-10-08T16:06:40.258991+0000","last_became_active":"2023-10-08T16:06:39.299502+0000","last_became_peered":"2023-10-08T16:06:39.299502+0000","last_unstale":"2023-10-08T16:06:40.258991+0000","last_undegraded":"2023-10-08T16:06:40.258991+0000","last_fullsized":"2023-10-08T16:06:40.258991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:49.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.268950+0000","last_change":"2023-10-08T16:06:40.263516+0000","last_active":"2023-10-08T16:06:40.268950+0000","last_peered":"2023-10-08T16:06:40.268950+0000","last_clean":"2023-10-08T16:06:40.268950+0000","last_became_active":"2023-10-08T16:06:40.263180+0000","last_became_peered":"2023-10-08T16:06:40.263180+0000","last_unstale":"2023-10-08T16:06:40.268950+0000","last_undegraded":"2023-10-08T16:06:40.268950+0000","last_fullsized":"2023-10-08T16:06:40.268950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:28.871262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.260056+0000","last_change":"2023-10-08T16:06:39.302588+0000","last_active":"2023-10-08T16:06:40.260056+0000","last_peered":"2023-10-08T16:06:40.260056+0000","last_clean":"2023-10-08T16:06:40.260056+0000","last_became_active":"2023-10-08T16:06:39.302361+0000","last_became_peered":"2023-10-08T16:06:39.302361+0000","last_unstale":"2023-10-08T16:06:40.260056+0000","last_undegraded":"2023-10-08T16:06:40.260056+0000","last_fullsized":"2023-10-08T16:06:40.260056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267686+0000","last_change":"2023-10-08T16:06:40.262950+0000","last_active":"2023-10-08T16:06:40.267686+0000","last_peered":"2023-10-08T16:06:40.267686+0000","last_clean":"2023-10-08T16:06:40.267686+0000","last_became_active":"2023-10-08T16:06:40.262620+0000","last_became_peered":"2023-10-08T16:06:40.262620+0000","last_unstale":"2023-10-08T16:06:40.267686+0000","last_undegraded":"2023-10-08T16:06:40.267686+0000","last_fullsized":"2023-10-08T16:06:40.267686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:02.797610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301577+0000","last_change":"2023-10-08T16:06:39.304109+0000","last_active":"2023-10-08T16:06:40.301577+0000","last_peered":"2023-10-08T16:06:40.301577+0000","last_clean":"2023-10-08T16:06:40.301577+0000","last_became_active":"2023-10-08T16:06:39.303757+0000","last_became_peered":"2023-10-08T16:06:39.303757+0000","last_unstale":"2023-10-08T16:06:40.301577+0000","last_undegraded":"2023-10-08T16:06:40.301577+0000","last_fullsized":"2023-10-08T16:06:40.301577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:51.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.267750+0000","last_change":"2023-10-08T16:06:40.259475+0000","last_active":"2023-10-08T16:06:40.267750+0000","last_peered":"2023-10-08T16:06:40.267750+0000","last_clean":"2023-10-08T16:06:40.267750+0000","last_became_active":"2023-10-08T16:06:40.259042+0000","last_became_peered":"2023-10-08T16:06:40.259042+0000","last_unstale":"2023-10-08T16:06:40.267750+0000","last_undegraded":"2023-10-08T16:06:40.267750+0000","last_fullsized":"2023-10-08T16:06:40.267750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.282564+0000","last_change":"2023-10-08T16:06:40.276456+0000","last_active":"2023-10-08T16:06:40.282564+0000","last_peered":"2023-10-08T16:06:40.282564+0000","last_clean":"2023-10-08T16:06:40.282564+0000","last_became_active":"2023-10-08T16:06:40.276127+0000","last_became_peered":"2023-10-08T16:06:40.276127+0000","last_unstale":"2023-10-08T16:06:40.282564+0000","last_undegraded":"2023-10-08T16:06:40.282564+0000","last_fullsized":"2023-10-08T16:06:40.282564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:30.619846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.299639+0000","last_change":"2023-10-08T16:06:39.302950+0000","last_active":"2023-10-08T16:06:40.299639+0000","last_peered":"2023-10-08T16:06:40.299639+0000","last_clean":"2023-10-08T16:06:40.299639+0000","last_became_active":"2023-10-08T16:06:39.302504+0000","last_became_peered":"2023-10-08T16:06:39.302504+0000","last_unstale":"2023-10-08T16:06:40.299639+0000","last_undegraded":"2023-10-08T16:06:40.299639+0000","last_fullsized":"2023-10-08T16:06:40.299639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:24.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.279270+0000","last_change":"2023-10-08T16:06:40.269067+0000","last_active":"2023-10-08T16:06:40.279270+0000","last_peered":"2023-10-08T16:06:40.279270+0000","last_clean":"2023-10-08T16:06:40.279270+0000","last_became_active":"2023-10-08T16:06:40.268755+0000","last_became_peered":"2023-10-08T16:06:40.268755+0000","last_unstale":"2023-10-08T16:06:40.279270+0000","last_undegraded":"2023-10-08T16:06:40.279270+0000","last_fullsized":"2023-10-08T16:06:40.279270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.300353+0000","last_change":"2023-10-08T16:06:39.305358+0000","last_active":"2023-10-08T16:06:40.300353+0000","last_peered":"2023-10-08T16:06:40.300353+0000","last_clean":"2023-10-08T16:06:40.300353+0000","last_became_active":"2023-10-08T16:06:39.305022+0000","last_became_peered":"2023-10-08T16:06:39.305022+0000","last_unstale":"2023-10-08T16:06:40.300353+0000","last_undegraded":"2023-10-08T16:06:40.300353+0000","last_fullsized":"2023-10-08T16:06:40.300353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:17.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.278272+0000","last_change":"2023-10-08T16:06:40.274826+0000","last_active":"2023-10-08T16:06:40.278272+0000","last_peered":"2023-10-08T16:06:40.278272+0000","last_clean":"2023-10-08T16:06:40.278272+0000","last_became_active":"2023-10-08T16:06:40.274506+0000","last_became_peered":"2023-10-08T16:06:40.274506+0000","last_unstale":"2023-10-08T16:06:40.278272+0000","last_undegraded":"2023-10-08T16:06:40.278272+0000","last_fullsized":"2023-10-08T16:06:40.278272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:16.587448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301960+0000","last_change":"2023-10-08T16:06:39.298025+0000","last_active":"2023-10-08T16:06:40.301960+0000","last_peered":"2023-10-08T16:06:40.301960+0000","last_clean":"2023-10-08T16:06:40.301960+0000","last_became_active":"2023-10-08T16:06:39.297643+0000","last_became_peered":"2023-10-08T16:06:39.297643+0000","last_unstale":"2023-10-08T16:06:40.301960+0000","last_undegraded":"2023-10-08T16:06:40.301960+0000","last_fullsized":"2023-10-08T16:06:40.301960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:41.102801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.273032+0000","last_change":"2023-10-08T16:06:40.268521+0000","last_active":"2023-10-08T16:06:40.273032+0000","last_peered":"2023-10-08T16:06:40.273032+0000","last_clean":"2023-10-08T16:06:40.273032+0000","last_became_active":"2023-10-08T16:06:40.267613+0000","last_became_peered":"2023-10-08T16:06:40.267613+0000","last_unstale":"2023-10-08T16:06:40.273032+0000","last_undegraded":"2023-10-08T16:06:40.273032+0000","last_fullsized":"2023-10-08T16:06:40.273032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:39.256831+0000","last_clean_scrub_stamp":"2023-10-08T16:06:39.256831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:08.853277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:06:40.301633+0000","last_change":"2023-10-08T16:06:39.303632+0000","last_active":"2023-10-08T16:06:40.301633+0000","last_peered":"2023-10-08T16:06:40.301633+0000","last_clean":"2023-10-08T16:06:40.301633+0000","last_became_active":"2023-10-08T16:06:39.303353+0000","last_became_peered":"2023-10-08T16:06:39.303353+0000","last_unstale":"2023-10-08T16:06:40.301633+0000","last_undegraded":"2023-10-08T16:06:40.301633+0000","last_fullsized":"2023-10-08T16:06:40.301633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:38.245940+0000","last_clean_scrub_stamp":"2023-10-08T16:06:38.245940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:20.639128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:06:52.042 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:06:52.042 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T16:06:52.042 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T16:06:52.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T16:06:52.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 Processor -- start 2023-10-08T16:06:52.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 -- start start 2023-10-08T16:06:52.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6218152d60 0x7f62181564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62180c7650 0x7f62180c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62180c9a10 con 0x7f621806c700 2023-10-08T16:06:52.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62180c9710 con 0x7f6218152d60 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621f849700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621806cf50 con 0x7f62180c7650 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621cde4700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f621806c700 0x7f62180c6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51592/0 (socket says 172.21.15.3:51592) 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621cde4700 1 -- 172.21.15.3:0/2914781122 learned_addr learned my addr 172.21.15.3:0/2914781122 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621dde6700 1 --2- 172.21.15.3:0/2914781122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62180c7650 0x7f62180c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621d5e5700 1 --2- 172.21.15.3:0/2914781122 >> v2:172.21.15.27:3300/0 conn(0x7f6218152d60 0x7f62181564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f620ffff700 1 -- 172.21.15.3:0/2914781122 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976781972 0 0) 0x7f62180c9a10 con 0x7f621806c700 2023-10-08T16:06:52.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f620ffff700 1 -- 172.21.15.3:0/2914781122 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6204003570 con 0x7f621806c700 2023-10-08T16:06:52.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621dde6700 1 -- 172.21.15.3:0/2914781122 >> v2:172.21.15.27:3300/0 conn(0x7f6218152d60 msgr2=0x7f62181564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:52.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621dde6700 1 --2- 172.21.15.3:0/2914781122 >> v2:172.21.15.27:3300/0 conn(0x7f6218152d60 0x7f62181564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621dde6700 1 -- 172.21.15.3:0/2914781122 >> v1:172.21.15.3:6789/0 conn(0x7f621806c700 legacy=0x7f62180c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621dde6700 1 -- 172.21.15.3:0/2914781122 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621806d230 con 0x7f62180c7650 2023-10-08T16:06:52.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.139+0000 7f621dde6700 1 --2- 172.21.15.3:0/2914781122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62180c7650 0x7f62180c9ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6210009e60 tx=0x7f6210009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b11a86c4c4a486cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f620ffff700 1 -- 172.21.15.3:0/2914781122 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000e070 con 0x7f62180c7650 2023-10-08T16:06:52.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f620ffff700 1 -- 172.21.15.3:0/2914781122 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621000bab0 con 0x7f62180c7650 2023-10-08T16:06:52.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f620ffff700 1 -- 172.21.15.3:0/2914781122 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000be70 con 0x7f62180c7650 2023-10-08T16:06:52.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 -- 172.21.15.3:0/2914781122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62180c7650 msgr2=0x7f62180c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 --2- 172.21.15.3:0/2914781122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62180c7650 0x7f62180c9ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6210009e60 tx=0x7f6210009780 comp rx=0 tx=0).stop 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 -- 172.21.15.3:0/2914781122 shutdown_connections 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 --2- 172.21.15.3:0/2914781122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62180c7650 0x7f62180c9ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 --2- 172.21.15.3:0/2914781122 >> v2:172.21.15.27:3300/0 conn(0x7f6218152d60 0x7f62181564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 -- 172.21.15.3:0/2914781122 >> 172.21.15.3:0/2914781122 conn(0x7f6218067af0 msgr2=0x7f62180cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 -- 172.21.15.3:0/2914781122 shutdown_connections 2023-10-08T16:06:52.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.143+0000 7f621f849700 1 -- 172.21.15.3:0/2914781122 wait complete. 2023-10-08T16:06:52.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 Processor -- start 2023-10-08T16:06:52.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 -- start start 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 0x7f62181471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62180c7650 0x7f621816a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6218152d60 0x7f621816aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218140900 con 0x7f621806c700 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180b13b0 con 0x7f62180c7650 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621f849700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180b1840 con 0x7f6218152d60 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 0x7f62181471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 0x7f62181471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42614/0 (socket says 172.21.15.3:42614) 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 -- 172.21.15.3:0/1084805473 learned_addr learned my addr 172.21.15.3:0/1084805473 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:52.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621cde4700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62180c7650 0x7f621816a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621dde6700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6218152d60 0x7f621816aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 -- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6218152d60 msgr2=0x7f621816aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6218152d60 0x7f621816aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 -- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62180c7650 msgr2=0x7f621816a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62180c7650 0x7f621816a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 -- 172.21.15.3:0/1084805473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210009a20 con 0x7f621806c700 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.147+0000 7f621d5e5700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 0x7f62181471f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f621400ec80 tx=0x7f62140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400c850 con 0x7f621806c700 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621400c9b0 con 0x7f621806c700 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62180b07a0 con 0x7f621806c700 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400cd50 con 0x7f621806c700 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62180b0d60 con 0x7f621806c700 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621804be40 con 0x7f621806c700 2023-10-08T16:06:52.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6214013680 con 0x7f621806c700 2023-10-08T16:06:52.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f620d7fa700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61fc060580 0x7f61fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f621cde4700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61fc060580 0x7f61fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.151+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f621407ca10 con 0x7f621806c700 2023-10-08T16:06:52.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.155+0000 7f621cde4700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61fc060580 0x7f61fc062a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6218140d80 tx=0x7f6208009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.159+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f621404d000 con 0x7f621806c700 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.339+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f621806da50 con 0x7f621806c700 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.339+0000 7f620d7fa700 1 -- 172.21.15.3:0/1084805473 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6214050620 con 0x7f621806c700 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61fc060580 msgr2=0x7f61fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61fc060580 0x7f61fc062a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6218140d80 tx=0x7f6208009040 comp rx=0 tx=0).stop 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 msgr2=0x7f62181471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 0x7f62181471f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f621400ec80 tx=0x7f62140091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 shutdown_connections 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61fc060580 0x7f61fc062a30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6218152d60 0x7f621816aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62180c7650 0x7f621816a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 --2- 172.21.15.3:0/1084805473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f621806c700 0x7f62181471f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 >> 172.21.15.3:0/1084805473 conn(0x7f6218067af0 msgr2=0x7f62180c1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 shutdown_connections 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.343+0000 7f621f849700 1 -- 172.21.15.3:0/1084805473 wait complete. 2023-10-08T16:06:52.357 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T16:06:52.357 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342f59e700 1 Processor -- start 2023-10-08T16:06:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342f59e700 1 -- start start 2023-10-08T16:06:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f343013eed0 0x7f34300c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342f59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300c7fb0 con 0x7f3430068990 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300c8290 con 0x7f34300c7ac0 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300c8570 con 0x7f343013eed0 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342ed9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3430068990 0x7f34300c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51596/0 (socket says 172.21.15.3:51596) 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342ed9d700 1 -- 172.21.15.3:0/2929366572 learned_addr learned my addr 172.21.15.3:0/2929366572 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342e59c700 1 --2- 172.21.15.3:0/2929366572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f343013eed0 0x7f34300c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562480093 0 0) 0x7f34300c7fb0 con 0x7f3430068990 2023-10-08T16:06:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3418004680 con 0x7f3430068990 2023-10-08T16:06:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232665345 0 0) 0x7f34300c8290 con 0x7f34300c7ac0 2023-10-08T16:06:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34300c7fb0 con 0x7f34300c7ac0 2023-10-08T16:06:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1761494188 0 0) 0x7f3418004680 con 0x7f3430068990 2023-10-08T16:06:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342e59c700 1 -- 172.21.15.3:0/2929366572 >> v1:172.21.15.27:6789/0 conn(0x7f34300c7ac0 legacy=0x7f3430068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342e59c700 1 -- 172.21.15.3:0/2929366572 >> v1:172.21.15.3:6789/0 conn(0x7f3430068990 legacy=0x7f34300c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.455+0000 7f342e59c700 1 -- 172.21.15.3:0/2929366572 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300c8850 con 0x7f343013eed0 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342e59c700 1 --2- 172.21.15.3:0/2929366572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f343013eed0 0x7f34300c7580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3420009910 tx=0x7f34200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad402741e8d7212 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280017f0 con 0x7f343013eed0 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420011420 con 0x7f343013eed0 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342d59a700 1 -- 172.21.15.3:0/2929366572 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200117c0 con 0x7f343013eed0 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 -- 172.21.15.3:0/2929366572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f343013eed0 msgr2=0x7f34300c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 --2- 172.21.15.3:0/2929366572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f343013eed0 0x7f34300c7580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3420009910 tx=0x7f34200091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 -- 172.21.15.3:0/2929366572 shutdown_connections 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 --2- 172.21.15.3:0/2929366572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f343013eed0 0x7f34300c7580 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 -- 172.21.15.3:0/2929366572 >> 172.21.15.3:0/2929366572 conn(0x7f34300c8c90 msgr2=0x7f34300c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 -- 172.21.15.3:0/2929366572 shutdown_connections 2023-10-08T16:06:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.459+0000 7f342f59e700 1 -- 172.21.15.3:0/2929366572 wait complete. 2023-10-08T16:06:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 Processor -- start 2023-10-08T16:06:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 -- start start 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3430068990 0x7f343013cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 0x7f3430156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f343013eed0 0x7f34300b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343013d4b0 con 0x7f34300c7ac0 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3430156ec0 con 0x7f343013eed0 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34301571a0 con 0x7f3430068990 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 0x7f3430156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 0x7f3430156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42622/0 (socket says 172.21.15.3:42622) 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 -- 172.21.15.3:0/2425239549 learned_addr learned my addr 172.21.15.3:0/2425239549 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342ed9d700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f343013eed0 0x7f34300b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342e59c700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3430068990 0x7f343013cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 -- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3430068990 msgr2=0x7f343013cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3430068990 0x7f343013cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 -- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f343013eed0 msgr2=0x7f34300b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f343013eed0 0x7f34300b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 -- 172.21.15.3:0/2425239549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009420 con 0x7f34300c7ac0 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342e59c700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3430068990 0x7f343013cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.463+0000 7f342dd9b700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 0x7f3430156670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f342400c790 tx=0x7f3424007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424010510 con 0x7f34300c7ac0 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3424010670 con 0x7f34300c7ac0 2023-10-08T16:06:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34300b0cb0 con 0x7f34300c7ac0 2023-10-08T16:06:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424010a10 con 0x7f34300c7ac0 2023-10-08T16:06:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34300b1270 con 0x7f34300c7ac0 2023-10-08T16:06:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f342401b400 con 0x7f34300c7ac0 2023-10-08T16:06:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34300b1490 con 0x7f34300c7ac0 2023-10-08T16:06:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f341e7fc700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3410060550 0x7f3410062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f342407c670 con 0x7f34300c7ac0 2023-10-08T16:06:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f342e59c700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3410060550 0x7f3410062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.467+0000 7f342e59c700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3410060550 0x7f3410062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34200030c0 tx=0x7f3420016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.479+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f342404cbc0 con 0x7f34300c7ac0 2023-10-08T16:06:52.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.639+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f343004be40 con 0x7f34300c7ac0 2023-10-08T16:06:52.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f341e7fc700 1 -- 172.21.15.3:0/2425239549 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f34240501e0 con 0x7f34300c7ac0 2023-10-08T16:06:52.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:52.646 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:52.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3410060550 msgr2=0x7f3410062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3410060550 0x7f3410062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34200030c0 tx=0x7f3420016000 comp rx=0 tx=0).stop 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 msgr2=0x7f3430156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 0x7f3430156670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f342400c790 tx=0x7f3424007e10 comp rx=0 tx=0).stop 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 shutdown_connections 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3410060550 0x7f3410062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f343013eed0 0x7f34300b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34300c7ac0 0x7f3430156670 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 --2- 172.21.15.3:0/2425239549 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3430068990 0x7f343013cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.643+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 >> 172.21.15.3:0/2425239549 conn(0x7f34300c8c90 msgr2=0x7f34300caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.647+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 shutdown_connections 2023-10-08T16:06:52.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.647+0000 7f342f59e700 1 -- 172.21.15.3:0/2425239549 wait complete. 2023-10-08T16:06:52.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:06:52.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:06:52.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 Processor -- start 2023-10-08T16:06:52.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- start start 2023-10-08T16:06:52.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f457c0adb20 0x7f457c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f457c0c6e00 0x7f457c0ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c06d640 con 0x7f457c15b180 2023-10-08T16:06:52.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c06e010 con 0x7f457c0c6e00 2023-10-08T16:06:52.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c157010 con 0x7f457c0adb20 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f457c0c6e00 0x7f457c0ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f457c0c6e00 0x7f457c0ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42628/0 (socket says 172.21.15.3:42628) 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 -- 172.21.15.3:0/2624197778 learned_addr learned my addr 172.21.15.3:0/2624197778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457b7fe700 1 --2- 172.21.15.3:0/2624197778 >> v2:172.21.15.27:3300/0 conn(0x7f457c0adb20 0x7f457c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 -- 172.21.15.3:0/2624197778 >> v2:172.21.15.27:3300/0 conn(0x7f457c0adb20 msgr2=0x7f457c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 --2- 172.21.15.3:0/2624197778 >> v2:172.21.15.27:3300/0 conn(0x7f457c0adb20 0x7f457c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 -- 172.21.15.3:0/2624197778 >> v1:172.21.15.27:6789/0 conn(0x7f457c15b180 legacy=0x7f457c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 -- 172.21.15.3:0/2624197778 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c06ca30 con 0x7f457c0c6e00 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457bfff700 1 --2- 172.21.15.3:0/2624197778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0c6e00 0x7f457c0ab4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f457c068130 tx=0x7f4574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ef78d9c013aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457a7fc700 1 -- 172.21.15.3:0/2624197778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574009e70 con 0x7f457c0c6e00 2023-10-08T16:06:52.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457a7fc700 1 -- 172.21.15.3:0/2624197778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457400b8f0 con 0x7f457c0c6e00 2023-10-08T16:06:52.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f457a7fc700 1 -- 172.21.15.3:0/2624197778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400bc90 con 0x7f457c0c6e00 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- 172.21.15.3:0/2624197778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0c6e00 msgr2=0x7f457c0ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 --2- 172.21.15.3:0/2624197778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0c6e00 0x7f457c0ab4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f457c068130 tx=0x7f4574009250 comp rx=0 tx=0).stop 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- 172.21.15.3:0/2624197778 shutdown_connections 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 --2- 172.21.15.3:0/2624197778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0c6e00 0x7f457c0ab4c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 --2- 172.21.15.3:0/2624197778 >> v2:172.21.15.27:3300/0 conn(0x7f457c0adb20 0x7f457c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- 172.21.15.3:0/2624197778 >> 172.21.15.3:0/2624197778 conn(0x7f457c0c83b0 msgr2=0x7f457c0c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- 172.21.15.3:0/2624197778 shutdown_connections 2023-10-08T16:06:52.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.771+0000 7f4580ec5700 1 -- 172.21.15.3:0/2624197778 wait complete. 2023-10-08T16:06:52.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 Processor -- start 2023-10-08T16:06:52.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 -- start start 2023-10-08T16:06:52.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 0x7f457c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f457c0c6e00 0x7f457c146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f457c15b180 0x7f457c06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c149d40 con 0x7f457c0adb20 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c1490c0 con 0x7f457c0c6e00 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f4580ec5700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c1493a0 con 0x7f457c15b180 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 0x7f457c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 0x7f457c148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42644/0 (socket says 172.21.15.3:42644) 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 -- 172.21.15.3:0/81539180 learned_addr learned my addr 172.21.15.3:0/81539180 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457bfff700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f457c15b180 0x7f457c06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457affd700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f457c0c6e00 0x7f457c146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 -- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f457c15b180 msgr2=0x7f457c06a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f457c15b180 0x7f457c06a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 -- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f457c0c6e00 msgr2=0x7f457c146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f457c0c6e00 0x7f457c146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 -- 172.21.15.3:0/81539180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740094f0 con 0x7f457c0adb20 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f457b7fe700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 0x7f457c148840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f456c009f60 tx=0x7f456c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.775+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c00cc20 con 0x7f457c0adb20 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c00f040 con 0x7f457c0adb20 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c149680 con 0x7f457c0adb20 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c014480 con 0x7f457c0adb20 2023-10-08T16:06:52.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c148d80 con 0x7f457c0adb20 2023-10-08T16:06:52.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c04be40 con 0x7f457c0adb20 2023-10-08T16:06:52.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f456c014830 con 0x7f457c0adb20 2023-10-08T16:06:52.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f45737fe700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f455c060550 0x7f455c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f457affd700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f455c060550 0x7f455c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.779+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f456c07cfa0 con 0x7f457c0adb20 2023-10-08T16:06:52.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.783+0000 7f457affd700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f455c060550 0x7f455c062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f457c06afd0 tx=0x7f4564009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.787+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f456c0acbe0 con 0x7f457c0adb20 2023-10-08T16:06:52.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.943+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f457c06f230 con 0x7f457c0adb20 2023-10-08T16:06:52.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.943+0000 7f45737fe700 1 -- 172.21.15.3:0/81539180 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f456c0180a0 con 0x7f457c0adb20 2023-10-08T16:06:52.946 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:06:52.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f455c060550 msgr2=0x7f455c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f455c060550 0x7f455c062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f457c06afd0 tx=0x7f4564009040 comp rx=0 tx=0).stop 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 msgr2=0x7f457c148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 0x7f457c148840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f456c009f60 tx=0x7f456c00b040 comp rx=0 tx=0).stop 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 shutdown_connections 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f455c060550 0x7f455c062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f457c15b180 0x7f457c06a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f457c0c6e00 0x7f457c146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 --2- 172.21.15.3:0/81539180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f457c0adb20 0x7f457c148840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 >> 172.21.15.3:0/81539180 conn(0x7f457c0c83b0 msgr2=0x7f457c0acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 shutdown_connections 2023-10-08T16:06:52.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:52.947+0000 7f4580ec5700 1 -- 172.21.15.3:0/81539180 wait complete. 2023-10-08T16:06:52.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:06:53.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139759e700 1 Processor -- start 2023-10-08T16:06:53.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139759e700 1 -- start start 2023-10-08T16:06:53.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f139806db60 0x7f139815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139806bb50 con 0x7f1398158c80 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13980b45a0 con 0x7f13980b37c0 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139806a3a0 con 0x7f139806db60 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1398158c80 0x7f139806b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51604/0 (socket says 172.21.15.3:51604) 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139659c700 1 -- 172.21.15.3:0/2364174065 learned_addr learned my addr 172.21.15.3:0/2364174065 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f1395d9b700 1 --2- 172.21.15.3:0/2364174065 >> v2:172.21.15.27:3300/0 conn(0x7f139806db60 0x7f139815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139559a700 1 -- 172.21.15.3:0/2364174065 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519572358 0 0) 0x7f139806bb50 con 0x7f1398158c80 2023-10-08T16:06:53.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139559a700 1 -- 172.21.15.3:0/2364174065 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1384003570 con 0x7f1398158c80 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f1395d9b700 1 -- 172.21.15.3:0/2364174065 >> v1:172.21.15.27:6789/0 conn(0x7f13980b37c0 legacy=0x7f1398159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139559a700 1 -- 172.21.15.3:0/2364174065 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618869413 0 0) 0x7f13980b45a0 con 0x7f13980b37c0 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f1395d9b700 1 -- 172.21.15.3:0/2364174065 >> v1:172.21.15.3:6789/0 conn(0x7f1398158c80 legacy=0x7f139806b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f1395d9b700 1 -- 172.21.15.3:0/2364174065 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139806a680 con 0x7f139806db60 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f1395d9b700 1 --2- 172.21.15.3:0/2364174065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f139815d4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1390009e60 tx=0x7f1390009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b8a66e308cc8dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139559a700 1 -- 172.21.15.3:0/2364174065 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000e070 con 0x7f139806db60 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139559a700 1 -- 172.21.15.3:0/2364174065 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000b8e0 con 0x7f139806db60 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.071+0000 7f139559a700 1 -- 172.21.15.3:0/2364174065 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380001470 con 0x7f139806db60 2023-10-08T16:06:53.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- 172.21.15.3:0/2364174065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 msgr2=0x7f139815d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 --2- 172.21.15.3:0/2364174065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f139815d4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1390009e60 tx=0x7f1390009780 comp rx=0 tx=0).stop 2023-10-08T16:06:53.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- 172.21.15.3:0/2364174065 shutdown_connections 2023-10-08T16:06:53.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 --2- 172.21.15.3:0/2364174065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f139815d4c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- 172.21.15.3:0/2364174065 >> 172.21.15.3:0/2364174065 conn(0x7f13980d0820 msgr2=0x7f13980b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:53.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- 172.21.15.3:0/2364174065 shutdown_connections 2023-10-08T16:06:53.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- 172.21.15.3:0/2364174065 wait complete. 2023-10-08T16:06:53.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 Processor -- start 2023-10-08T16:06:53.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- start start 2023-10-08T16:06:53.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f1398148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 0x7f13980c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1398158c80 0x7f139815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139815b350 con 0x7f1398158c80 2023-10-08T16:06:53.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139815a740 con 0x7f139806db60 2023-10-08T16:06:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139815aa20 con 0x7f13980b37c0 2023-10-08T16:06:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f1395d9b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 0x7f13980c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f1396d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1398158c80 0x7f139815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f139659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f1398148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f1395d9b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 0x7f13980c5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:40012/0 (socket says 172.21.15.3:40012) 2023-10-08T16:06:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.075+0000 7f1395d9b700 1 -- 172.21.15.3:0/1284744513 learned_addr learned my addr 172.21.15.3:0/1284744513 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:53.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1395d9b700 1 -- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 msgr2=0x7f1398148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1395d9b700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f1398148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1395d9b700 1 -- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1398158c80 msgr2=0x7f139815b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1395d9b700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1398158c80 0x7f139815b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1395d9b700 1 -- 172.21.15.3:0/1284744513 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390009a20 con 0x7f13980b37c0 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1396d9d700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1398158c80 0x7f139815b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f1395d9b700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 0x7f13980c5320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13900099f0 tx=0x7f1390017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000bad0 con 0x7f13980b37c0 2023-10-08T16:06:53.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139001f410 con 0x7f13980b37c0 2023-10-08T16:06:53.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139815ad00 con 0x7f13980b37c0 2023-10-08T16:06:53.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139001f7d0 con 0x7f13980b37c0 2023-10-08T16:06:53.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13980c5860 con 0x7f13980b37c0 2023-10-08T16:06:53.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139815b500 con 0x7f13980b37c0 2023-10-08T16:06:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.079+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f139001fb80 con 0x7f13980b37c0 2023-10-08T16:06:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.083+0000 7f138e7fc700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1378060550 0x7f1378062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.083+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f139007eaa0 con 0x7f13980b37c0 2023-10-08T16:06:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.083+0000 7f139659c700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1378060550 0x7f1378062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.083+0000 7f139659c700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1378060550 0x7f1378062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13800015a0 tx=0x7f1380000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.091+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f139815b500 con 0x7f13980b37c0 2023-10-08T16:06:53.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.255+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f139815b4c0 con 0x7f13980b37c0 2023-10-08T16:06:53.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.255+0000 7f138e7fc700 1 -- 172.21.15.3:0/1284744513 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f139004f090 con 0x7f13980b37c0 2023-10-08T16:06:53.258 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:06:53.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1378060550 msgr2=0x7f1378062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1378060550 0x7f1378062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13800015a0 tx=0x7f1380000bc0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 msgr2=0x7f13980c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 0x7f13980c5320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13900099f0 tx=0x7f1390017000 comp rx=0 tx=0).stop 2023-10-08T16:06:53.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 shutdown_connections 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1378060550 0x7f1378062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1398158c80 0x7f139815b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f13980b37c0 0x7f13980c5320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 --2- 172.21.15.3:0/1284744513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f139806db60 0x7f1398148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 >> 172.21.15.3:0/1284744513 conn(0x7f13980d0820 msgr2=0x7f139806c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 shutdown_connections 2023-10-08T16:06:53.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.259+0000 7f139759e700 1 -- 172.21.15.3:0/1284744513 wait complete. 2023-10-08T16:06:53.276 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:06:53.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 Processor -- start 2023-10-08T16:06:53.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 -- start start 2023-10-08T16:06:53.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f04240cd420 0x7f042406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159410 0x7f04240ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240cb380 con 0x7f0424159040 2023-10-08T16:06:53.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04240caa90 con 0x7f04240cd420 2023-10-08T16:06:53.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0428d74700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042406b850 con 0x7f0424159410 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0421d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f04240cd420 0x7f042406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f042259c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0424159040 0x7f04240b2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51608/0 (socket says 172.21.15.3:51608) 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f042259c700 1 -- 172.21.15.3:0/2366762057 learned_addr learned my addr 172.21.15.3:0/2366762057 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0422d9d700 1 --2- 172.21.15.3:0/2366762057 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159410 0x7f04240ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0421d9b700 1 -- 172.21.15.3:0/2366762057 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159410 msgr2=0x7f04240ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0421d9b700 1 --2- 172.21.15.3:0/2366762057 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159410 0x7f04240ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0421d9b700 1 -- 172.21.15.3:0/2366762057 >> v1:172.21.15.3:6789/0 conn(0x7f0424159040 legacy=0x7f04240b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f042159a700 1 -- 172.21.15.3:0/2366762057 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865198147 0 0) 0x7f04240cb380 con 0x7f0424159040 2023-10-08T16:06:53.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0421d9b700 1 -- 172.21.15.3:0/2366762057 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240cad30 con 0x7f04240cd420 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f0421d9b700 1 --2- 172.21.15.3:0/2366762057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f042406aed0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f04180098e0 tx=0x7f04180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646611f440b2bbc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f042159a700 1 -- 172.21.15.3:0/2366762057 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800b640 con 0x7f04240cd420 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f042159a700 1 -- 172.21.15.3:0/2366762057 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800b7a0 con 0x7f04240cd420 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.383+0000 7f042159a700 1 -- 172.21.15.3:0/2366762057 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800bb40 con 0x7f04240cd420 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 -- 172.21.15.3:0/2366762057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 msgr2=0x7f042406aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 --2- 172.21.15.3:0/2366762057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f042406aed0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f04180098e0 tx=0x7f04180091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 -- 172.21.15.3:0/2366762057 shutdown_connections 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 --2- 172.21.15.3:0/2366762057 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159410 0x7f04240ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 --2- 172.21.15.3:0/2366762057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f042406aed0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 -- 172.21.15.3:0/2366762057 >> 172.21.15.3:0/2366762057 conn(0x7f04240d0920 msgr2=0x7f04240cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:53.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 -- 172.21.15.3:0/2366762057 shutdown_connections 2023-10-08T16:06:53.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 -- 172.21.15.3:0/2366762057 wait complete. 2023-10-08T16:06:53.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 Processor -- start 2023-10-08T16:06:53.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.387+0000 7f0428d74700 1 -- start start 2023-10-08T16:06:53.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f04240c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159040 0x7f042416a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f042415ba00 0x7f0424169370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042416a5d0 con 0x7f04240cd420 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c7130 con 0x7f042415ba00 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c9260 con 0x7f0424159040 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f04240c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f04240c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42674/0 (socket says 172.21.15.3:42674) 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 -- 172.21.15.3:0/2142336098 learned_addr learned my addr 172.21.15.3:0/2142336098 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0422d9d700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f042415ba00 0x7f0424169370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0421d9b700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159040 0x7f042416a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 -- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159040 msgr2=0x7f042416a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159040 0x7f042416a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 -- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f042415ba00 msgr2=0x7f0424169370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f042415ba00 0x7f0424169370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 -- 172.21.15.3:0/2142336098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009420 con 0x7f04240cd420 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f042259c700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f04240c8d20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f041400c5e0 tx=0x7f0414001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414005b30 con 0x7f04240cd420 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414005c90 con 0x7f04240cd420 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424169d30 con 0x7f04240cd420 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140072e0 con 0x7f04240cd420 2023-10-08T16:06:53.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.391+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042416a2f0 con 0x7f04240cd420 2023-10-08T16:06:53.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.395+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04240c6f60 con 0x7f04240cd420 2023-10-08T16:06:53.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.395+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f041401b3b0 con 0x7f04240cd420 2023-10-08T16:06:53.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.395+0000 7f04127fc700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0404060550 0x7f0404062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.395+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f041407bcd0 con 0x7f04240cd420 2023-10-08T16:06:53.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.395+0000 7f0421d9b700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0404060550 0x7f0404062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.395+0000 7f0421d9b700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0404060550 0x7f0404062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f042406a470 tx=0x7f0418017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.403+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0414049be0 con 0x7f04240cd420 2023-10-08T16:06:53.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.563+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0424071180 con 0x7f04240cd420 2023-10-08T16:06:53.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.563+0000 7f04127fc700 1 -- 172.21.15.3:0/2142336098 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0414017020 con 0x7f04240cd420 2023-10-08T16:06:53.568 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:06:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0404060550 msgr2=0x7f0404062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0404060550 0x7f0404062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f042406a470 tx=0x7f0418017000 comp rx=0 tx=0).stop 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 msgr2=0x7f04240c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f04240c8d20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f041400c5e0 tx=0x7f0414001070 comp rx=0 tx=0).stop 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 shutdown_connections 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0404060550 0x7f0404062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f042415ba00 0x7f0424169370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0424159040 0x7f042416a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 --2- 172.21.15.3:0/2142336098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04240cd420 0x7f04240c8d20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 >> 172.21.15.3:0/2142336098 conn(0x7f04240d0920 msgr2=0x7f04240ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 shutdown_connections 2023-10-08T16:06:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.567+0000 7f0428d74700 1 -- 172.21.15.3:0/2142336098 wait complete. 2023-10-08T16:06:53.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:53.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.683+0000 7f86ca70f700 1 Processor -- start 2023-10-08T16:06:53.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.683+0000 7f86ca70f700 1 -- start start 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c9680 0x7f86c40c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40c7200 con 0x7f86c40c7fc0 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40c74e0 con 0x7f86c415d740 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c8400 con 0x7f86c40c9680 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c9f0e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f86c40c7fc0 0x7f86c40aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51618/0 (socket says 172.21.15.3:51618) 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c9f0e700 1 -- 172.21.15.3:0/3688090761 learned_addr learned my addr 172.21.15.3:0/3688090761 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:53.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c970d700 1 --2- 172.21.15.3:0/3688090761 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c9680 0x7f86c40c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86bbfff700 1 -- 172.21.15.3:0/3688090761 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135249751 0 0) 0x7f86c40c7200 con 0x7f86c40c7fc0 2023-10-08T16:06:53.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86bbfff700 1 -- 172.21.15.3:0/3688090761 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0003570 con 0x7f86c40c7fc0 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c970d700 1 -- 172.21.15.3:0/3688090761 >> v1:172.21.15.27:6789/0 conn(0x7f86c415d740 legacy=0x7f86c40cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86bbfff700 1 -- 172.21.15.3:0/3688090761 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244530593 0 0) 0x7f86c40c74e0 con 0x7f86c415d740 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c970d700 1 -- 172.21.15.3:0/3688090761 >> v1:172.21.15.3:6789/0 conn(0x7f86c40c7fc0 legacy=0x7f86c40aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c970d700 1 -- 172.21.15.3:0/3688090761 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40c77c0 con 0x7f86c40c9680 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86c970d700 1 --2- 172.21.15.3:0/3688090761 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c9680 0x7f86c40c9a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009e90 tx=0x7f86c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e67731b19ce5f058 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86bbfff700 1 -- 172.21.15.3:0/3688090761 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000e070 con 0x7f86c40c9680 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86bbfff700 1 -- 172.21.15.3:0/3688090761 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c000bc30 con 0x7f86c40c9680 2023-10-08T16:06:53.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86bbfff700 1 -- 172.21.15.3:0/3688090761 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0012430 con 0x7f86c40c9680 2023-10-08T16:06:53.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 -- 172.21.15.3:0/3688090761 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c9680 msgr2=0x7f86c40c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3688090761 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c9680 0x7f86c40c9a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009e90 tx=0x7f86c0009780 comp rx=0 tx=0).stop 2023-10-08T16:06:53.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 -- 172.21.15.3:0/3688090761 shutdown_connections 2023-10-08T16:06:53.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3688090761 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c9680 0x7f86c40c9a50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.687+0000 7f86ca70f700 1 -- 172.21.15.3:0/3688090761 >> 172.21.15.3:0/3688090761 conn(0x7f86c406b6b0 msgr2=0x7f86c406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:53.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 -- 172.21.15.3:0/3688090761 shutdown_connections 2023-10-08T16:06:53.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 -- 172.21.15.3:0/3688090761 wait complete. 2023-10-08T16:06:53.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 Processor -- start 2023-10-08T16:06:53.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 -- start start 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c7fc0 0x7f86c40b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 0x7f86c40aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86c415d740 0x7f86c40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40af8d0 con 0x7f86c40c9680 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40afbb0 con 0x7f86c415d740 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86ca70f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40ab6a0 con 0x7f86c40c7fc0 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86c8f0c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 0x7f86c40aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86c9f0e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86c415d740 0x7f86c40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86c8f0c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 0x7f86c40aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42678/0 (socket says 172.21.15.3:42678) 2023-10-08T16:06:53.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86c8f0c700 1 -- 172.21.15.3:0/3867998061 learned_addr learned my addr 172.21.15.3:0/3867998061 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:53.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.691+0000 7f86c970d700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c7fc0 0x7f86c40b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86c8f0c700 1 -- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c7fc0 msgr2=0x7f86c40b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86c8f0c700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c7fc0 0x7f86c40b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86c8f0c700 1 -- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86c415d740 msgr2=0x7f86c40b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86c8f0c700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86c415d740 0x7f86c40b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86c8f0c700 1 -- 172.21.15.3:0/3867998061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0009a20 con 0x7f86c40c9680 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86c8f0c700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 0x7f86c40aad50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f86b400c610 tx=0x7f86b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4011590 con 0x7f86c40c9680 2023-10-08T16:06:53.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b40116f0 con 0x7f86c40c9680 2023-10-08T16:06:53.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40ab980 con 0x7f86c40c9680 2023-10-08T16:06:53.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4011ab0 con 0x7f86c40c9680 2023-10-08T16:06:53.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c40b1fe0 con 0x7f86c40c9680 2023-10-08T16:06:53.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.695+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c40afd40 con 0x7f86c40c9680 2023-10-08T16:06:53.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.699+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f86b401b3b0 con 0x7f86c40c9680 2023-10-08T16:06:53.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.699+0000 7f86b97fa700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f86a8060550 0x7f86a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:53.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.699+0000 7f86c970d700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f86a8060550 0x7f86a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:53.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.699+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86b407bc50 con 0x7f86c40c9680 2023-10-08T16:06:53.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.699+0000 7f86c970d700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f86a8060550 0x7f86a8062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f86c00099f0 tx=0x7f86c0019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:53.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.707+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f86b4081020 con 0x7f86c40c9680 2023-10-08T16:06:53.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.907+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86c404be40 con 0x7f86c40c9680 2023-10-08T16:06:53.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86b97fa700 1 -- 172.21.15.3:0/3867998061 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f86b4017020 con 0x7f86c40c9680 2023-10-08T16:06:53.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:53.913 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f86a8060550 msgr2=0x7f86a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f86a8060550 0x7f86a8062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f86c00099f0 tx=0x7f86c0019000 comp rx=0 tx=0).stop 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 msgr2=0x7f86c40aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 0x7f86c40aad50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f86b400c610 tx=0x7f86b400c920 comp rx=0 tx=0).stop 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 shutdown_connections 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f86a8060550 0x7f86a8062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86c415d740 0x7f86c40b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86c40c9680 0x7f86c40aad50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 --2- 172.21.15.3:0/3867998061 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f86c40c7fc0 0x7f86c40b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 >> 172.21.15.3:0/3867998061 conn(0x7f86c406b6b0 msgr2=0x7f86c40ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:53.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 shutdown_connections 2023-10-08T16:06:53.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:53.911+0000 7f86ca70f700 1 -- 172.21.15.3:0/3867998061 wait complete. 2023-10-08T16:06:53.917 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:06:53.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:54.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 Processor -- start 2023-10-08T16:06:54.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 -- start start 2023-10-08T16:06:54.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5480158b90 0x7f5480158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f548006a400 0x7f548006a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54800ca2d0 con 0x7f54800cad20 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54801594a0 con 0x7f5480158b90 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54800ca890 con 0x7f548006a400 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5480158b90 0x7f5480158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5480158b90 0x7f5480158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42688/0 (socket says 172.21.15.3:42688) 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 -- 172.21.15.3:0/3609913238 learned_addr learned my addr 172.21.15.3:0/3609913238 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f5477fff700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f548006a400 0x7f548006a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547dd9b700 1 -- 172.21.15.3:0/3609913238 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577801380 0 0) 0x7f54800ca2d0 con 0x7f54800cad20 2023-10-08T16:06:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547dd9b700 1 -- 172.21.15.3:0/3609913238 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f546c003570 con 0x7f54800cad20 2023-10-08T16:06:54.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 -- 172.21.15.3:0/3609913238 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f548006a400 msgr2=0x7f548006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f548006a400 0x7f548006a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 -- 172.21.15.3:0/3609913238 >> v1:172.21.15.27:6789/0 conn(0x7f54800cad20 legacy=0x7f5480067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 -- 172.21.15.3:0/3609913238 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480159890 con 0x7f5480158b90 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f5477fff700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f548006a400 0x7f548006a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547e59c700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f5480158f60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54700099b0 tx=0x7f5470009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8768b6d1b9d5ed7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547dd9b700 1 -- 172.21.15.3:0/3609913238 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000b680 con 0x7f5480158b90 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547dd9b700 1 -- 172.21.15.3:0/3609913238 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000b7e0 con 0x7f5480158b90 2023-10-08T16:06:54.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.039+0000 7f547dd9b700 1 -- 172.21.15.3:0/3609913238 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000bb60 con 0x7f5480158b90 2023-10-08T16:06:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- 172.21.15.3:0/3609913238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 msgr2=0x7f5480158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f5480158f60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54700099b0 tx=0x7f5470009250 comp rx=0 tx=0).stop 2023-10-08T16:06:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- 172.21.15.3:0/3609913238 shutdown_connections 2023-10-08T16:06:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f548006a400 0x7f548006a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 --2- 172.21.15.3:0/3609913238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f5480158f60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- 172.21.15.3:0/3609913238 >> 172.21.15.3:0/3609913238 conn(0x7f54800cfd30 msgr2=0x7f54800d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- 172.21.15.3:0/3609913238 shutdown_connections 2023-10-08T16:06:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- 172.21.15.3:0/3609913238 wait complete. 2023-10-08T16:06:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 Processor -- start 2023-10-08T16:06:54.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- start start 2023-10-08T16:06:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548006a400 0x7f548015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f54800cad20 0x7f54800c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f54800c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5480155b50 con 0x7f5480158b90 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548016a540 con 0x7f548006a400 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5480169c10 con 0x7f54800cad20 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.043+0000 7f547ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f54800c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f54800c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42700/0 (socket says 172.21.15.3:42700) 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 -- 172.21.15.3:0/4259420267 learned_addr learned my addr 172.21.15.3:0/4259420267 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f5477fff700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f54800cad20 0x7f54800c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547e59c700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548006a400 0x7f548015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 -- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f54800cad20 msgr2=0x7f54800c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f54800cad20 0x7f54800c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 -- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548006a400 msgr2=0x7f548015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548006a400 0x7f548015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 -- 172.21.15.3:0/4259420267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468009420 con 0x7f5480158b90 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547e59c700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548006a400 0x7f548015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547ed9d700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f54800c74b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f547800c910 tx=0x7f5478002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478012630 con 0x7f5480158b90 2023-10-08T16:06:54.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478012790 con 0x7f5480158b90 2023-10-08T16:06:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54700094f0 con 0x7f5480158b90 2023-10-08T16:06:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478012b50 con 0x7f5480158b90 2023-10-08T16:06:54.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548016a1d0 con 0x7f5480158b90 2023-10-08T16:06:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54800ce9e0 con 0x7f5480158b90 2023-10-08T16:06:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f547801a3b0 con 0x7f5480158b90 2023-10-08T16:06:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f54767fc700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5460060550 0x7f5460062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f547807c980 con 0x7f5480158b90 2023-10-08T16:06:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.047+0000 7f547e59c700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5460060550 0x7f5460062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.051+0000 7f547e59c700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5460060550 0x7f5460062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54700099b0 tx=0x7f5470017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.055+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f54800ce9e0 con 0x7f5480158b90 2023-10-08T16:06:54.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.219+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54800ce9e0 con 0x7f5480158b90 2023-10-08T16:06:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f54767fc700 1 -- 172.21.15.3:0/4259420267 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f54800ce9e0 con 0x7f5480158b90 2023-10-08T16:06:54.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:54.226 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:54.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5460060550 msgr2=0x7f5460062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5460060550 0x7f5460062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54700099b0 tx=0x7f5470017000 comp rx=0 tx=0).stop 2023-10-08T16:06:54.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 msgr2=0x7f54800c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f54800c74b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f547800c910 tx=0x7f5478002720 comp rx=0 tx=0).stop 2023-10-08T16:06:54.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 shutdown_connections 2023-10-08T16:06:54.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5460060550 0x7f5460062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5480158b90 0x7f54800c74b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f54800cad20 0x7f54800c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 --2- 172.21.15.3:0/4259420267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548006a400 0x7f548015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 >> 172.21.15.3:0/4259420267 conn(0x7f54800cfd30 msgr2=0x7f54800d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 shutdown_connections 2023-10-08T16:06:54.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.223+0000 7f547f59e700 1 -- 172.21.15.3:0/4259420267 wait complete. 2023-10-08T16:06:54.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:06:54.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:06:54.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.347+0000 7f97d064b700 1 Processor -- start 2023-10-08T16:06:54.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.347+0000 7f97d064b700 1 -- start start 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.347+0000 7f97d064b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f97c8159f70 0x7f97c815a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.347+0000 7f97d064b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f97c80cd770 0x7f97c80c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.347+0000 7f97d064b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c80cbf30 0x7f97c815a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80cd2e0 con 0x7f97c80cd770 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80cc6d0 con 0x7f97c8159f70 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80cc9b0 con 0x7f97c80cbf30 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f97c80cd770 0x7f97c80c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f97c80cd770 0x7f97c80c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42716/0 (socket says 172.21.15.3:42716) 2023-10-08T16:06:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 -- 172.21.15.3:0/218464544 learned_addr learned my addr 172.21.15.3:0/218464544 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cebe8700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c80cbf30 0x7f97c815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97ce3e7700 1 --2- 172.21.15.3:0/218464544 >> v2:172.21.15.27:3300/0 conn(0x7f97c8159f70 0x7f97c815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 -- 172.21.15.3:0/218464544 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c80cbf30 msgr2=0x7f97c815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c80cbf30 0x7f97c815a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 -- 172.21.15.3:0/218464544 >> v2:172.21.15.27:3300/0 conn(0x7f97c8159f70 msgr2=0x7f97c815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 --2- 172.21.15.3:0/218464544 >> v2:172.21.15.27:3300/0 conn(0x7f97c8159f70 0x7f97c815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 -- 172.21.15.3:0/218464544 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c80ccc90 con 0x7f97c80cd770 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cebe8700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c80cbf30 0x7f97c815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cdbe6700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cd770 0x7f97c80c8fd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f97c806b6a0 tx=0x7f97b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd43f92f9e2cb945 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cd3e5700 1 -- 172.21.15.3:0/218464544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800b640 con 0x7f97c80cd770 2023-10-08T16:06:54.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cd3e5700 1 -- 172.21.15.3:0/218464544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800b7a0 con 0x7f97c80cd770 2023-10-08T16:06:54.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97cd3e5700 1 -- 172.21.15.3:0/218464544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800bb60 con 0x7f97c80cd770 2023-10-08T16:06:54.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- 172.21.15.3:0/218464544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cd770 msgr2=0x7f97c80c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cd770 0x7f97c80c8fd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f97c806b6a0 tx=0x7f97b8009250 comp rx=0 tx=0).stop 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- 172.21.15.3:0/218464544 shutdown_connections 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c80cbf30 0x7f97c815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 --2- 172.21.15.3:0/218464544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cd770 0x7f97c80c8fd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 --2- 172.21.15.3:0/218464544 >> v2:172.21.15.27:3300/0 conn(0x7f97c8159f70 0x7f97c815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- 172.21.15.3:0/218464544 >> 172.21.15.3:0/218464544 conn(0x7f97c80ca6d0 msgr2=0x7f97c80caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- 172.21.15.3:0/218464544 shutdown_connections 2023-10-08T16:06:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.351+0000 7f97d064b700 1 -- 172.21.15.3:0/218464544 wait complete. 2023-10-08T16:06:54.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.355+0000 7f97d064b700 1 Processor -- start 2023-10-08T16:06:54.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.355+0000 7f97d064b700 1 -- start start 2023-10-08T16:06:54.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 0x7f97c81568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97c80cd770 0x7f97c80b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c8159f70 0x7f97c8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8169820 con 0x7f97c80cbf30 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8156e30 con 0x7f97c80cd770 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c816a060 con 0x7f97c8159f70 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 0x7f97c81568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 0x7f97c81568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42718/0 (socket says 172.21.15.3:42718) 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 -- 172.21.15.3:0/3486824280 learned_addr learned my addr 172.21.15.3:0/3486824280 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97cebe8700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c8159f70 0x7f97c8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97cdbe6700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97c80cd770 0x7f97c80b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 -- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c8159f70 msgr2=0x7f97c8157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c8159f70 0x7f97c8157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 -- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97c80cd770 msgr2=0x7f97c80b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97c80cd770 0x7f97c80b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 -- 172.21.15.3:0/3486824280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c0009a20 con 0x7f97c80cbf30 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97ce3e7700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 0x7f97c81568f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e990 tx=0x7f97c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400ee80 con 0x7f97c80cbf30 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400c850 con 0x7f97c80cbf30 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b80094f0 con 0x7f97c80cbf30 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400cbf0 con 0x7f97c80cbf30 2023-10-08T16:06:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.359+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c8169a10 con 0x7f97c80cbf30 2023-10-08T16:06:54.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.363+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c8071180 con 0x7f97c80cbf30 2023-10-08T16:06:54.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.363+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f97c4013470 con 0x7f97c80cbf30 2023-10-08T16:06:54.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.363+0000 7f97be7fc700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97ac060580 0x7f97ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.363+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97c407c840 con 0x7f97c80cbf30 2023-10-08T16:06:54.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.363+0000 7f97cdbe6700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97ac060580 0x7f97ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.363+0000 7f97cdbe6700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97ac060580 0x7f97ac062a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97c806b6a0 tx=0x7f97b8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.371+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97c404cef0 con 0x7f97c80cbf30 2023-10-08T16:06:54.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.535+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97c80ca000 con 0x7f97c80cbf30 2023-10-08T16:06:54.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97be7fc700 1 -- 172.21.15.3:0/3486824280 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97c4050510 con 0x7f97c80cbf30 2023-10-08T16:06:54.541 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:06:54.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97ac060580 msgr2=0x7f97ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97ac060580 0x7f97ac062a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97c806b6a0 tx=0x7f97b8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 msgr2=0x7f97c81568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 0x7f97c81568f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e990 tx=0x7f97c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 shutdown_connections 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97ac060580 0x7f97ac062a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97c8159f70 0x7f97c8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97c80cd770 0x7f97c80b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 --2- 172.21.15.3:0/3486824280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97c80cbf30 0x7f97c81568f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 >> 172.21.15.3:0/3486824280 conn(0x7f97c80ca6d0 msgr2=0x7f97c8159660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 shutdown_connections 2023-10-08T16:06:54.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.539+0000 7f97d064b700 1 -- 172.21.15.3:0/3486824280 wait complete. 2023-10-08T16:06:54.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:06:54.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.663+0000 7f51adefa700 1 Processor -- start 2023-10-08T16:06:54.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 -- start start 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a80adb20 0x7f51a806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f51a815b180 0x7f51a80c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f51a80c6c30 0x7f51a80ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a80c70b0 con 0x7f51a815b180 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a806d640 con 0x7f51a80c6c30 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a806e010 con 0x7f51a80adb20 2023-10-08T16:06:54.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f51a815b180 0x7f51a80c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f51a815b180 0x7f51a80c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42728/0 (socket says 172.21.15.3:42728) 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 -- 172.21.15.3:0/3735200558 learned_addr learned my addr 172.21.15.3:0/3735200558 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51ad6f9700 1 --2- 172.21.15.3:0/3735200558 >> v2:172.21.15.27:3300/0 conn(0x7f51a80c6c30 0x7f51a80ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51acef8700 1 --2- 172.21.15.3:0/3735200558 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a80adb20 0x7f51a806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 -- 172.21.15.3:0/3735200558 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a80adb20 msgr2=0x7f51a806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 --2- 172.21.15.3:0/3735200558 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a80adb20 0x7f51a806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 -- 172.21.15.3:0/3735200558 >> v2:172.21.15.27:3300/0 conn(0x7f51a80c6c30 msgr2=0x7f51a80ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 --2- 172.21.15.3:0/3735200558 >> v2:172.21.15.27:3300/0 conn(0x7f51a80c6c30 0x7f51a80ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 -- 172.21.15.3:0/3735200558 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8157010 con 0x7f51a815b180 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51ad6f9700 1 --2- 172.21.15.3:0/3735200558 >> v2:172.21.15.27:3300/0 conn(0x7f51a80c6c30 0x7f51a80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:54.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a7fff700 1 --2- 172.21.15.3:0/3735200558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a815b180 0x7f51a80c66f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51a806b880 tx=0x7f5190009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2539edcd684cde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a77fe700 1 -- 172.21.15.3:0/3735200558 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000e070 con 0x7f51a815b180 2023-10-08T16:06:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a77fe700 1 -- 172.21.15.3:0/3735200558 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000bae0 con 0x7f51a815b180 2023-10-08T16:06:54.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51a77fe700 1 -- 172.21.15.3:0/3735200558 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900092e0 con 0x7f51a815b180 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 -- 172.21.15.3:0/3735200558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a815b180 msgr2=0x7f51a80c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.667+0000 7f51adefa700 1 --2- 172.21.15.3:0/3735200558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a815b180 0x7f51a80c66f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51a806b880 tx=0x7f5190009840 comp rx=0 tx=0).stop 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 -- 172.21.15.3:0/3735200558 shutdown_connections 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 --2- 172.21.15.3:0/3735200558 >> v2:172.21.15.27:3300/0 conn(0x7f51a80c6c30 0x7f51a80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 --2- 172.21.15.3:0/3735200558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a815b180 0x7f51a80c66f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 --2- 172.21.15.3:0/3735200558 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a80adb20 0x7f51a806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 -- 172.21.15.3:0/3735200558 >> 172.21.15.3:0/3735200558 conn(0x7f51a80c83b0 msgr2=0x7f51a80c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 -- 172.21.15.3:0/3735200558 shutdown_connections 2023-10-08T16:06:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 -- 172.21.15.3:0/3735200558 wait complete. 2023-10-08T16:06:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 Processor -- start 2023-10-08T16:06:54.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.671+0000 7f51adefa700 1 -- start start 2023-10-08T16:06:54.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51a80adb20 0x7f51a8154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 0x7f51a80a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a815b180 0x7f51a806a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80a8c00 con 0x7f51a80c6c30 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8154fe0 con 0x7f51a80adb20 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80ca200 con 0x7f51a815b180 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 0x7f51a80a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51acef8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51a80adb20 0x7f51a8154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 0x7f51a80a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42732/0 (socket says 172.21.15.3:42732) 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 -- 172.21.15.3:0/98387647 learned_addr learned my addr 172.21.15.3:0/98387647 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51ad6f9700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a815b180 0x7f51a806a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 -- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a815b180 msgr2=0x7f51a806a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a815b180 0x7f51a806a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 -- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51a80adb20 msgr2=0x7f51a8154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51a80adb20 0x7f51a8154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 -- 172.21.15.3:0/98387647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190009ae0 con 0x7f51a80c6c30 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a7fff700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 0x7f51a80a92c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f51a80c2750 tx=0x7f5190018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190008980 con 0x7f51a80c6c30 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190008b20 con 0x7f51a80c6c30 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80ca4e0 con 0x7f51a80c6c30 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519001c410 con 0x7f51a80c6c30 2023-10-08T16:06:54.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.675+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80cab20 con 0x7f51a80c6c30 2023-10-08T16:06:54.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.679+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a804be40 con 0x7f51a80c6c30 2023-10-08T16:06:54.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.679+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5190003040 con 0x7f51a80c6c30 2023-10-08T16:06:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.679+0000 7f51a4ff9700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5188060550 0x7f5188062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.679+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f519007dd90 con 0x7f51a80c6c30 2023-10-08T16:06:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.679+0000 7f51acef8700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5188060550 0x7f5188062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.679+0000 7f51acef8700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5188060550 0x7f5188062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5198006aa0 tx=0x7f5198008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.683+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f519004e2e0 con 0x7f51a80c6c30 2023-10-08T16:06:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.847+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51a806f230 con 0x7f51a80c6c30 2023-10-08T16:06:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.847+0000 7f51a4ff9700 1 -- 172.21.15.3:0/98387647 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5190009940 con 0x7f51a80c6c30 2023-10-08T16:06:54.852 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:06:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5188060550 msgr2=0x7f5188062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5188060550 0x7f5188062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5198006aa0 tx=0x7f5198008040 comp rx=0 tx=0).stop 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 msgr2=0x7f51a80a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 0x7f51a80a92c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f51a80c2750 tx=0x7f5190018000 comp rx=0 tx=0).stop 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 shutdown_connections 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5188060550 0x7f5188062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f51a815b180 0x7f51a806a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51a80c6c30 0x7f51a80a92c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 --2- 172.21.15.3:0/98387647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51a80adb20 0x7f51a8154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 >> 172.21.15.3:0/98387647 conn(0x7f51a80c83b0 msgr2=0x7f51a80c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 shutdown_connections 2023-10-08T16:06:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.851+0000 7f51adefa700 1 -- 172.21.15.3:0/98387647 wait complete. 2023-10-08T16:06:54.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:06:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dbadc3700 1 Processor -- start 2023-10-08T16:06:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dbadc3700 1 -- start start 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dbadc3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6db406db60 0x7f6db415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dbadc3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db406bb50 con 0x7f6db40b37c0 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dbadc3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40b45a0 con 0x7f6db4158c80 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dbadc3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db406a3a0 con 0x7f6db406db60 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dba5c2700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6db40b37c0 0x7f6db4159050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51630/0 (socket says 172.21.15.3:51630) 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dba5c2700 1 -- 172.21.15.3:0/2781446747 learned_addr learned my addr 172.21.15.3:0/2781446747 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2781446747 >> v2:172.21.15.27:3300/0 conn(0x7f6db406db60 0x7f6db415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160118086 0 0) 0x7f6db406bb50 con 0x7f6db40b37c0 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d9c003570 con 0x7f6db40b37c0 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644228558 0 0) 0x7f6d9c003570 con 0x7f6db40b37c0 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 >> v2:172.21.15.27:3300/0 conn(0x7f6db406db60 msgr2=0x7f6db415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 --2- 172.21.15.3:0/2781446747 >> v2:172.21.15.27:3300/0 conn(0x7f6db406db60 0x7f6db415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 >> v1:172.21.15.27:6789/0 conn(0x7f6db4158c80 legacy=0x7f6db406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db406a680 con 0x7f6db40b37c0 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f6dac0017f0 con 0x7f6db40b37c0 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 >> v1:172.21.15.3:6789/0 conn(0x7f6db40b37c0 legacy=0x7f6db4159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d9c003a60 0x7f6d9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d9c004810 0x7f6d9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c0051c0 0x7f6d9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db406a3a0 con 0x7f6d9c004810 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c00c0d0 con 0x7f6d9c0051c0 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c00c290 con 0x7f6d9c003a60 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d9c004810 0x7f6d9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.979+0000 7f6dba5c2700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c0051c0 0x7f6d9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db9dc1700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d9c003a60 0x7f6d9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db95c0700 1 -- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d9c003a60 msgr2=0x7f6d9c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d9c003a60 0x7f6d9c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db95c0700 1 -- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c0051c0 msgr2=0x7f6d9c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c0051c0 0x7f6d9c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db95c0700 1 -- 172.21.15.3:0/2781446747 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c003570 con 0x7f6d9c004810 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dba5c2700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c0051c0 0x7f6d9c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dba5c2700 1 -- 172.21.15.3:0/2781446747 reap_dead start 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db9dc1700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d9c003a60 0x7f6d9c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d9c004810 0x7f6d9c004c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009c00 tx=0x7f6db00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e436d9a909402214 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000e710 con 0x7f6d9c004810 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000e870 con 0x7f6d9c004810 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6db8dbf700 1 -- 172.21.15.3:0/2781446747 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000ec30 con 0x7f6d9c004810 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2781446747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d9c004810 msgr2=0x7f6d9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d9c004810 0x7f6d9c004c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009c00 tx=0x7f6db00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2781446747 shutdown_connections 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2781446747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d9c004810 0x7f6d9c004c80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2781446747 >> 172.21.15.3:0/2781446747 conn(0x7f6db40d0820 msgr2=0x7f6db40b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2781446747 shutdown_connections 2023-10-08T16:06:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2781446747 wait complete. 2023-10-08T16:06:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 Processor -- start 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.983+0000 7f6dbadc3700 1 -- start start 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c004810 0x7f6db41468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6db40cc830 0x7f6db40ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6db4156760 0x7f6db4156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40cd840 con 0x7f6db4156760 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4157110 con 0x7f6d9c004810 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4169480 con 0x7f6db40cc830 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dba5c2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6db4156760 0x7f6db4156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6db40cc830 0x7f6db40ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db9dc1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c004810 0x7f6db41468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dba5c2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6db4156760 0x7f6db4156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42740/0 (socket says 172.21.15.3:42740) 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dba5c2700 1 -- 172.21.15.3:0/2179798828 learned_addr learned my addr 172.21.15.3:0/2179798828 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 -- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c004810 msgr2=0x7f6db41468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c004810 0x7f6db41468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 -- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6db4156760 msgr2=0x7f6db4156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6db4156760 0x7f6db4156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 -- 172.21.15.3:0/2179798828 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40ce460 con 0x7f6db40cc830 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6db95c0700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6db40cc830 0x7f6db40ccca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6db0006f00 tx=0x7f6db001a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0022070 con 0x7f6db40cc830 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db40cd280 con 0x7f6db40cc830 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000e9e0 con 0x7f6db40cc830 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00276c0 con 0x7f6db40cc830 2023-10-08T16:06:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.987+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db40ce0f0 con 0x7f6db40cc830 2023-10-08T16:06:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.991+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6db001c450 con 0x7f6db40cc830 2023-10-08T16:06:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.991+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db40cdf50 con 0x7f6db40cc830 2023-10-08T16:06:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.991+0000 7f6da9ffb700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6da0060580 0x7f6da0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:54.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.991+0000 7f6db9dc1700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6da0060580 0x7f6da0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:54.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.991+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6db007e380 con 0x7f6db40cc830 2023-10-08T16:06:54.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.991+0000 7f6db9dc1700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6da0060580 0x7f6da0062a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6da4007fd0 tx=0x7f6da4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:54.999+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6db40cdf50 con 0x7f6db40cc830 2023-10-08T16:06:55.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.159+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6db40cdf50 con 0x7f6db40cc830 2023-10-08T16:06:55.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.163+0000 7f6da9ffb700 1 -- 172.21.15.3:0/2179798828 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6db40cdf50 con 0x7f6db40cc830 2023-10-08T16:06:55.165 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:06:55.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6da0060580 msgr2=0x7f6da0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6da0060580 0x7f6da0062a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6da4007fd0 tx=0x7f6da4009040 comp rx=0 tx=0).stop 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6db40cc830 msgr2=0x7f6db40ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6db40cc830 0x7f6db40ccca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6db0006f00 tx=0x7f6db001a000 comp rx=0 tx=0).stop 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 shutdown_connections 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6da0060580 0x7f6da0062a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6db4156760 0x7f6db4156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6db40cc830 0x7f6db40ccca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 --2- 172.21.15.3:0/2179798828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d9c004810 0x7f6db41468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 >> 172.21.15.3:0/2179798828 conn(0x7f6db40d0820 msgr2=0x7f6db41525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 shutdown_connections 2023-10-08T16:06:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.167+0000 7f6dbadc3700 1 -- 172.21.15.3:0/2179798828 wait complete. 2023-10-08T16:06:55.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:55.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac7254700 1 Processor -- start 2023-10-08T16:06:55.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac7254700 1 -- start start 2023-10-08T16:06:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac7254700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ac015a530 0x7f0ac00aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac7254700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac006c260 con 0x7f0ac006d9f0 2023-10-08T16:06:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac7254700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac006b650 con 0x7f0ac00aa960 2023-10-08T16:06:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac7254700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac006b930 con 0x7f0ac015a530 2023-10-08T16:06:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ac015a530 0x7f0ac00aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ac015a530 0x7f0ac00aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42742/0 (socket says 172.21.15.3:42742) 2023-10-08T16:06:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 -- 172.21.15.3:0/1823356775 learned_addr learned my addr 172.21.15.3:0/1823356775 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac5a51700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0ac006d9f0 0x7f0ac0159e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51634/0 (socket says 172.21.15.3:51634) 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac5250700 1 -- 172.21.15.3:0/1823356775 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883031443 0 0) 0x7f0ac006c260 con 0x7f0ac006d9f0 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac5250700 1 -- 172.21.15.3:0/1823356775 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aac003570 con 0x7f0ac006d9f0 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 -- 172.21.15.3:0/1823356775 >> v1:172.21.15.27:6789/0 conn(0x7f0ac00aa960 legacy=0x7f0ac00c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 -- 172.21.15.3:0/1823356775 >> v1:172.21.15.3:6789/0 conn(0x7f0ac006d9f0 legacy=0x7f0ac0159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 -- 172.21.15.3:0/1823356775 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac006bc10 con 0x7f0ac015a530 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.287+0000 7f0ac6a53700 1 --2- 172.21.15.3:0/1823356775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac015a530 0x7f0ac00aad30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009f00 tx=0x7f0ab8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd9b796fde4bc57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac5250700 1 -- 172.21.15.3:0/1823356775 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800e070 con 0x7f0ac015a530 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac5250700 1 -- 172.21.15.3:0/1823356775 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800b9a0 con 0x7f0ac015a530 2023-10-08T16:06:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac5250700 1 -- 172.21.15.3:0/1823356775 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80092e0 con 0x7f0ac015a530 2023-10-08T16:06:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 -- 172.21.15.3:0/1823356775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac015a530 msgr2=0x7f0ac00aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1823356775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac015a530 0x7f0ac00aad30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009f00 tx=0x7f0ab8009840 comp rx=0 tx=0).stop 2023-10-08T16:06:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 -- 172.21.15.3:0/1823356775 shutdown_connections 2023-10-08T16:06:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1823356775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac015a530 0x7f0ac00aad30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 -- 172.21.15.3:0/1823356775 >> 172.21.15.3:0/1823356775 conn(0x7f0ac00c83d0 msgr2=0x7f0ac00c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 -- 172.21.15.3:0/1823356775 shutdown_connections 2023-10-08T16:06:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 -- 172.21.15.3:0/1823356775 wait complete. 2023-10-08T16:06:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 Processor -- start 2023-10-08T16:06:55.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.291+0000 7f0ac7254700 1 -- start start 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0ac006d9f0 0x7f0ac014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 0x7f0ac00ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac015a530 0x7f0ac00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac014ee40 con 0x7f0ac00aa960 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac014bff0 con 0x7f0ac015a530 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac014cb70 con 0x7f0ac006d9f0 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 0x7f0ac00ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 0x7f0ac00ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42746/0 (socket says 172.21.15.3:42746) 2023-10-08T16:06:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 -- 172.21.15.3:0/1968683681 learned_addr learned my addr 172.21.15.3:0/1968683681 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac6a53700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac015a530 0x7f0ac00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac6252700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0ac006d9f0 0x7f0ac014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 -- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0ac006d9f0 msgr2=0x7f0ac014b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0ac006d9f0 0x7f0ac014b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 -- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac015a530 msgr2=0x7f0ac00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac015a530 0x7f0ac00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 -- 172.21.15.3:0/1968683681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009ae0 con 0x7f0ac00aa960 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac6252700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0ac006d9f0 0x7f0ac014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac5a51700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 0x7f0ac00ae870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c820 tx=0x7f0ab4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4005a70 con 0x7f0ac00aa960 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4005bd0 con 0x7f0ac00aa960 2023-10-08T16:06:55.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40070d0 con 0x7f0ac00aa960 2023-10-08T16:06:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac014c240 con 0x7f0ac00aa960 2023-10-08T16:06:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.295+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac014c800 con 0x7f0ac00aa960 2023-10-08T16:06:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.299+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac004be40 con 0x7f0ac00aa960 2023-10-08T16:06:55.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.299+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ab40074c0 con 0x7f0ac00aa960 2023-10-08T16:06:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.303+0000 7f0ab27fc700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0aa4060550 0x7f0aa4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.303+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ab407bd10 con 0x7f0ac00aa960 2023-10-08T16:06:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.303+0000 7f0ac6252700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0aa4060550 0x7f0aa4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.303+0000 7f0ac6252700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0aa4060550 0x7f0aa4062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0abc007fd0 tx=0x7f0abc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.307+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ab404c300 con 0x7f0ac00aa960 2023-10-08T16:06:55.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.507+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ac014ccb0 con 0x7f0ac00aa960 2023-10-08T16:06:55.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ab27fc700 1 -- 172.21.15.3:0/1968683681 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f0ab404f920 con 0x7f0ac00aa960 2023-10-08T16:06:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:55.513 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:06:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0aa4060550 msgr2=0x7f0aa4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0aa4060550 0x7f0aa4062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0abc007fd0 tx=0x7f0abc009040 comp rx=0 tx=0).stop 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 msgr2=0x7f0ac00ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 0x7f0ac00ae870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c820 tx=0x7f0ab4007e00 comp rx=0 tx=0).stop 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 shutdown_connections 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0aa4060550 0x7f0aa4062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac015a530 0x7f0ac00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac00aa960 0x7f0ac00ae870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 --2- 172.21.15.3:0/1968683681 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0ac006d9f0 0x7f0ac014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 >> 172.21.15.3:0/1968683681 conn(0x7f0ac00c83d0 msgr2=0x7f0ac01554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 shutdown_connections 2023-10-08T16:06:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.511+0000 7f0ac7254700 1 -- 172.21.15.3:0/1968683681 wait complete. 2023-10-08T16:06:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:06:55.531 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:55.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 Processor -- start 2023-10-08T16:06:55.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 -- start start 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e900ca070 0x7f0e900ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e9006aeb0 0x7f0e9006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9006c8a0 con 0x7f0e9006d900 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9006cb40 con 0x7f0e9006aeb0 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e95289700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9006ce20 con 0x7f0e900ca070 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e9006aeb0 0x7f0e9006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e9006aeb0 0x7f0e9006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42752/0 (socket says 172.21.15.3:42752) 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/2132822862 learned_addr learned my addr 172.21.15.3:0/2132822862 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:55.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8ffff700 1 --2- 172.21.15.3:0/2132822862 >> v2:172.21.15.27:3300/0 conn(0x7f0e900ca070 0x7f0e900ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/2132822862 >> v2:172.21.15.27:3300/0 conn(0x7f0e900ca070 msgr2=0x7f0e900ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:55.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 --2- 172.21.15.3:0/2132822862 >> v2:172.21.15.27:3300/0 conn(0x7f0e900ca070 0x7f0e900ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/2132822862 >> v1:172.21.15.27:6789/0 conn(0x7f0e9006d900 legacy=0x7f0e9015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/2132822862 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9006d100 con 0x7f0e9006aeb0 2023-10-08T16:06:55.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8f7fe700 1 --2- 172.21.15.3:0/2132822862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e9006aeb0 0x7f0e9006bc90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e780099b0 tx=0x7f0e78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468800297b669771 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8effd700 1 -- 172.21.15.3:0/2132822862 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78009ea0 con 0x7f0e9006aeb0 2023-10-08T16:06:55.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8effd700 1 -- 172.21.15.3:0/2132822862 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800b820 con 0x7f0e9006aeb0 2023-10-08T16:06:55.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.635+0000 7f0e8effd700 1 -- 172.21.15.3:0/2132822862 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800bbc0 con 0x7f0e9006aeb0 2023-10-08T16:06:55.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 -- 172.21.15.3:0/2132822862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e9006aeb0 msgr2=0x7f0e9006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 --2- 172.21.15.3:0/2132822862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e9006aeb0 0x7f0e9006bc90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e780099b0 tx=0x7f0e78009250 comp rx=0 tx=0).stop 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 -- 172.21.15.3:0/2132822862 shutdown_connections 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 --2- 172.21.15.3:0/2132822862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e9006aeb0 0x7f0e9006bc90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 --2- 172.21.15.3:0/2132822862 >> v2:172.21.15.27:3300/0 conn(0x7f0e900ca070 0x7f0e900ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 -- 172.21.15.3:0/2132822862 >> 172.21.15.3:0/2132822862 conn(0x7f0e900c83d0 msgr2=0x7f0e900c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 -- 172.21.15.3:0/2132822862 shutdown_connections 2023-10-08T16:06:55.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 -- 172.21.15.3:0/2132822862 wait complete. 2023-10-08T16:06:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 Processor -- start 2023-10-08T16:06:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.639+0000 7f0e95289700 1 -- start start 2023-10-08T16:06:55.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9006d900 0x7f0e901596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 0x7f0e900c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e900c2a10 0x7f0e900c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900c2ea0 con 0x7f0e900ca070 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900c3180 con 0x7f0e9006d900 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900c3460 con 0x7f0e900c2a10 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 0x7f0e900c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 0x7f0e900c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42758/0 (socket says 172.21.15.3:42758) 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/628806752 learned_addr learned my addr 172.21.15.3:0/628806752 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8ffff700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9006d900 0x7f0e901596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e94a88700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e900c2a10 0x7f0e900c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e900c2a10 msgr2=0x7f0e900c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e900c2a10 0x7f0e900c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9006d900 msgr2=0x7f0e901596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9006d900 0x7f0e901596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 -- 172.21.15.3:0/628806752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780094f0 con 0x7f0e900ca070 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8ffff700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9006d900 0x7f0e901596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e8f7fe700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 0x7f0e900c3f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0e780094c0 tx=0x7f0e78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800bba0 con 0x7f0e900ca070 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78011420 con 0x7f0e900ca070 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900c3740 con 0x7f0e900ca070 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780117c0 con 0x7f0e900ca070 2023-10-08T16:06:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e900c49c0 con 0x7f0e900ca070 2023-10-08T16:06:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9004be40 con 0x7f0e900ca070 2023-10-08T16:06:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.643+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0e78011b70 con 0x7f0e900ca070 2023-10-08T16:06:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.647+0000 7f0e87fff700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e70060580 0x7f0e70062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.647+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e7807e030 con 0x7f0e900ca070 2023-10-08T16:06:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.647+0000 7f0e8ffff700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e70060580 0x7f0e70062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.647+0000 7f0e8ffff700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e70060580 0x7f0e70062a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e800076c0 tx=0x7f0e8000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.659+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0e7804e620 con 0x7f0e900ca070 2023-10-08T16:06:55.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.823+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e9006d3e0 con 0x7f0e900ca070 2023-10-08T16:06:55.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.823+0000 7f0e87fff700 1 -- 172.21.15.3:0/628806752 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f0e78051c40 con 0x7f0e900ca070 2023-10-08T16:06:55.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:55.828 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:55.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e70060580 msgr2=0x7f0e70062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e70060580 0x7f0e70062a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e800076c0 tx=0x7f0e8000b040 comp rx=0 tx=0).stop 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 msgr2=0x7f0e900c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 0x7f0e900c3f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0e780094c0 tx=0x7f0e78017000 comp rx=0 tx=0).stop 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 shutdown_connections 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e70060580 0x7f0e70062a30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e900c2a10 0x7f0e900c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e900ca070 0x7f0e900c3f40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 --2- 172.21.15.3:0/628806752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9006d900 0x7f0e901596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 >> 172.21.15.3:0/628806752 conn(0x7f0e900c83d0 msgr2=0x7f0e900c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 shutdown_connections 2023-10-08T16:06:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.827+0000 7f0e95289700 1 -- 172.21.15.3:0/628806752 wait complete. 2023-10-08T16:06:55.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:55.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.955+0000 7f2a1bfff700 1 Processor -- start 2023-10-08T16:06:55.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.955+0000 7f2a1bfff700 1 -- start start 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a14035280 0x7f2a140067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a14036450 con 0x7f2a140dfb00 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a14007130 con 0x7f2a14006ce0 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140dfed0 con 0x7f2a14035280 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1affd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2a140dfb00 0x7f2a14036c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51636/0 (socket says 172.21.15.3:51636) 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1affd700 1 -- 172.21.15.3:0/3050980607 learned_addr learned my addr 172.21.15.3:0/3050980607 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1a7fc700 1 --2- 172.21.15.3:0/3050980607 >> v2:172.21.15.27:3300/0 conn(0x7f2a14035280 0x7f2a140067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a19ffb700 1 -- 172.21.15.3:0/3050980607 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210280992 0 0) 0x7f2a14036450 con 0x7f2a140dfb00 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a19ffb700 1 -- 172.21.15.3:0/3050980607 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a04003570 con 0x7f2a140dfb00 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/3050980607 >> v1:172.21.15.27:6789/0 conn(0x7f2a14006ce0 legacy=0x7f2a14052910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/3050980607 >> v1:172.21.15.3:6789/0 conn(0x7f2a140dfb00 legacy=0x7f2a14036c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/3050980607 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140373a0 con 0x7f2a14035280 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1a7fc700 1 --2- 172.21.15.3:0/3050980607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a14035280 0x7f2a140067a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a100098e0 tx=0x7f2a100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b809a7f8a3c1c2f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a19ffb700 1 -- 172.21.15.3:0/3050980607 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000f6b0 con 0x7f2a14035280 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a19ffb700 1 -- 172.21.15.3:0/3050980607 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000f810 con 0x7f2a14035280 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a19ffb700 1 -- 172.21.15.3:0/3050980607 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000fbb0 con 0x7f2a14035280 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- 172.21.15.3:0/3050980607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a14035280 msgr2=0x7f2a140067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/3050980607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a14035280 0x7f2a140067a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a100098e0 tx=0x7f2a100091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- 172.21.15.3:0/3050980607 shutdown_connections 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/3050980607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a14035280 0x7f2a140067a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- 172.21.15.3:0/3050980607 >> 172.21.15.3:0/3050980607 conn(0x7f2a14054d40 msgr2=0x7f2a14055110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- 172.21.15.3:0/3050980607 shutdown_connections 2023-10-08T16:06:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.959+0000 7f2a1bfff700 1 -- 172.21.15.3:0/3050980607 wait complete. 2023-10-08T16:06:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 Processor -- start 2023-10-08T16:06:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 -- start start 2023-10-08T16:06:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a14006ce0 0x7f2a1402b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 0x7f2a140ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a140dfb00 0x7f2a140e4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1402bcd0 con 0x7f2a14035280 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14051b20 con 0x7f2a140dfb00 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14051e00 con 0x7f2a14006ce0 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 0x7f2a140ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 0x7f2a140ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42762/0 (socket says 172.21.15.3:42762) 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/587972000 learned_addr learned my addr 172.21.15.3:0/587972000 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1affd700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a14006ce0 0x7f2a1402b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1b7fe700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a140dfb00 0x7f2a140e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a14006ce0 msgr2=0x7f2a1402b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a14006ce0 0x7f2a1402b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a140dfb00 msgr2=0x7f2a140e4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a140dfb00 0x7f2a140e4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 -- 172.21.15.3:0/587972000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10009420 con 0x7f2a14035280 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1a7fc700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 0x7f2a140ce770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a100093f0 tx=0x7f2a10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1001ad80 con 0x7f2a14035280 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10010470 con 0x7f2a14035280 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a140520e0 con 0x7f2a14035280 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10010830 con 0x7f2a14035280 2023-10-08T16:06:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.963+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a140cecb0 con 0x7f2a14035280 2023-10-08T16:06:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.967+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a140053f0 con 0x7f2a14035280 2023-10-08T16:06:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.967+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a100183e0 con 0x7f2a14035280 2023-10-08T16:06:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.967+0000 7f2a02ffd700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a08060550 0x7f2a08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.967+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a10014070 con 0x7f2a14035280 2023-10-08T16:06:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.967+0000 7f2a1affd700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a08060550 0x7f2a08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.967+0000 7f2a1affd700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a08060550 0x7f2a08062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0058d0 tx=0x7f2a0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:55.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:55.975+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a1004edd0 con 0x7f2a14035280 2023-10-08T16:06:56.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.175+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a140053f0 con 0x7f2a14035280 2023-10-08T16:06:56.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.175+0000 7f2a02ffd700 1 -- 172.21.15.3:0/587972000 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f2a100523f0 con 0x7f2a14035280 2023-10-08T16:06:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:06:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:06:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a08060550 msgr2=0x7f2a08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a08060550 0x7f2a08062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0058d0 tx=0x7f2a0c009040 comp rx=0 tx=0).stop 2023-10-08T16:06:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 msgr2=0x7f2a140ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 0x7f2a140ce770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a100093f0 tx=0x7f2a10019000 comp rx=0 tx=0).stop 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 shutdown_connections 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a08060550 0x7f2a08062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a140dfb00 0x7f2a140e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a14035280 0x7f2a140ce770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 --2- 172.21.15.3:0/587972000 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a14006ce0 0x7f2a1402b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 >> 172.21.15.3:0/587972000 conn(0x7f2a14054d40 msgr2=0x7f2a1404d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 shutdown_connections 2023-10-08T16:06:56.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.179+0000 7f2a1bfff700 1 -- 172.21.15.3:0/587972000 wait complete. 2023-10-08T16:06:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:06:56.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:06:39.636023+0000', 'modified': '2023-10-08T16:06:42.298675+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6837/820109692', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6836', 'nonce': 820109692}, {'type': 'v1', 'addr': '172.21.15.3:6837', 'nonce': 820109692}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:06:56.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:06:56.596 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:06:56.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.711+0000 7f7299750700 1 Processor -- start 2023-10-08T16:06:56.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.711+0000 7f7299750700 1 -- start start 2023-10-08T16:06:56.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f728c0554c0 0x7f728c055920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c034000 con 0x7f728c0e0470 2023-10-08T16:06:56.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c055e60 con 0x7f728c0554c0 2023-10-08T16:06:56.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c054e90 con 0x7f728c0e00a0 2023-10-08T16:06:56.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7293fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7298f4f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f728c0554c0 0x7f728c055920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f72937fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f728c0e0470 0x7f728c057870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:50744/0 (socket says 172.21.15.3:50744) 2023-10-08T16:06:56.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7293fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:40184/0 (socket says 172.21.15.3:40184) 2023-10-08T16:06:56.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f72937fe700 1 -- 172.21.15.3:0/2801464774 learned_addr learned my addr 172.21.15.3:0/2801464774 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:56.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7292ffd700 1 -- 172.21.15.3:0/2801464774 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309242302 0 0) 0x7f728c034000 con 0x7f728c0e0470 2023-10-08T16:06:56.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7298f4f700 1 -- 172.21.15.3:0/2801464774 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 msgr2=0x7f728c033ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7298f4f700 1 --2- 172.21.15.3:0/2801464774 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7298f4f700 1 -- 172.21.15.3:0/2801464774 >> v1:172.21.15.27:6789/0 conn(0x7f728c0e0470 legacy=0x7f728c057870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7298f4f700 1 -- 172.21.15.3:0/2801464774 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c055170 con 0x7f728c0554c0 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7298f4f700 1 --2- 172.21.15.3:0/2801464774 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0554c0 0x7f728c055920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f729404c2e0 tx=0x7f7294063c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66c4441823d3fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7292ffd700 1 -- 172.21.15.3:0/2801464774 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729404b600 con 0x7f728c0554c0 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7292ffd700 1 -- 172.21.15.3:0/2801464774 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729404be40 con 0x7f728c0554c0 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7292ffd700 1 -- 172.21.15.3:0/2801464774 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294063f80 con 0x7f728c0554c0 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- 172.21.15.3:0/2801464774 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0554c0 msgr2=0x7f728c055920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 --2- 172.21.15.3:0/2801464774 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0554c0 0x7f728c055920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f729404c2e0 tx=0x7f7294063c90 comp rx=0 tx=0).stop 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- 172.21.15.3:0/2801464774 shutdown_connections 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 --2- 172.21.15.3:0/2801464774 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0554c0 0x7f728c055920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 --2- 172.21.15.3:0/2801464774 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- 172.21.15.3:0/2801464774 >> 172.21.15.3:0/2801464774 conn(0x7f728c00a630 msgr2=0x7f728c056f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- 172.21.15.3:0/2801464774 shutdown_connections 2023-10-08T16:06:56.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.715+0000 7f7299750700 1 -- 172.21.15.3:0/2801464774 wait complete. 2023-10-08T16:06:56.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 Processor -- start 2023-10-08T16:06:56.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 -- start start 2023-10-08T16:06:56.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f728c0554c0 0x7f728c007c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 0x7f728c0dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0e1380 con 0x7f728c0e0470 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c034bb0 con 0x7f728c0554c0 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c034310 con 0x7f728c0e00a0 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 0x7f728c0dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 0x7f728c0dc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42782/0 (socket says 172.21.15.3:42782) 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 -- 172.21.15.3:0/2920531440 learned_addr learned my addr 172.21.15.3:0/2920531440 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7293fff700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f728c0554c0 0x7f728c007c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f72937fe700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 -- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 msgr2=0x7f728c033ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 -- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f728c0554c0 msgr2=0x7f728c007c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f728c0554c0 0x7f728c007c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 -- 172.21.15.3:0/2920531440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729406c040 con 0x7f728c0e0470 2023-10-08T16:06:56.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7298f4f700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 0x7f728c0dc4d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f729402b170 tx=0x7f729408f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f727ffff700 1 -- 172.21.15.3:0/2920531440 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294096070 con 0x7f728c0e0470 2023-10-08T16:06:56.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f727ffff700 1 -- 172.21.15.3:0/2920531440 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940009a0 con 0x7f728c0e0470 2023-10-08T16:06:56.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c0345f0 con 0x7f728c0e0470 2023-10-08T16:06:56.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f727ffff700 1 -- 172.21.15.3:0/2920531440 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729406dce0 con 0x7f728c0e0470 2023-10-08T16:06:56.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.719+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c0e1590 con 0x7f728c0e0470 2023-10-08T16:06:56.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.723+0000 7f727ffff700 1 -- 172.21.15.3:0/2920531440 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7294062ba0 con 0x7f728c0e0470 2023-10-08T16:06:56.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.723+0000 7f727ffff700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7278060550 0x7f7278062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.723+0000 7f7293fff700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7278060550 0x7f7278062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.723+0000 7f727ffff700 1 -- 172.21.15.3:0/2920531440 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72940f3540 con 0x7f728c0e0470 2023-10-08T16:06:56.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.723+0000 7f7293fff700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7278060550 0x7f7278062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7288009d00 tx=0x7f7288009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 Processor -- start 2023-10-08T16:06:56.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- start start 2023-10-08T16:06:56.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cdf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cdf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c0cf30 con 0x1a61710 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c08ed0 con 0x1a61ae0 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bcf0b0 con 0x1aac790 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cdf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cdf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42788/0 (socket says 172.21.15.3:42788) 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 -- 172.21.15.3:0/408818817 learned_addr learned my addr 172.21.15.3:0/408818817 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f7298f4f700 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cdf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f7293fff700 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 -- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 msgr2=0x1cdf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cdf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 -- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 msgr2=0x1cdef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 -- 172.21.15.3:0/408818817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1aad9e0 con 0x1a61710 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f72937fe700 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cdf440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f728c0e0840 tx=0x7f7280009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf870a681772997 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f727d7fa700 1 -- 172.21.15.3:0/408818817 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280005ab0 con 0x1a61710 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f727d7fa700 1 -- 172.21.15.3:0/408818817 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7280005c10 con 0x1a61710 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f727d7fa700 1 -- 172.21.15.3:0/408818817 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800070d0 con 0x1a61710 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- 172.21.15.3:0/408818817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 msgr2=0x1cdf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cdf440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f728c0e0840 tx=0x7f7280009040 comp rx=0 tx=0).stop 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- 172.21.15.3:0/408818817 shutdown_connections 2023-10-08T16:06:56.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cdf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cdf440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 --2- 172.21.15.3:0/408818817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- 172.21.15.3:0/408818817 >> 172.21.15.3:0/408818817 conn(0x1a61eb0 msgr2=0x1c9b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- 172.21.15.3:0/408818817 shutdown_connections 2023-10-08T16:06:56.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.727+0000 7f729cc5b740 1 -- 172.21.15.3:0/408818817 wait complete. 2023-10-08T16:06:56.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 -- start start 2023-10-08T16:06:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 Processor -- start 2023-10-08T16:06:56.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1a61710 0x1ce3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1ce3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 0x1cc4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bced50 con 0x1aac790 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba7970 con 0x1a61ae0 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c0f290 con 0x1a61710 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f729cc5b740 10 client.0 _ll_register_callbacks cb 0x1c526a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f7298f4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 0x1cc4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f7298f4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 0x1cc4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42790/0 (socket says 172.21.15.3:42790) 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.731+0000 7f7298f4f700 1 -- 172.21.15.3:0/1298363246 learned_addr learned my addr 172.21.15.3:0/1298363246 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7293fff700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1a61710 0x1ce3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72937fe700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1ce3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7298f4f700 1 -- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1a61710 msgr2=0x1ce3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7298f4f700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1a61710 0x1ce3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7298f4f700 1 -- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 msgr2=0x1ce3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7298f4f700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1ce3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7298f4f700 1 -- 172.21.15.3:0/1298363246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728000f040 con 0x1aac790 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7298f4f700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 0x1cc4cb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7294070080 tx=0x7f729406f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e044039fa18f144 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 1 -- 172.21.15.3:0/1298363246 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72940db070 con 0x1aac790 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 1 -- 172.21.15.3:0/1298363246 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f729406de40 con 0x1aac790 2023-10-08T16:06:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ba7cc0 con 0x1aac790 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 1 -- 172.21.15.3:0/1298363246 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72940c7f30 con 0x1aac790 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 10 client.4686 fetch_fsmap learned FSMap version 6 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1bd7370 con 0x1aac790 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 1 -- 172.21.15.3:0/1298363246 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ba7cc0 con 0x1aac790 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 1 -- 172.21.15.3:0/1298363246 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f72940c7a90 con 0x1aac790 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 10 client.4686 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 20 client.4686 populate_metadata read hostname 'smithi003' 2023-10-08T16:06:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1cc6400 0x1cee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 4 client.4686 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 --> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bab3e0 con 0x1cc6400 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7293fff700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1cc6400 0x1cee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f7293fff700 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1cc6400 0x1cee6b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed6b30187ad9c1e server_cookie=1bc15947f69404ef in_seq=0 out_seq=0 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.735+0000 7f72727fc700 10 client.4686 ms_handle_connect on v2:172.21.15.3:6836/820109692 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f72727fc700 1 -- 172.21.15.3:0/1298363246 <== mds.0 v2:172.21.15.3:6836/820109692 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1bab3e0 con 0x1cc6400 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f72727fc700 10 client.4686 handle_command_reply: tid=0 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 client.4686 shutdown 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 msgr2=0x1cc4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 0x1cc4cb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7294070080 tx=0x7f729406f040 comp rx=0 tx=0).stop 2023-10-08T16:06:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 shutdown_connections 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1cc6400 0x1cee6b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1aac790 0x1cc4cb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f72727fc700 0 client.4686 ms_handle_reset on v2:172.21.15.3:6836/820109692 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1ce3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 --2- 172.21.15.3:0/1298363246 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1a61710 0x1ce3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 >> 172.21.15.3:0/1298363246 conn(0x1a61eb0 msgr2=0x1c93f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 shutdown_connections 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 1 -- 172.21.15.3:0/1298363246 wait complete. 2023-10-08T16:06:56.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.739+0000 7f729cc5b740 20 client.4686 trim_cache size 0 max 16384 2023-10-08T16:06:56.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 Processor -- start 2023-10-08T16:06:56.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- start start 2023-10-08T16:06:56.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cde890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cc2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bde550 con 0x1a61710 2023-10-08T16:06:56.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bb7c90 con 0x1a61ae0 2023-10-08T16:06:56.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c06890 con 0x1aac790 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cde890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cde890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42792/0 (socket says 172.21.15.3:42792) 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 -- 172.21.15.3:0/4201422509 learned_addr learned my addr 172.21.15.3:0/4201422509 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7298f4f700 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cc2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f72937fe700 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 -- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 msgr2=0x1cc2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cc2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 -- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 msgr2=0x1cdedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 -- 172.21.15.3:0/4201422509 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bbdd80 con 0x1a61710 2023-10-08T16:06:56.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f7293fff700 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cde890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7288009fd0 tx=0x7f7288018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e829dda308883a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f727dffb700 1 -- 172.21.15.3:0/4201422509 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288006420 con 0x1a61710 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f727dffb700 1 -- 172.21.15.3:0/4201422509 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288006580 con 0x1a61710 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f727dffb700 1 -- 172.21.15.3:0/4201422509 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288006920 con 0x1a61710 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- 172.21.15.3:0/4201422509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 msgr2=0x1cde890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cde890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7288009fd0 tx=0x7f7288018000 comp rx=0 tx=0).stop 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- 172.21.15.3:0/4201422509 shutdown_connections 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1cc2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61ae0 0x1cdedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 --2- 172.21.15.3:0/4201422509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61710 0x1cde890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- 172.21.15.3:0/4201422509 >> 172.21.15.3:0/4201422509 conn(0x1a61eb0 msgr2=0x1cc4570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- 172.21.15.3:0/4201422509 shutdown_connections 2023-10-08T16:06:56.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.759+0000 7f729cc5b740 1 -- 172.21.15.3:0/4201422509 wait complete. 2023-10-08T16:06:56.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 -- start start 2023-10-08T16:06:56.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 Processor -- start 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61710 0x1c94da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 0x1c984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1c98a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c0c9d0 con 0x1a61ae0 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c04b50 con 0x1a61710 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c0def0 con 0x1aac790 2023-10-08T16:06:56.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 0x1c984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f729cc5b740 10 client.0 _ll_register_callbacks cb 0x1a2d9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 0x1c984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42798/0 (socket says 172.21.15.3:42798) 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 -- 172.21.15.3:0/646763316 learned_addr learned my addr 172.21.15.3:0/646763316 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f7293fff700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61710 0x1c94da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f7298f4f700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1c98a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 -- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 msgr2=0x1c98a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1c98a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 -- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61710 msgr2=0x1c94da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61710 0x1c94da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 -- 172.21.15.3:0/646763316 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7288005a00 con 0x1a61ae0 2023-10-08T16:06:56.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f7298f4f700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1c98a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:56.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72937fe700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 0x1c984c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72800011e0 tx=0x7f7280017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcd793f6e7358af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.763+0000 7f72727fc700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 1 -- 172.21.15.3:0/646763316 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800077e0 con 0x1a61ae0 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 1 -- 172.21.15.3:0/646763316 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7280014480 con 0x1a61ae0 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7280005c10 con 0x1a61ae0 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 1 -- 172.21.15.3:0/646763316 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7280014850 con 0x1a61ae0 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 10 client.4692 fetch_fsmap learned FSMap version 6 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1bb2130 con 0x1a61ae0 2023-10-08T16:06:56.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 1 -- 172.21.15.3:0/646763316 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7280005c10 con 0x1a61ae0 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 1 -- 172.21.15.3:0/646763316 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f72800149b0 con 0x1a61ae0 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 10 client.4692 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 10 client.4692 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 20 client.4692 populate_metadata read hostname 'smithi003' 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1c98f40 0x1d38af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 4 client.4692 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 --> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1bdd410 con 0x1c98f40 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f7293fff700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1c98f40 0x1d38af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 10 client.4692 ms_handle_connect on v2:172.21.15.3:6836/820109692 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f7293fff700 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1c98f40 0x1d38af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bda6edac3de2c917 server_cookie=86adbb4f5513e786 in_seq=0 out_seq=0 2023-10-08T16:06:56.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 1 -- 172.21.15.3:0/646763316 <== mds.0 v2:172.21.15.3:6836/820109692 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1bdd410 con 0x1c98f40 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 10 client.4692 handle_command_reply: tid=0 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 client.4692 shutdown 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 msgr2=0x1c984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 0x1c984c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72800011e0 tx=0x7f7280017000 comp rx=0 tx=0).stop 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 shutdown_connections 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:6836/820109692,v1:172.21.15.3:6837/820109692] conn(0x1c98f40 0x1d38af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f72727fc700 0 client.4692 ms_handle_reset on v2:172.21.15.3:6836/820109692 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1aac790 0x1c98a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1a61ae0 0x1c984c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 --2- 172.21.15.3:0/646763316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1a61710 0x1c94da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 >> 172.21.15.3:0/646763316 conn(0x1a61eb0 msgr2=0x1cc2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 shutdown_connections 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 1 -- 172.21.15.3:0/646763316 wait complete. 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.767+0000 7f729cc5b740 20 client.4692 trim_cache size 0 max 16384 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3007c8b5-937d-4f26-8e83-7370fb7a9cb4", 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4278, 2023-10-08T16:06:56.775 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 16.483572625000001, 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 6, 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 20, 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 23.237696285999998 2023-10-08T16:06:56.776 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:06:56.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7278060550 msgr2=0x7f7278062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7278060550 0x7f7278062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7288009d00 tx=0x7f7288009120 comp rx=0 tx=0).stop 2023-10-08T16:06:56.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 msgr2=0x7f728c0dc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 0x7f728c0dc4d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f729402b170 tx=0x7f729408f000 comp rx=0 tx=0).stop 2023-10-08T16:06:56.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 shutdown_connections 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7278060550 0x7f7278062a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f728c0e0470 0x7f728c0dc4d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f728c0e00a0 0x7f728c033ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 --2- 172.21.15.3:0/2920531440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f728c0554c0 0x7f728c007c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 >> 172.21.15.3:0/2920531440 conn(0x7f728c00a630 msgr2=0x7f728c052f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 shutdown_connections 2023-10-08T16:06:56.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.771+0000 7f7299750700 1 -- 172.21.15.3:0/2920531440 wait complete. 2023-10-08T16:06:56.788 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-08T16:06:56.809 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-08T16:06:56.810 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T16:06:56.810 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-08T16:06:56.810 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-08T16:06:56.810 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-08T16:06:56.810 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-08T16:06:56.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:56.810 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:06:56.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:56.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2023-10-08T16:06:56.839 INFO:teuthology.orchestra.run.smithi003.stderr:Cannot find device "ceph-brx" 2023-10-08T16:06:56.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:06:56.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:56.841 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-08T16:06:56.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:56.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-10-08T16:06:56.866 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-10-08T16:06:56.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:06:56.868 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-08T16:06:56.868 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:06:56.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 Processor -- start 2023-10-08T16:06:56.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 -- start start 2023-10-08T16:06:56.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ed0158dd0 0x7f2ed01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2ed006c700 0x7f2ed006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed0159d80 con 0x7f2ed006d9d0 2023-10-08T16:06:56.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed006d070 con 0x7f2ed006c700 2023-10-08T16:06:56.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ed50a9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed006b8b0 con 0x7f2ed0158dd0 2023-10-08T16:06:56.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ece59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2ed006d9d0 0x7f2ed006b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51650/0 (socket says 172.21.15.3:51650) 2023-10-08T16:06:56.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ece59c700 1 -- 172.21.15.3:0/4266649358 learned_addr learned my addr 172.21.15.3:0/4266649358 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:56.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecf59e700 1 --2- 172.21.15.3:0/4266649358 >> v2:172.21.15.3:3300/0 conn(0x7f2ed006c700 0x7f2ed006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2eced9d700 1 --2- 172.21.15.3:0/4266649358 >> v2:172.21.15.27:3300/0 conn(0x7f2ed0158dd0 0x7f2ed01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecdd9b700 1 -- 172.21.15.3:0/4266649358 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514852422 0 0) 0x7f2ed0159d80 con 0x7f2ed006d9d0 2023-10-08T16:06:56.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecdd9b700 1 -- 172.21.15.3:0/4266649358 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc003570 con 0x7f2ed006d9d0 2023-10-08T16:06:56.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2eced9d700 1 -- 172.21.15.3:0/4266649358 >> v2:172.21.15.3:3300/0 conn(0x7f2ed006c700 msgr2=0x7f2ed006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:56.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2eced9d700 1 --2- 172.21.15.3:0/4266649358 >> v2:172.21.15.3:3300/0 conn(0x7f2ed006c700 0x7f2ed006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecdd9b700 1 -- 172.21.15.3:0/4266649358 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667148437 0 0) 0x7f2ebc003570 con 0x7f2ed006d9d0 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2eced9d700 1 -- 172.21.15.3:0/4266649358 >> v1:172.21.15.3:6789/0 conn(0x7f2ed006d9d0 legacy=0x7f2ed006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2eced9d700 1 -- 172.21.15.3:0/4266649358 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed006bb90 con 0x7f2ed0158dd0 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecf59e700 1 --2- 172.21.15.3:0/4266649358 >> v2:172.21.15.3:3300/0 conn(0x7f2ed006c700 0x7f2ed006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2eced9d700 1 --2- 172.21.15.3:0/4266649358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed0158dd0 0x7f2ed01591a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0069640 tx=0x7f2eb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0d35662624e749b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecdd9b700 1 -- 172.21.15.3:0/4266649358 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80017f0 con 0x7f2ed0158dd0 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecdd9b700 1 -- 172.21.15.3:0/4266649358 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb8011420 con 0x7f2ed0158dd0 2023-10-08T16:06:56.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.983+0000 7f2ecdd9b700 1 -- 172.21.15.3:0/4266649358 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80117c0 con 0x7f2ed0158dd0 2023-10-08T16:06:56.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 -- 172.21.15.3:0/4266649358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed0158dd0 msgr2=0x7f2ed01591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/4266649358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed0158dd0 0x7f2ed01591a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0069640 tx=0x7f2eb80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 -- 172.21.15.3:0/4266649358 shutdown_connections 2023-10-08T16:06:56.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/4266649358 >> v2:172.21.15.3:3300/0 conn(0x7f2ed006c700 0x7f2ed006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/4266649358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed0158dd0 0x7f2ed01591a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 -- 172.21.15.3:0/4266649358 >> 172.21.15.3:0/4266649358 conn(0x7f2ed00d09d0 msgr2=0x7f2ed00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:56.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 -- 172.21.15.3:0/4266649358 shutdown_connections 2023-10-08T16:06:56.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 -- 172.21.15.3:0/4266649358 wait complete. 2023-10-08T16:06:56.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 Processor -- start 2023-10-08T16:06:56.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.987+0000 7f2ed50a9700 1 -- start start 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2ed006c700 0x7f2ed00b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed006d9d0 0x7f2ed00c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 0x7f2ed0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00c5700 con 0x7f2ed0158dd0 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00b21a0 con 0x7f2ed006d9d0 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00c5950 con 0x7f2ed006c700 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 0x7f2ed0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 0x7f2ed0154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42814/0 (socket says 172.21.15.3:42814) 2023-10-08T16:06:56.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 -- 172.21.15.3:0/3292442743 learned_addr learned my addr 172.21.15.3:0/3292442743 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:56.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2eced9d700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2ed006c700 0x7f2ed00b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ece59c700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed006d9d0 0x7f2ed00c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 -- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2ed006c700 msgr2=0x7f2ed00b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2ed006c700 0x7f2ed00b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 -- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed006d9d0 msgr2=0x7f2ed00c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed006d9d0 0x7f2ed00c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 -- 172.21.15.3:0/3292442743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009420 con 0x7f2ed0158dd0 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ecf59e700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 0x7f2ed0154360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000ea20 tx=0x7f2ec00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000ee60 con 0x7f2ed0158dd0 2023-10-08T16:06:56.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000c850 con 0x7f2ed0158dd0 2023-10-08T16:06:56.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb8009420 con 0x7f2ed0158dd0 2023-10-08T16:06:56.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000cc10 con 0x7f2ed0158dd0 2023-10-08T16:06:56.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed00c5f10 con 0x7f2ed0158dd0 2023-10-08T16:06:56.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.991+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed004be40 con 0x7f2ed0158dd0 2023-10-08T16:06:56.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.995+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2ec0013470 con 0x7f2ed0158dd0 2023-10-08T16:06:56.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.995+0000 7f2ec6ffd700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2eb0060550 0x7f2eb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:56.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.995+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ec007cb60 con 0x7f2ed0158dd0 2023-10-08T16:06:56.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.995+0000 7f2eced9d700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2eb0060550 0x7f2eb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:56.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:56.995+0000 7f2eced9d700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2eb0060550 0x7f2eb0062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0069640 tx=0x7f2eb8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.003+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ec004d0b0 con 0x7f2ed0158dd0 2023-10-08T16:06:57.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.207+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ed0159a10 con 0x7f2ed0158dd0 2023-10-08T16:06:57.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.207+0000 7f2ec6ffd700 1 -- 172.21.15.3:0/3292442743 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ec00506d0 con 0x7f2ed0158dd0 2023-10-08T16:06:57.210 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.207+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2eb0060550 msgr2=0x7f2eb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.207+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2eb0060550 0x7f2eb0062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0069640 tx=0x7f2eb8016000 comp rx=0 tx=0).stop 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.207+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 msgr2=0x7f2ed0154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.207+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 0x7f2ed0154360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000ea20 tx=0x7f2ec00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 shutdown_connections 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2eb0060550 0x7f2eb0062a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ed0158dd0 0x7f2ed0154360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ed006d9d0 0x7f2ed00c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 --2- 172.21.15.3:0/3292442743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2ed006c700 0x7f2ed00b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 >> 172.21.15.3:0/3292442743 conn(0x7f2ed00d09d0 msgr2=0x7f2ed0155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:57.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 shutdown_connections 2023-10-08T16:06:57.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:57.211+0000 7f2ed50a9700 1 -- 172.21.15.3:0/3292442743 wait complete. 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:06:57.225 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:57.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.226 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-10-08T16:06:57.235 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:57.235 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:57.236 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42499sec preferred_lft 42499sec 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:23:c8:a3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:06:57.237 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:57.238 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T16:06:57.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.238 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:57.239 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:57.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2023-10-08T16:06:57.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2023-10-08T16:06:57.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2023-10-08T16:06:57.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T16:06:57.239 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:57.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.282 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:06:57.339 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-10-08T16:06:57.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.341 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-10-08T16:06:57.366 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-10-08T16:06:57.366 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:06:57.366 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:06:57.366 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:06:57.366 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:06:57.367 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:06:57.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.367 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:57.367 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:57.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:06:57.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:06:57.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:06:57.367 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:57.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.407 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:06:57.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.412 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2023-10-08T16:06:57.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.417 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:57.417 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:57.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:06:57.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T16:06:57.417 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:57.492 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T16:06:57.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T16:06:57.493 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:57.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:57.562 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:57.562 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:57.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-10-08T16:06:57.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T16:06:57.563 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:57.588 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T16:06:57.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:57.588 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:57.595 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:57.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:57.595 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:57.643 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:06:57.657 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:06:57.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:06:57.668 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:06:57.668 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:06:57.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:57.669 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:06:57.674 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:06:57.674 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T16:06:57.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:06:57.691 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:06:57.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:06:57.747 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:06:57.747 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:57.748 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:06:57.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-10-08T16:06:57.751+0000 7ff20c171380 -1 init, newargv = 0x55f2fa3fdb80 newargc=15 2023-10-08T16:06:57.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[40923]: starting ceph client 2023-10-08T16:06:57.764 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[40923]: starting fuse 2023-10-08T16:06:58.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:06:58.869 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:06:58.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:06:58.928 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:06:58.929 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:06:58.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:58.930 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:06:58.937 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:06:58.937 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:06:58.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:06:58.937 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-10-08T16:06:58.937 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-10-08T16:06:58.937 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:06:58.937 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-10-08T16:06:58.937 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-10-08T16:06:58.938 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-10-08T16:06:58.939 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:06:59.022 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.40923.asok 2023-10-08T16:06:59.206 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40923.asok 2023-10-08T16:06:59.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:59.207 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40923.asok status 2023-10-08T16:06:59.344 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:06:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-10-08T16:06:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:06:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:06:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "40923", 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4707, 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-10-08T16:06:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4707 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 763287432 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:06:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 763287432 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.4707 192.168.0.1:0/763287432", 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/763287432", 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 6, 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 20, 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-10-08T16:06:59.347 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:06:59.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:06:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 Processor -- start 2023-10-08T16:06:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 -- start start 2023-10-08T16:06:59.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0f28155fd0 0x7f0f280ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f280aed70 0x7f0f280c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f280c7eb0 con 0x7f0f280adc80 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280c72a0 con 0x7f0f28155fd0 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2cd1d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280c7580 con 0x7f0f280aed70 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f25d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0f28155fd0 0x7f0f280ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0f280adc80 0x7f0f280ae050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51656/0 (socket says 172.21.15.3:51656) 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2659c700 1 -- 172.21.15.3:0/3645426115 learned_addr learned my addr 172.21.15.3:0/3645426115 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f26d9d700 1 --2- 172.21.15.3:0/3645426115 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f280aed70 0x7f0f280c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2559a700 1 -- 172.21.15.3:0/3645426115 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708058646 0 0) 0x7f0f280c7eb0 con 0x7f0f280adc80 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2559a700 1 -- 172.21.15.3:0/3645426115 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f14003570 con 0x7f0f280adc80 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f25d9b700 1 -- 172.21.15.3:0/3645426115 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f280aed70 msgr2=0x7f0f280c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f25d9b700 1 --2- 172.21.15.3:0/3645426115 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f280aed70 0x7f0f280c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f25d9b700 1 -- 172.21.15.3:0/3645426115 >> v1:172.21.15.3:6789/0 conn(0x7f0f280adc80 legacy=0x7f0f280ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f25d9b700 1 -- 172.21.15.3:0/3645426115 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280c7860 con 0x7f0f28155fd0 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f25d9b700 1 --2- 172.21.15.3:0/3645426115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f28155fd0 0x7f0f280ae830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009e60 tx=0x7f0f20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4d681fd4a93b6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2559a700 1 -- 172.21.15.3:0/3645426115 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000e070 con 0x7f0f28155fd0 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2559a700 1 -- 172.21.15.3:0/3645426115 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2000bab0 con 0x7f0f28155fd0 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.455+0000 7f0f2559a700 1 -- 172.21.15.3:0/3645426115 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000be70 con 0x7f0f28155fd0 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/3645426115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f28155fd0 msgr2=0x7f0f280ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/3645426115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f28155fd0 0x7f0f280ae830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009e60 tx=0x7f0f20009780 comp rx=0 tx=0).stop 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/3645426115 shutdown_connections 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/3645426115 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f280aed70 0x7f0f280c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/3645426115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f28155fd0 0x7f0f280ae830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/3645426115 >> 172.21.15.3:0/3645426115 conn(0x7f0f280ccbd0 msgr2=0x7f0f280ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:59.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/3645426115 shutdown_connections 2023-10-08T16:06:59.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/3645426115 wait complete. 2023-10-08T16:06:59.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 Processor -- start 2023-10-08T16:06:59.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.459+0000 7f0f2cd1d700 1 -- start start 2023-10-08T16:06:59.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f280adc80 0x7f0f281529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 0x7f0f28166e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f28155fd0 0x7f0f280c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28156ba0 con 0x7f0f280aed70 2023-10-08T16:06:59.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28167370 con 0x7f0f280adc80 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28166180 con 0x7f0f28155fd0 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 0x7f0f28166e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 0x7f0f28166e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42818/0 (socket says 172.21.15.3:42818) 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 -- 172.21.15.3:0/1924032149 learned_addr learned my addr 172.21.15.3:0/1924032149 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f26d9d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f28155fd0 0x7f0f280c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2659c700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f280adc80 0x7f0f281529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 -- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f28155fd0 msgr2=0x7f0f280c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f28155fd0 0x7f0f280c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 -- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f280adc80 msgr2=0x7f0f281529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f280adc80 0x7f0f281529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 -- 172.21.15.3:0/1924032149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20009a20 con 0x7f0f280aed70 2023-10-08T16:06:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f25d9b700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 0x7f0f28166e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f20013000 tx=0x7f0f20019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20022070 con 0x7f0f280aed70 2023-10-08T16:06:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20012a50 con 0x7f0f280aed70 2023-10-08T16:06:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f28166460 con 0x7f0f280aed70 2023-10-08T16:06:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20012df0 con 0x7f0f280aed70 2023-10-08T16:06:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f28166a20 con 0x7f0f280aed70 2023-10-08T16:06:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.463+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2804be40 con 0x7f0f280aed70 2023-10-08T16:06:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.467+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0f20003040 con 0x7f0f280aed70 2023-10-08T16:06:59.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.467+0000 7f0f1e7fc700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f08060550 0x7f0f08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.467+0000 7f0f2659c700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f08060550 0x7f0f08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.467+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f2007fa90 con 0x7f0f280aed70 2023-10-08T16:06:59.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.467+0000 7f0f2659c700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f08060550 0x7f0f08062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007fd0 tx=0x7f0f10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.475+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0f2004ffe0 con 0x7f0f280aed70 2023-10-08T16:06:59.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f280c7b40 con 0x7f0f280aed70 2023-10-08T16:06:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f1e7fc700 1 -- 172.21.15.3:0/1924032149 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f20053600 con 0x7f0f280aed70 2023-10-08T16:06:59.678 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:06:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f08060550 msgr2=0x7f0f08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f08060550 0x7f0f08062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007fd0 tx=0x7f0f10009040 comp rx=0 tx=0).stop 2023-10-08T16:06:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 msgr2=0x7f0f28166e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 0x7f0f28166e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f20013000 tx=0x7f0f20019000 comp rx=0 tx=0).stop 2023-10-08T16:06:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 shutdown_connections 2023-10-08T16:06:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f08060550 0x7f0f08062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0f28155fd0 0x7f0f280c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f280aed70 0x7f0f28166e30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 --2- 172.21.15.3:0/1924032149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f280adc80 0x7f0f281529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 >> 172.21.15.3:0/1924032149 conn(0x7f0f280ccbd0 msgr2=0x7f0f28154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 shutdown_connections 2023-10-08T16:06:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:06:59.675+0000 7f0f2cd1d700 1 -- 172.21.15.3:0/1924032149 wait complete. 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:06:59.692 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T16:06:59.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.693 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-10-08T16:06:59.700 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:59.700 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:59.700 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:59.700 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.700 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42497sec preferred_lft 42497sec 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:23:c8:a3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec2d:51ff:fe60:39b2/64 scope link 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi003.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::10d3:e4ff:fe73:f282/64 scope link 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.703 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:06:59.716 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-10-08T16:06:59.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.718 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:06:59.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.769 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:59.770 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:59.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:06:59.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:06:59.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:06:59.770 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:59.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.810 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:06:59.816 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:06:59.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.817 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2023-10-08T16:06:59.821 INFO:teuthology.orchestra.run.smithi003.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T16:06:59.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.822 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:59.822 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:59.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:06:59.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T16:06:59.822 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:06:59.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T16:06:59.909 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 06:71:f0:e1:d0:2b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.910 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::471:f0ff:fee1:d02b/64 scope link 2023-10-08T16:06:59.911 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T16:06:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:59.924 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:59.924 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 06:71:f0:e1:d0:2b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::471:f0ff:fee1:d02b/64 scope link 2023-10-08T16:06:59.925 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:59.926 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T16:06:59.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T16:06:59.927 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:07:00.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:00.024 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:07:00.024 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:07:00.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.1 up 2023-10-08T16:07:00.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T16:07:00.025 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:07:00.048 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-08T16:07:00.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:00.048 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T16:07:00.055 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T16:07:00.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:00.055 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T16:07:00.101 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:07:00.117 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:00.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:00.132 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:00.132 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:00.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:00.133 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:07:00.139 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:07:00.139 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-08T16:07:00.139 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-08T16:07:00.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:07:00.152 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:00.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:00.164 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:00.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:00.165 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:07:00.213 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:07:00.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi003.stderr:2023-10-08T16:07:00.215+0000 7fd358310380 -1 init, newargv = 0x55ef73222980 newargc=15 2023-10-08T16:07:00.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi003.stderr:ceph-fuse[41066]: starting ceph client 2023-10-08T16:07:00.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi003.stderr:ceph-fuse[41066]: starting fuse 2023-10-08T16:07:01.315 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:07:01.333 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:01.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:01.348 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:01.349 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:01.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:01.349 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:07:01.398 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:07:01.399 INFO:teuthology.orchestra.run.smithi003.stdout:53 2023-10-08T16:07:01.399 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-08T16:07:01.399 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:01.399 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-10-08T16:07:01.399 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-10-08T16:07:01.399 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:01.399 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-10-08T16:07:01.399 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:07:01.400 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.2")) 2023-10-08T16:07:01.401 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:01.484 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.2.41066.asok 2023-10-08T16:07:01.667 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.41066.asok 2023-10-08T16:07:01.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:01.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.41066.asok status 2023-10-08T16:07:01.762 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "2", 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "41066", 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-10-08T16:07:01.763 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4725, 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4725 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.2:0", 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 504200053 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.2:0", 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 504200053 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.4725 192.168.0.2:0/504200053", 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.2:0/504200053", 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 6, 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 20, 2023-10-08T16:07:01.765 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:07:01.766 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-10-08T16:07:01.766 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-10-08T16:07:01.766 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:07:01.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:07:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc9bb2700 1 Processor -- start 2023-10-08T16:07:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc9bb2700 1 -- start start 2023-10-08T16:07:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc9bb2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4068ab0 0x7fafc40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc9bb2700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4068e80 con 0x7fafc4156310 2023-10-08T16:07:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc9bb2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4156930 con 0x7fafc4159e80 2023-10-08T16:07:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc9bb2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc41593a0 con 0x7fafc4068ab0 2023-10-08T16:07:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fafc4156310 0x7fafc406cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49386/0 (socket says 172.21.15.3:49386) 2023-10-08T16:07:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc3fff700 1 -- 172.21.15.3:0/4260383155 learned_addr learned my addr 172.21.15.3:0/4260383155 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc37fe700 1 --2- 172.21.15.3:0/4260383155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4068ab0 0x7fafc40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318444804 0 0) 0x7fafc4068e80 con 0x7fafc4156310 2023-10-08T16:07:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.879+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac003570 con 0x7fafc4156310 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170194378 0 0) 0x7fafc4156930 con 0x7fafc4159e80 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc4068e80 con 0x7fafc4159e80 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098882194 0 0) 0x7fafac003570 con 0x7fafc4156310 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc37fe700 1 -- 172.21.15.3:0/4260383155 >> v1:172.21.15.27:6789/0 conn(0x7fafc4159e80 legacy=0x7fafc4155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc37fe700 1 -- 172.21.15.3:0/4260383155 >> v1:172.21.15.3:6789/0 conn(0x7fafc4156310 legacy=0x7fafc406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc37fe700 1 -- 172.21.15.3:0/4260383155 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4159680 con 0x7fafc4068ab0 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc37fe700 1 --2- 172.21.15.3:0/4260383155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4068ab0 0x7fafc40cb170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafb400aac0 tx=0x7fafb400a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b528948421bd412b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0017f0 con 0x7fafc4068ab0 2023-10-08T16:07:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400c660 con 0x7fafc4068ab0 2023-10-08T16:07:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc27fc700 1 -- 172.21.15.3:0/4260383155 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400c9e0 con 0x7fafc4068ab0 2023-10-08T16:07:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 -- 172.21.15.3:0/4260383155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4068ab0 msgr2=0x7fafc40cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/4260383155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4068ab0 0x7fafc40cb170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafb400aac0 tx=0x7fafb400a330 comp rx=0 tx=0).stop 2023-10-08T16:07:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 -- 172.21.15.3:0/4260383155 shutdown_connections 2023-10-08T16:07:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/4260383155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4068ab0 0x7fafc40cb170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 -- 172.21.15.3:0/4260383155 >> 172.21.15.3:0/4260383155 conn(0x7fafc40c8de0 msgr2=0x7fafc40c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 -- 172.21.15.3:0/4260383155 shutdown_connections 2023-10-08T16:07:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.883+0000 7fafc9bb2700 1 -- 172.21.15.3:0/4260383155 wait complete. 2023-10-08T16:07:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 Processor -- start 2023-10-08T16:07:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 -- start start 2023-10-08T16:07:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc4068ab0 0x7fafc41627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4156310 0x7fafc40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 0x7fafc40c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40c56d0 con 0x7fafc4159e80 2023-10-08T16:07:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40c4da0 con 0x7fafc4068ab0 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40c5080 con 0x7fafc4156310 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 0x7fafc40c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 0x7fafc40c2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59500/0 (socket says 172.21.15.3:59500) 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 -- 172.21.15.3:0/671094460 learned_addr learned my addr 172.21.15.3:0/671094460 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc37fe700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc4068ab0 0x7fafc41627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc2ffd700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4156310 0x7fafc40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 -- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4156310 msgr2=0x7fafc40c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4156310 0x7fafc40c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 -- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc4068ab0 msgr2=0x7fafc41627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc4068ab0 0x7fafc41627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 -- 172.21.15.3:0/671094460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb400a5d0 con 0x7fafc4159e80 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc37fe700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc4068ab0 0x7fafc41627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc3fff700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 0x7fafc40c2290 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00cbf0 tx=0x7fafbc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc004e20 con 0x7fafc4159e80 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00a750 con 0x7fafc4159e80 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc40c5360 con 0x7fafc4159e80 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00ab10 con 0x7fafc4159e80 2023-10-08T16:07:01.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.887+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc40c3490 con 0x7fafc4159e80 2023-10-08T16:07:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.891+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc40c5880 con 0x7fafc4159e80 2023-10-08T16:07:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.891+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fafbc007150 con 0x7fafc4159e80 2023-10-08T16:07:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.891+0000 7fafab7fe700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fafb0060550 0x7fafb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.891+0000 7fafc37fe700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fafb0060550 0x7fafb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.891+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafbc07c030 con 0x7fafc4159e80 2023-10-08T16:07:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.891+0000 7fafc37fe700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fafb0060550 0x7fafb0062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafb400b010 tx=0x7fafb4019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:01.899+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fafc40c5880 con 0x7fafc4159e80 2023-10-08T16:07:02.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.095+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fafc404be40 con 0x7fafc4159e80 2023-10-08T16:07:02.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.095+0000 7fafab7fe700 1 -- 172.21.15.3:0/671094460 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fafbc018020 con 0x7fafc4159e80 2023-10-08T16:07:02.099 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:07:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fafb0060550 msgr2=0x7fafb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fafb0060550 0x7fafb0062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafb400b010 tx=0x7fafb4019000 comp rx=0 tx=0).stop 2023-10-08T16:07:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 msgr2=0x7fafc40c2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 0x7fafc40c2290 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00cbf0 tx=0x7fafbc007c70 comp rx=0 tx=0).stop 2023-10-08T16:07:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 shutdown_connections 2023-10-08T16:07:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fafb0060550 0x7fafb0062a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafc4159e80 0x7fafc40c2290 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fafc4156310 0x7fafc40c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 --2- 172.21.15.3:0/671094460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc4068ab0 0x7fafc41627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 >> 172.21.15.3:0/671094460 conn(0x7fafc40c8de0 msgr2=0x7fafc4155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:02.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 shutdown_connections 2023-10-08T16:07:02.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:02.099+0000 7fafc9bb2700 1 -- 172.21.15.3:0/671094460 wait complete. 2023-10-08T16:07:02.112 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:07:02.112 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:07:02.113 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:02.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.113 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-10-08T16:07:02.121 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:02.121 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:02.121 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:02.122 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42537sec preferred_lft 42537sec 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:88:23:76:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:07:02.123 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:02.123 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T16:07:02.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T16:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:02.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.211 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:07:02.220 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-10-08T16:07:02.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.221 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:07:02.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.249 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:02.249 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:02.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:07:02.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:07:02.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:07:02.249 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:02.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.292 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.298 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-10-08T16:07:02.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.347 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:02.348 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:02.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:07:02.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T16:07:02.348 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:02.380 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T16:07:02.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.380 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:02.380 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:02.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T16:07:02.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T16:07:02.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T16:07:02.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T16:07:02.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T16:07:02.381 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:02.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:02.449 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:02.449 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:02.449 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-10-08T16:07:02.449 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T16:07:02.449 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:02.475 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-08T16:07:02.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:02.475 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:02.481 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:02.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:02.482 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:02.487 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:02.545 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:02.546 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:02.560 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:02.561 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:02.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:02.562 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:02.566 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:07:02.567 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-08T16:07:02.609 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:02.629 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:02.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:02.643 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:02.643 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:02.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:02.644 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:02.695 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:2023-10-08T16:07:02.689+0000 7f911acf2380 -1 init, newargv = 0x5603043add80 newargc=15 2023-10-08T16:07:02.695 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39478]: starting ceph client 2023-10-08T16:07:02.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39478]: starting fuse 2023-10-08T16:07:03.751 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:03.769 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:03.769 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:03.780 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:03.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:03.781 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:03.785 INFO:teuthology.orchestra.run.smithi027.stdout:52 2023-10-08T16:07:03.786 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> import re 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> import os 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2023-10-08T16:07:03.786 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:07:03.787 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> return f 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.1")) 2023-10-08T16:07:03.788 DEBUG:teuthology.orchestra.run.smithi027:> ' 2023-10-08T16:07:03.872 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.1.39478.asok 2023-10-08T16:07:04.055 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.39478.asok 2023-10-08T16:07:04.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:04.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.39478.asok status 2023-10-08T16:07:04.193 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-08T16:07:04.193 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2023-10-08T16:07:04.193 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:07:04.193 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:07:04.193 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "1", 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "39478", 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4741, 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2023-10-08T16:07:04.194 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 4741 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2175671224 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:07:04.195 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2175671224 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.4741 192.168.0.1:0/2175671224", 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "192.168.0.1:0/2175671224", 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 6, 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 20, 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2023-10-08T16:07:04.196 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-08T16:07:04.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:07:04.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.315+0000 7f57e1836700 1 Processor -- start 2023-10-08T16:07:04.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.315+0000 7f57e1836700 1 -- start start 2023-10-08T16:07:04.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f57dc0cb880 0x7f57dc155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f57dc159e80 0x7f57dc156140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc068e80 con 0x7f57dc068ab0 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc156680 con 0x7f57dc159e80 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc156930 con 0x7f57dc0cb880 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57daffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f57dc068ab0 0x7f57dc0cb170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49396/0 (socket says 172.21.15.3:49396) 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57daffd700 1 -- 172.21.15.3:0/2179455491 learned_addr learned my addr 172.21.15.3:0/2179455491 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57db7fe700 1 --2- 172.21.15.3:0/2179455491 >> v2:172.21.15.3:3300/0 conn(0x7f57dc159e80 0x7f57dc156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57da7fc700 1 -- 172.21.15.3:0/2179455491 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885851451 0 0) 0x7f57dc068e80 con 0x7f57dc068ab0 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57da7fc700 1 -- 172.21.15.3:0/2179455491 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c8003570 con 0x7f57dc068ab0 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57d27fc700 1 --2- 172.21.15.3:0/2179455491 >> v2:172.21.15.27:3300/0 conn(0x7f57dc0cb880 0x7f57dc155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57db7fe700 1 -- 172.21.15.3:0/2179455491 >> v2:172.21.15.27:3300/0 conn(0x7f57dc0cb880 msgr2=0x7f57dc155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:04.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57db7fe700 1 --2- 172.21.15.3:0/2179455491 >> v2:172.21.15.27:3300/0 conn(0x7f57dc0cb880 0x7f57dc155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57db7fe700 1 -- 172.21.15.3:0/2179455491 >> v1:172.21.15.3:6789/0 conn(0x7f57dc068ab0 legacy=0x7f57dc0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57db7fe700 1 -- 172.21.15.3:0/2179455491 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc1593a0 con 0x7f57dc159e80 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57d27fc700 1 --2- 172.21.15.3:0/2179455491 >> v2:172.21.15.27:3300/0 conn(0x7f57dc0cb880 0x7f57dc155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57db7fe700 1 --2- 172.21.15.3:0/2179455491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc159e80 0x7f57dc156140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57dc06ac80 tx=0x7f57d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fffc20000356ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57da7fc700 1 -- 172.21.15.3:0/2179455491 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4009e80 con 0x7f57dc159e80 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57da7fc700 1 -- 172.21.15.3:0/2179455491 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d400cc70 con 0x7f57dc159e80 2023-10-08T16:07:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57da7fc700 1 -- 172.21.15.3:0/2179455491 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4011400 con 0x7f57dc159e80 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- 172.21.15.3:0/2179455491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc159e80 msgr2=0x7f57dc156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 --2- 172.21.15.3:0/2179455491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc159e80 0x7f57dc156140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57dc06ac80 tx=0x7f57d4009780 comp rx=0 tx=0).stop 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- 172.21.15.3:0/2179455491 shutdown_connections 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 --2- 172.21.15.3:0/2179455491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc159e80 0x7f57dc156140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 --2- 172.21.15.3:0/2179455491 >> v2:172.21.15.27:3300/0 conn(0x7f57dc0cb880 0x7f57dc155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- 172.21.15.3:0/2179455491 >> 172.21.15.3:0/2179455491 conn(0x7f57dc0c8de0 msgr2=0x7f57dc0c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:04.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- 172.21.15.3:0/2179455491 shutdown_connections 2023-10-08T16:07:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.319+0000 7f57e1836700 1 -- 172.21.15.3:0/2179455491 wait complete. 2023-10-08T16:07:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.323+0000 7f57e1836700 1 Processor -- start 2023-10-08T16:07:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.323+0000 7f57e1836700 1 -- start start 2023-10-08T16:07:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 0x7f57dc162ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57dc0cb880 0x7f57dc164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57dc159e80 0x7f57dc0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c62e0 con 0x7f57dc068ab0 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc156e60 con 0x7f57dc0cb880 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc157140 con 0x7f57dc159e80 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 0x7f57dc162ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 0x7f57dc162ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59514/0 (socket says 172.21.15.3:59514) 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 -- 172.21.15.3:0/2046889958 learned_addr learned my addr 172.21.15.3:0/2046889958 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57d27fc700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57dc0cb880 0x7f57dc164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57db7fe700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57dc159e80 0x7f57dc0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 -- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57dc159e80 msgr2=0x7f57dc0c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57dc159e80 0x7f57dc0c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 -- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57dc0cb880 msgr2=0x7f57dc164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57dc0cb880 0x7f57dc164620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 -- 172.21.15.3:0/2046889958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d400d040 con 0x7f57dc068ab0 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57daffd700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 0x7f57dc162ba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c7c0 tx=0x7f57cc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc005c00 con 0x7f57dc068ab0 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc005d60 con 0x7f57dc068ab0 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc157420 con 0x7f57dc068ab0 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc007340 con 0x7f57dc068ab0 2023-10-08T16:07:04.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc164b60 con 0x7f57dc068ab0 2023-10-08T16:07:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.327+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc164de0 con 0x7f57dc068ab0 2023-10-08T16:07:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.331+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f57cc0076b0 con 0x7f57dc068ab0 2023-10-08T16:07:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.331+0000 7f57d37fe700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f57bc060550 0x7f57bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.331+0000 7f57d27fc700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f57bc060550 0x7f57bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.331+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57cc07c340 con 0x7f57dc068ab0 2023-10-08T16:07:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.331+0000 7f57d27fc700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f57bc060550 0x7f57bc062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f57dc14c2e0 tx=0x7f57c4006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:04.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.335+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f57cc04c910 con 0x7f57dc068ab0 2023-10-08T16:07:04.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.531+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57dc04be40 con 0x7f57dc068ab0 2023-10-08T16:07:04.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.531+0000 7f57d37fe700 1 -- 172.21.15.3:0/2046889958 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f57cc04ff30 con 0x7f57dc068ab0 2023-10-08T16:07:04.535 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:07:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f57bc060550 msgr2=0x7f57bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f57bc060550 0x7f57bc062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f57dc14c2e0 tx=0x7f57c4006f90 comp rx=0 tx=0).stop 2023-10-08T16:07:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 msgr2=0x7f57dc162ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 0x7f57dc162ba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c7c0 tx=0x7f57cc007dd0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 shutdown_connections 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f57bc060550 0x7f57bc062a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57dc159e80 0x7f57dc0c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57dc0cb880 0x7f57dc164620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 --2- 172.21.15.3:0/2046889958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57dc068ab0 0x7f57dc162ba0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 >> 172.21.15.3:0/2046889958 conn(0x7f57dc0c8de0 msgr2=0x7f57dc1559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 shutdown_connections 2023-10-08T16:07:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:04.535+0000 7f57e1836700 1 -- 172.21.15.3:0/2046889958 wait complete. 2023-10-08T16:07:04.548 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:07:04.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:07:04.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-10-08T16:07:04.548 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T16:07:04.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:04.549 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:07:04.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:07:04.549 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:07:04.549 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T16:07:04.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.549 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-10-08T16:07:04.557 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:04.557 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:04.557 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:04.557 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.557 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42534sec preferred_lft 42534sec 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-10-08T16:07:04.558 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:88:23:76:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ce:f9:8e:0a:a5:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::e4d6:67ff:fe20:d296/64 scope link 2023-10-08T16:07:04.559 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.560 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:04.560 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ce:f9:8e:0a:a5:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:07:04.560 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ccf9:8eff:fe0a:a5cd/64 scope link 2023-10-08T16:07:04.560 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.561 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:07:04.618 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-10-08T16:07:04.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.620 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-10-08T16:07:04.629 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-10-08T16:07:04.629 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:07:04.629 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:07:04.629 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:07:04.630 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:07:04.630 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:07:04.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.630 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:04.630 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:04.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:07:04.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:07:04.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:07:04.630 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:04.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.672 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-08T16:07:04.678 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:07:04.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.678 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-10-08T16:07:04.726 INFO:teuthology.orchestra.run.smithi027.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T16:07:04.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.727 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:04.727 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:04.727 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:07:04.727 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T16:07:04.727 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:04.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T16:07:04.773 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether de:67:35:72:df:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::dc67:35ff:fe72:dfb5/64 scope link 2023-10-08T16:07:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.775 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:04.833 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether de:67:35:72:df:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:07:04.834 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:07:04.834 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.834 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::dc67:35ff:fe72:dfb5/64 scope link 2023-10-08T16:07:04.834 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:04.835 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T16:07:04.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.835 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:04.835 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:04.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T16:07:04.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T16:07:04.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T16:07:04.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T16:07:04.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T16:07:04.836 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:04.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:04.895 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:04.895 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:04.895 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.1 up 2023-10-08T16:07:04.895 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T16:07:04.895 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:04.925 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-08T16:07:04.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:04.925 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:04.929 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T16:07:04.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:04.930 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:04.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:04.997 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:04.997 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:05.007 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:05.007 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:05.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:05.008 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:05.013 INFO:teuthology.orchestra.run.smithi027.stdout:52 2023-10-08T16:07:05.013 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-08T16:07:05.013 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-08T16:07:05.015 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:05.030 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:05.030 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:05.045 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:05.045 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:05.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:05.046 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:05.098 INFO:teuthology.orchestra.run.smithi027.stdout:52 2023-10-08T16:07:05.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi027.stderr:2023-10-08T16:07:05.097+0000 7fe7f5f59380 -1 init, newargv = 0x5601a5f69e00 newargc=15 2023-10-08T16:07:05.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi027.stderr:ceph-fuse[39591]: starting ceph client 2023-10-08T16:07:05.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi027.stderr:ceph-fuse[39591]: starting fuse 2023-10-08T16:07:06.202 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:06.221 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:06.222 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:06.279 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:06.280 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:06.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.281 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:06.288 INFO:teuthology.orchestra.run.smithi027.stdout:52 2023-10-08T16:07:06.288 INFO:teuthology.orchestra.run.smithi027.stdout:53 2023-10-08T16:07:06.288 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-08T16:07:06.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:06.288 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> import re 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> import os 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2023-10-08T16:07:06.289 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> return f 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.3")) 2023-10-08T16:07:06.290 DEBUG:teuthology.orchestra.run.smithi027:> ' 2023-10-08T16:07:06.374 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.3.39591.asok 2023-10-08T16:07:06.558 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.39591.asok 2023-10-08T16:07:06.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.558 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.39591.asok status 2023-10-08T16:07:06.650 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "3", 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "39591", 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2023-10-08T16:07:06.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4750, 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 4750 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.2:0", 2023-10-08T16:07:06.652 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2156911332 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.2:0", 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2156911332 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.4750 192.168.0.2:0/2156911332", 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "192.168.0.2:0/2156911332", 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2023-10-08T16:07:06.653 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 6, 2023-10-08T16:07:06.654 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 20, 2023-10-08T16:07:06.654 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:07:06.654 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2023-10-08T16:07:06.654 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2023-10-08T16:07:06.654 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-08T16:07:06.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.659 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-10-08T16:07:06.660 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-10-08T16:07:06.668 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:06.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.688 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-10-08T16:07:06.688 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-08T16:07:06.695 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-10-08T16:07:06.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-08T16:07:06.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.695 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T16:07:06.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.758 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2023-10-08T16:07:06.758 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:06.766 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2023-10-08T16:07:06.766 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:06.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:06.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.826 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2023-10-08T16:07:06.826 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:06.833 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2023-10-08T16:07:06.834 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:06.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:06.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:06.848 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T16:07:06.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:06.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 Processor -- start 2023-10-08T16:07:06.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- start start 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ab015d930 0x7f3ab00cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab006cf90 0x7f3ab006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab006d930 con 0x7f3ab00c3380 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00c8390 con 0x7f3ab015d930 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c7500 con 0x7f3ab006cf90 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ab015d930 0x7f3ab00cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ab015d930 0x7f3ab00cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59522/0 (socket says 172.21.15.3:59522) 2023-10-08T16:07:06.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 -- 172.21.15.3:0/3582770017 learned_addr learned my addr 172.21.15.3:0/3582770017 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:06.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aaffff700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab006cf90 0x7f3ab006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 -- 172.21.15.3:0/3582770017 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab006cf90 msgr2=0x7f3ab006d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:06.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab006cf90 0x7f3ab006d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 -- 172.21.15.3:0/3582770017 >> v1:172.21.15.27:6789/0 conn(0x7f3ab00c3380 legacy=0x7f3ab00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 -- 172.21.15.3:0/3582770017 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00c7780 con 0x7f3ab015d930 2023-10-08T16:07:06.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aaffff700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab006cf90 0x7f3ab006d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aa7fff700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab00cb310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a980099b0 tx=0x7f3a98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99982813c2803ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aaeffd700 1 -- 172.21.15.3:0/3582770017 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800b860 con 0x7f3ab015d930 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aaeffd700 1 -- 172.21.15.3:0/3582770017 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800b9c0 con 0x7f3ab015d930 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3aaeffd700 1 -- 172.21.15.3:0/3582770017 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800bd80 con 0x7f3ab015d930 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- 172.21.15.3:0/3582770017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 msgr2=0x7f3ab00cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab00cb310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a980099b0 tx=0x7f3a98009250 comp rx=0 tx=0).stop 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- 172.21.15.3:0/3582770017 shutdown_connections 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab006cf90 0x7f3ab006d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/3582770017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab00cb310 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- 172.21.15.3:0/3582770017 >> 172.21.15.3:0/3582770017 conn(0x7f3ab006b5b0 msgr2=0x7f3ab006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- 172.21.15.3:0/3582770017 shutdown_connections 2023-10-08T16:07:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.983+0000 7f3ab4df7700 1 -- 172.21.15.3:0/3582770017 wait complete. 2023-10-08T16:07:06.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.987+0000 7f3ab4df7700 1 Processor -- start 2023-10-08T16:07:06.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.987+0000 7f3ab4df7700 1 -- start start 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ab006cf90 0x7f3ab015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab00c3380 0x7f3ab00c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab01596c0 con 0x7f3ab015d930 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab01599a0 con 0x7f3ab006cf90 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0159c80 con 0x7f3ab00c3380 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab0067be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59538/0 (socket says 172.21.15.3:59538) 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 -- 172.21.15.3:0/2963099973 learned_addr learned my addr 172.21.15.3:0/2963099973 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:06.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaf7fe700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ab006cf90 0x7f3ab015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aa7fff700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab00c3380 0x7f3ab00c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 -- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab00c3380 msgr2=0x7f3ab00c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab00c3380 0x7f3ab00c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 -- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ab006cf90 msgr2=0x7f3ab015bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ab006cf90 0x7f3ab015bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 -- 172.21.15.3:0/2963099973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a980094f0 con 0x7f3ab015d930 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aaffff700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab0067be0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800d180 tx=0x7f3aa8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800dcc0 con 0x7f3ab015d930 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800f040 con 0x7f3ab015d930 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab0159f60 con 0x7f3ab015d930 2023-10-08T16:07:06.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8015690 con 0x7f3ab015d930 2023-10-08T16:07:06.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.991+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00c4a20 con 0x7f3ab015d930 2023-10-08T16:07:06.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.995+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab015a460 con 0x7f3ab015d930 2023-10-08T16:07:06.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.995+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3aa801e3b0 con 0x7f3ab015d930 2023-10-08T16:07:06.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.995+0000 7f3aa77fe700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3a90060550 0x7f3a90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.995+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3aa807ccc0 con 0x7f3ab015d930 2023-10-08T16:07:06.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.995+0000 7f3aaf7fe700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3a90060550 0x7f3a90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:06.995+0000 7f3aaf7fe700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3a90060550 0x7f3a90062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00cb6c0 tx=0x7f3aa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.003+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3aa804d2b0 con 0x7f3ab015d930 2023-10-08T16:07:07.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.167+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ab004be40 con 0x7f3ab015d930 2023-10-08T16:07:07.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.171+0000 7f3aa77fe700 1 -- 172.21.15.3:0/2963099973 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f3aa80508d0 con 0x7f3ab015d930 2023-10-08T16:07:07.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:07.173 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:07.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3a90060550 msgr2=0x7f3a90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3a90060550 0x7f3a90062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00cb6c0 tx=0x7f3aa0009040 comp rx=0 tx=0).stop 2023-10-08T16:07:07.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 msgr2=0x7f3ab0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab0067be0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800d180 tx=0x7f3aa8009a50 comp rx=0 tx=0).stop 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 shutdown_connections 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3a90060550 0x7f3a90062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ab015d930 0x7f3ab0067be0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ab00c3380 0x7f3ab00c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 --2- 172.21.15.3:0/2963099973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ab006cf90 0x7f3ab015bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 >> 172.21.15.3:0/2963099973 conn(0x7f3ab006b5b0 msgr2=0x7f3ab014cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 shutdown_connections 2023-10-08T16:07:07.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.175+0000 7f3ab4df7700 1 -- 172.21.15.3:0/2963099973 wait complete. 2023-10-08T16:07:07.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:07:07.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:07.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.303+0000 7efe57fff700 1 Processor -- start 2023-10-08T16:07:07.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.303+0000 7efe57fff700 1 -- start start 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efe5815ca70 0x7efe5815c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe580ac670 0x7efe580c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe580c7700 con 0x7efe5815bf50 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe580cad30 con 0x7efe5815ca70 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe580c8200 con 0x7efe580ac670 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe56ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7efe5815bf50 0x7efe580c6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49404/0 (socket says 172.21.15.3:49404) 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe56ffd700 1 -- 172.21.15.3:0/3718618973 learned_addr learned my addr 172.21.15.3:0/3718618973 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe577fe700 1 --2- 172.21.15.3:0/3718618973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe580ac670 0x7efe580c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe4ffff700 1 --2- 172.21.15.3:0/3718618973 >> v2:172.21.15.27:3300/0 conn(0x7efe5815ca70 0x7efe5815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe567fc700 1 -- 172.21.15.3:0/3718618973 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353309808 0 0) 0x7efe580c7700 con 0x7efe5815bf50 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe567fc700 1 -- 172.21.15.3:0/3718618973 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe38003570 con 0x7efe5815bf50 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe577fe700 1 -- 172.21.15.3:0/3718618973 >> v2:172.21.15.27:3300/0 conn(0x7efe5815ca70 msgr2=0x7efe5815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe577fe700 1 --2- 172.21.15.3:0/3718618973 >> v2:172.21.15.27:3300/0 conn(0x7efe5815ca70 0x7efe5815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe577fe700 1 -- 172.21.15.3:0/3718618973 >> v1:172.21.15.3:6789/0 conn(0x7efe5815bf50 legacy=0x7efe580c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe577fe700 1 -- 172.21.15.3:0/3718618973 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580c7960 con 0x7efe580ac670 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe577fe700 1 --2- 172.21.15.3:0/3718618973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe580ac670 0x7efe580c91b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe580cae70 tx=0x7efe50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7016e11a1bf8e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe567fc700 1 -- 172.21.15.3:0/3718618973 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50016070 con 0x7efe580ac670 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe567fc700 1 -- 172.21.15.3:0/3718618973 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5000bab0 con 0x7efe580ac670 2023-10-08T16:07:07.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe567fc700 1 -- 172.21.15.3:0/3718618973 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5000e070 con 0x7efe580ac670 2023-10-08T16:07:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- 172.21.15.3:0/3718618973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe580ac670 msgr2=0x7efe580c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 --2- 172.21.15.3:0/3718618973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe580ac670 0x7efe580c91b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe580cae70 tx=0x7efe50009780 comp rx=0 tx=0).stop 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- 172.21.15.3:0/3718618973 shutdown_connections 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 --2- 172.21.15.3:0/3718618973 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe580ac670 0x7efe580c91b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 --2- 172.21.15.3:0/3718618973 >> v2:172.21.15.27:3300/0 conn(0x7efe5815ca70 0x7efe5815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- 172.21.15.3:0/3718618973 >> 172.21.15.3:0/3718618973 conn(0x7efe5806b4f0 msgr2=0x7efe5806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- 172.21.15.3:0/3718618973 shutdown_connections 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.307+0000 7efe57fff700 1 -- 172.21.15.3:0/3718618973 wait complete. 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 Processor -- start 2023-10-08T16:07:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 -- start start 2023-10-08T16:07:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 0x7efe580a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe5815bf50 0x7efe580c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe5815ca70 0x7efe580c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe580ab200 con 0x7efe580ac670 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe580aa5f0 con 0x7efe5815bf50 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe580aa8d0 con 0x7efe5815ca70 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 0x7efe580a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 0x7efe580a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59550/0 (socket says 172.21.15.3:59550) 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 -- 172.21.15.3:0/2559386643 learned_addr learned my addr 172.21.15.3:0/2559386643 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe4ffff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe5815bf50 0x7efe580c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe577fe700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe5815ca70 0x7efe580c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 -- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe5815ca70 msgr2=0x7efe580c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe5815ca70 0x7efe580c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 -- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe5815bf50 msgr2=0x7efe580c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe5815bf50 0x7efe580c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 -- 172.21.15.3:0/2559386643 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50009a20 con 0x7efe580ac670 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe4ffff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe5815bf50 0x7efe580c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe56ffd700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 0x7efe580a9f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe480011e0 tx=0x7efe48007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48005b30 con 0x7efe580ac670 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48005c90 con 0x7efe580ac670 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe580aabb0 con 0x7efe580ac670 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe480072e0 con 0x7efe580ac670 2023-10-08T16:07:07.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.311+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe580c6e40 con 0x7efe580ac670 2023-10-08T16:07:07.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.315+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5804be40 con 0x7efe580ac670 2023-10-08T16:07:07.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.315+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efe48007650 con 0x7efe580ac670 2023-10-08T16:07:07.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.315+0000 7efe4effd700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efe3c060550 0x7efe3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.315+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe4807bc40 con 0x7efe580ac670 2023-10-08T16:07:07.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.315+0000 7efe4ffff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efe3c060550 0x7efe3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.319+0000 7efe4ffff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efe3c060550 0x7efe3c062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe580c3ca0 tx=0x7efe40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.323+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe48049be0 con 0x7efe580ac670 2023-10-08T16:07:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe580c7c40 con 0x7efe580ac670 2023-10-08T16:07:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe4effd700 1 -- 172.21.15.3:0/2559386643 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe480170a0 con 0x7efe580ac670 2023-10-08T16:07:07.489 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:07:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efe3c060550 msgr2=0x7efe3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efe3c060550 0x7efe3c062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe580c3ca0 tx=0x7efe40008040 comp rx=0 tx=0).stop 2023-10-08T16:07:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 msgr2=0x7efe580a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 0x7efe580a9f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe480011e0 tx=0x7efe48007df0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 shutdown_connections 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efe3c060550 0x7efe3c062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe5815ca70 0x7efe580c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe5815bf50 0x7efe580c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 --2- 172.21.15.3:0/2559386643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe580ac670 0x7efe580a9f30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 >> 172.21.15.3:0/2559386643 conn(0x7efe5806b4f0 msgr2=0x7efe580cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 shutdown_connections 2023-10-08T16:07:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.487+0000 7efe57fff700 1 -- 172.21.15.3:0/2559386643 wait complete. 2023-10-08T16:07:07.503 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:07:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 Processor -- start 2023-10-08T16:07:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 -- start start 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb964158c80 0x7fb96415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb96406db60 0x7fb96406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640b45a0 con 0x7fb9640b37c0 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96415a060 con 0x7fb964158c80 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96b49b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96406a3a0 con 0x7fb96406db60 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb964158c80 0x7fb96415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb964158c80 0x7fb96415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59564/0 (socket says 172.21.15.3:59564) 2023-10-08T16:07:07.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 -- 172.21.15.3:0/3090024142 learned_addr learned my addr 172.21.15.3:0/3090024142 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:07.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb969c98700 1 --2- 172.21.15.3:0/3090024142 >> v2:172.21.15.27:3300/0 conn(0x7fb96406db60 0x7fb96406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 -- 172.21.15.3:0/3090024142 >> v2:172.21.15.27:3300/0 conn(0x7fb96406db60 msgr2=0x7fb96406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 --2- 172.21.15.3:0/3090024142 >> v2:172.21.15.27:3300/0 conn(0x7fb96406db60 0x7fb96406b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 -- 172.21.15.3:0/3090024142 >> v1:172.21.15.27:6789/0 conn(0x7fb9640b37c0 legacy=0x7fb96406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 -- 172.21.15.3:0/3090024142 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96406a680 con 0x7fb964158c80 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.615+0000 7fb96a499700 1 --2- 172.21.15.3:0/3090024142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96415d4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb9640b2990 tx=0x7fb958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df234a9c8f655dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb969497700 1 -- 172.21.15.3:0/3090024142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958009e70 con 0x7fb964158c80 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb969497700 1 -- 172.21.15.3:0/3090024142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800b8f0 con 0x7fb964158c80 2023-10-08T16:07:07.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb969497700 1 -- 172.21.15.3:0/3090024142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800bc90 con 0x7fb964158c80 2023-10-08T16:07:07.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 -- 172.21.15.3:0/3090024142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 msgr2=0x7fb96415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 --2- 172.21.15.3:0/3090024142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96415d4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb9640b2990 tx=0x7fb958009250 comp rx=0 tx=0).stop 2023-10-08T16:07:07.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 -- 172.21.15.3:0/3090024142 shutdown_connections 2023-10-08T16:07:07.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 --2- 172.21.15.3:0/3090024142 >> v2:172.21.15.27:3300/0 conn(0x7fb96406db60 0x7fb96406b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 --2- 172.21.15.3:0/3090024142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96415d4c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 -- 172.21.15.3:0/3090024142 >> 172.21.15.3:0/3090024142 conn(0x7fb9640d0820 msgr2=0x7fb9640b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 -- 172.21.15.3:0/3090024142 shutdown_connections 2023-10-08T16:07:07.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 -- 172.21.15.3:0/3090024142 wait complete. 2023-10-08T16:07:07.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 Processor -- start 2023-10-08T16:07:07.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 -- start start 2023-10-08T16:07:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb96406db60 0x7fb9641544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 0x7fb964137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.619+0000 7fb96b49b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96b49b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96414c120 con 0x7fb964158c80 2023-10-08T16:07:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96b49b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96414b510 con 0x7fb9640b37c0 2023-10-08T16:07:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96b49b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96414b7f0 con 0x7fb96406db60 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 0x7fb964137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96ac9a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 0x7fb964137040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:60056/0 (socket says 172.21.15.3:60056) 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 -- 172.21.15.3:0/2447111605 learned_addr learned my addr 172.21.15.3:0/2447111605 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96a499700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb96406db60 0x7fb9641544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 -- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb96406db60 msgr2=0x7fb9641544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb96406db60 0x7fb9641544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 -- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 msgr2=0x7fb96414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96414c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 -- 172.21.15.3:0/2447111605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580094f0 con 0x7fb9640b37c0 2023-10-08T16:07:07.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb969c98700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 0x7fb964137040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb954009ef0 tx=0x7fb95400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400cb70 con 0x7fb9640b37c0 2023-10-08T16:07:07.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400f040 con 0x7fb9640b37c0 2023-10-08T16:07:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96414bad0 con 0x7fb9640b37c0 2023-10-08T16:07:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954014480 con 0x7fb9640b37c0 2023-10-08T16:07:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96414b1e0 con 0x7fb9640b37c0 2023-10-08T16:07:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96414c2d0 con 0x7fb9640b37c0 2023-10-08T16:07:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.623+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb9540147f0 con 0x7fb9640b37c0 2023-10-08T16:07:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.627+0000 7fb9627fc700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb950060550 0x7fb950062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.627+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb95407d930 con 0x7fb9640b37c0 2023-10-08T16:07:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.627+0000 7fb96a499700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb950060550 0x7fb950062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.627+0000 7fb96a499700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb950060550 0x7fb950062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9640b2990 tx=0x7fb958017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.635+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb95404df20 con 0x7fb9640b37c0 2023-10-08T16:07:07.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.799+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb96414c290 con 0x7fb9640b37c0 2023-10-08T16:07:07.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.799+0000 7fb9627fc700 1 -- 172.21.15.3:0/2447111605 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb954051540 con 0x7fb9640b37c0 2023-10-08T16:07:07.802 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:07:07.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb950060550 msgr2=0x7fb950062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb950060550 0x7fb950062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9640b2990 tx=0x7fb958017000 comp rx=0 tx=0).stop 2023-10-08T16:07:07.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 msgr2=0x7fb964137040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 0x7fb964137040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb954009ef0 tx=0x7fb95400b040 comp rx=0 tx=0).stop 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 shutdown_connections 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb950060550 0x7fb950062a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb964158c80 0x7fb96414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9640b37c0 0x7fb964137040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 --2- 172.21.15.3:0/2447111605 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb96406db60 0x7fb9641544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 >> 172.21.15.3:0/2447111605 conn(0x7fb9640d0820 msgr2=0x7fb96415a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 shutdown_connections 2023-10-08T16:07:07.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.803+0000 7fb96b49b700 1 -- 172.21.15.3:0/2447111605 wait complete. 2023-10-08T16:07:07.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:07:07.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 Processor -- start 2023-10-08T16:07:07.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 -- start start 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03781558d0 0x7f03780c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f03780c9ba0 0x7f03780cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780ca900 con 0x7f03780c9ba0 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780cabc0 con 0x7f03781558d0 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037d697700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780caea0 con 0x7f03780ad740 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f03780c9ba0 0x7f03780cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f0377fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03781558d0 0x7f03780c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f03780c9ba0 0x7f03780cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59580/0 (socket says 172.21.15.3:59580) 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 -- 172.21.15.3:0/890762579 learned_addr learned my addr 172.21.15.3:0/890762579 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037ce96700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 -- 172.21.15.3:0/890762579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 msgr2=0x7f03780cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 -- 172.21.15.3:0/890762579 >> v2:172.21.15.27:3300/0 conn(0x7f03781558d0 msgr2=0x7f03780c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 --2- 172.21.15.3:0/890762579 >> v2:172.21.15.27:3300/0 conn(0x7f03781558d0 0x7f03780c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 -- 172.21.15.3:0/890762579 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780cb180 con 0x7f03780c9ba0 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f037ce96700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:07.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f03777fe700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780cbdf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03780ca530 tx=0x7f036c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783f95da4c11e440 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.939+0000 7f0376ffd700 1 -- 172.21.15.3:0/890762579 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c009e70 con 0x7f03780c9ba0 2023-10-08T16:07:07.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f0376ffd700 1 -- 172.21.15.3:0/890762579 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00b860 con 0x7f03780c9ba0 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f0376ffd700 1 -- 172.21.15.3:0/890762579 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00bc00 con 0x7f03780c9ba0 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 -- 172.21.15.3:0/890762579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 msgr2=0x7f03780cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780cbdf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03780ca530 tx=0x7f036c009250 comp rx=0 tx=0).stop 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 -- 172.21.15.3:0/890762579 shutdown_connections 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 --2- 172.21.15.3:0/890762579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780cbdf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 --2- 172.21.15.3:0/890762579 >> v2:172.21.15.27:3300/0 conn(0x7f03781558d0 0x7f03780c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 -- 172.21.15.3:0/890762579 >> 172.21.15.3:0/890762579 conn(0x7f037806b4f0 msgr2=0x7f037806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 -- 172.21.15.3:0/890762579 shutdown_connections 2023-10-08T16:07:07.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.943+0000 7f037d697700 1 -- 172.21.15.3:0/890762579 wait complete. 2023-10-08T16:07:07.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 Processor -- start 2023-10-08T16:07:07.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 -- start start 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03781558d0 0x7f03780c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378156010 con 0x7f03780c9ba0 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780ab2c0 con 0x7f03781558d0 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037d697700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c1660 con 0x7f03780ad740 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59594/0 (socket says 172.21.15.3:59594) 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 -- 172.21.15.3:0/3659582379 learned_addr learned my addr 172.21.15.3:0/3659582379 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f0377fff700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f037ce96700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03781558d0 0x7f03780c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 -- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 msgr2=0x7f03780aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 -- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03781558d0 msgr2=0x7f03780c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03781558d0 0x7f03780c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 -- 172.21.15.3:0/3659582379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094f0 con 0x7f03780c9ba0 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f0377fff700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f03777fe700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780c0d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f036c009290 tx=0x7f036c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.947+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c000d10 con 0x7f03780c9ba0 2023-10-08T16:07:07.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00bbe0 con 0x7f03780c9ba0 2023-10-08T16:07:07.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03780c1940 con 0x7f03780c9ba0 2023-10-08T16:07:07.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c01a680 con 0x7f03780c9ba0 2023-10-08T16:07:07.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0378155ca0 con 0x7f03780c9ba0 2023-10-08T16:07:07.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037804be40 con 0x7f03780c9ba0 2023-10-08T16:07:07.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f036c01aa30 con 0x7f03780c9ba0 2023-10-08T16:07:07.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f035ffff700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0364060580 0x7f0364062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f036c07dbd0 con 0x7f03780c9ba0 2023-10-08T16:07:07.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f0377fff700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0364060580 0x7f0364062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.951+0000 7f0377fff700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0364060580 0x7f0364062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0368009d80 tx=0x7f0368008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:07.959+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f036c04e320 con 0x7f03780c9ba0 2023-10-08T16:07:08.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.119+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03780cb9a0 con 0x7f03780c9ba0 2023-10-08T16:07:08.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.119+0000 7f035ffff700 1 -- 172.21.15.3:0/3659582379 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f036c02a0a0 con 0x7f03780c9ba0 2023-10-08T16:07:08.123 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.119+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0364060580 msgr2=0x7f0364062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.119+0000 7f037d697700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0364060580 0x7f0364062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0368009d80 tx=0x7f0368008040 comp rx=0 tx=0).stop 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.119+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 msgr2=0x7f03780c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.119+0000 7f037d697700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780c0d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f036c009290 tx=0x7f036c017000 comp rx=0 tx=0).stop 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 shutdown_connections 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0364060580 0x7f0364062a30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03781558d0 0x7f03780c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03780c9ba0 0x7f03780c0d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 --2- 172.21.15.3:0/3659582379 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f03780ad740 0x7f03780aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 >> 172.21.15.3:0/3659582379 conn(0x7f037806b4f0 msgr2=0x7f0378068500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 shutdown_connections 2023-10-08T16:07:08.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.123+0000 7f037d697700 1 -- 172.21.15.3:0/3659582379 wait complete. 2023-10-08T16:07:08.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.243+0000 7f4825e18700 1 Processor -- start 2023-10-08T16:07:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.243+0000 7f4825e18700 1 -- start start 2023-10-08T16:07:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 0x7f48200b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48200ca5d0 0x7f48200caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4820067060 0x7f48200674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820067a20 con 0x7f48201591f0 2023-10-08T16:07:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482006ce20 con 0x7f4820067060 2023-10-08T16:07:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200cb090 con 0x7f48200ca5d0 2023-10-08T16:07:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4824e16700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 0x7f48200b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48200ca5d0 0x7f48200caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4824e16700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 0x7f48200b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59610/0 (socket says 172.21.15.3:59610) 2023-10-08T16:07:08.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4824e16700 1 -- 172.21.15.3:0/3413833843 learned_addr learned my addr 172.21.15.3:0/3413833843 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825617700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4820067060 0x7f48200674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 -- 172.21.15.3:0/3413833843 >> v2:172.21.15.27:3300/0 conn(0x7f4820067060 msgr2=0x7f48200674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 --2- 172.21.15.3:0/3413833843 >> v2:172.21.15.27:3300/0 conn(0x7f4820067060 0x7f48200674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 -- 172.21.15.3:0/3413833843 >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 msgr2=0x7f48200b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 --2- 172.21.15.3:0/3413833843 >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 0x7f48200b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 -- 172.21.15.3:0/3413833843 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200cb370 con 0x7f48200ca5d0 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4824e16700 1 --2- 172.21.15.3:0/3413833843 >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 0x7f48200b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481ffff700 1 --2- 172.21.15.3:0/3413833843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48200ca5d0 0x7f48200caa40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f482006b940 tx=0x7f48140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d26a6aeb4781b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481f7fe700 1 -- 172.21.15.3:0/3413833843 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011630 con 0x7f48200ca5d0 2023-10-08T16:07:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481f7fe700 1 -- 172.21.15.3:0/3413833843 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48140117b0 con 0x7f48200ca5d0 2023-10-08T16:07:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f481f7fe700 1 -- 172.21.15.3:0/3413833843 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011b70 con 0x7f48200ca5d0 2023-10-08T16:07:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- 172.21.15.3:0/3413833843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48200ca5d0 msgr2=0x7f48200caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- 172.21.15.3:0/3413833843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48200ca5d0 0x7f48200caa40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f482006b940 tx=0x7f48140091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- 172.21.15.3:0/3413833843 shutdown_connections 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- 172.21.15.3:0/3413833843 >> v2:172.21.15.27:3300/0 conn(0x7f4820067060 0x7f48200674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- 172.21.15.3:0/3413833843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48200ca5d0 0x7f48200caa40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 --2- 172.21.15.3:0/3413833843 >> v2:172.21.15.3:3300/0 conn(0x7f48201591f0 0x7f48200b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- 172.21.15.3:0/3413833843 >> 172.21.15.3:0/3413833843 conn(0x7f48200cfd80 msgr2=0x7f48200d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- 172.21.15.3:0/3413833843 shutdown_connections 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.247+0000 7f4825e18700 1 -- 172.21.15.3:0/3413833843 wait complete. 2023-10-08T16:07:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 Processor -- start 2023-10-08T16:07:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 -- start start 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4820067060 0x7f4820158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 0x7f48200c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48201591f0 0x7f48200c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200c81e0 con 0x7f48200ca5d0 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200c8460 con 0x7f4820067060 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200c8740 con 0x7f48201591f0 2023-10-08T16:07:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 0x7f48200c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 0x7f48200c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59612/0 (socket says 172.21.15.3:59612) 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 -- 172.21.15.3:0/1133378451 learned_addr learned my addr 172.21.15.3:0/1133378451 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4824e16700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4820067060 0x7f4820158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825617700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48201591f0 0x7f48200c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 -- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48201591f0 msgr2=0x7f48200c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48201591f0 0x7f48200c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 -- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4820067060 msgr2=0x7f4820158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4820067060 0x7f4820158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 -- 172.21.15.3:0/1133378451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810009ae0 con 0x7f48200ca5d0 2023-10-08T16:07:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825617700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48201591f0 0x7f48200c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481ffff700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 0x7f48200c9500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4814013000 tx=0x7f4814017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481401f070 con 0x7f48200ca5d0 2023-10-08T16:07:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814000bc0 con 0x7f48200ca5d0 2023-10-08T16:07:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4814009420 con 0x7f48200ca5d0 2023-10-08T16:07:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011b70 con 0x7f48200ca5d0 2023-10-08T16:07:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.251+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48200c8d00 con 0x7f48200ca5d0 2023-10-08T16:07:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.255+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482004be40 con 0x7f48200ca5d0 2023-10-08T16:07:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.255+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4814023070 con 0x7f48200ca5d0 2023-10-08T16:07:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.255+0000 7f481cff9700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f480c060550 0x7f480c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.255+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f481407d920 con 0x7f48200ca5d0 2023-10-08T16:07:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.255+0000 7f4824e16700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f480c060550 0x7f480c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.255+0000 7f4824e16700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f480c060550 0x7f480c062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f48100072d0 tx=0x7f481000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.267+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f481404e000 con 0x7f48200ca5d0 2023-10-08T16:07:08.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.430+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4820067c00 con 0x7f48200ca5d0 2023-10-08T16:07:08.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.430+0000 7f481cff9700 1 -- 172.21.15.3:0/1133378451 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f48140515e0 con 0x7f48200ca5d0 2023-10-08T16:07:08.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:08.437 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f480c060550 msgr2=0x7f480c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f480c060550 0x7f480c062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f48100072d0 tx=0x7f481000b040 comp rx=0 tx=0).stop 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 msgr2=0x7f48200c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 0x7f48200c9500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4814013000 tx=0x7f4814017000 comp rx=0 tx=0).stop 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 shutdown_connections 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f480c060550 0x7f480c062a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48201591f0 0x7f48200c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48200ca5d0 0x7f48200c9500 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 --2- 172.21.15.3:0/1133378451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4820067060 0x7f4820158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 >> 172.21.15.3:0/1133378451 conn(0x7f48200cfd80 msgr2=0x7f48200cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 shutdown_connections 2023-10-08T16:07:08.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.434+0000 7f4825e18700 1 -- 172.21.15.3:0/1133378451 wait complete. 2023-10-08T16:07:08.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:07:08.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:08.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.562+0000 7f9c6359e700 1 Processor -- start 2023-10-08T16:07:08.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.562+0000 7f9c6359e700 1 -- start start 2023-10-08T16:07:08.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.562+0000 7f9c6359e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9c641558d0 0x7f9c640c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.562+0000 7f9c6359e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640ca900 con 0x7f9c640c9ba0 2023-10-08T16:07:08.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.562+0000 7f9c6359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640cabc0 con 0x7f9c640cc500 2023-10-08T16:07:08.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c640caea0 con 0x7f9c641558d0 2023-10-08T16:07:08.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c59d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9c640c9ba0 0x7f9c640cbdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49412/0 (socket says 172.21.15.3:49412) 2023-10-08T16:07:08.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c59d9b700 1 -- 172.21.15.3:0/1180636970 learned_addr learned my addr 172.21.15.3:0/1180636970 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:08.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9c641558d0 0x7f9c640c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c61d9b700 1 -- 172.21.15.3:0/1180636970 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115394528 0 0) 0x7f9c640ca900 con 0x7f9c640c9ba0 2023-10-08T16:07:08.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c61d9b700 1 -- 172.21.15.3:0/1180636970 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c44003570 con 0x7f9c640c9ba0 2023-10-08T16:07:08.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6259c700 1 -- 172.21.15.3:0/1180636970 >> v1:172.21.15.27:6789/0 conn(0x7f9c640cc500 legacy=0x7f9c640c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c61d9b700 1 -- 172.21.15.3:0/1180636970 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271610409 0 0) 0x7f9c640cabc0 con 0x7f9c640cc500 2023-10-08T16:07:08.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6259c700 1 -- 172.21.15.3:0/1180636970 >> v1:172.21.15.3:6789/0 conn(0x7f9c640c9ba0 legacy=0x7f9c640cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6259c700 1 -- 172.21.15.3:0/1180636970 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640cb180 con 0x7f9c641558d0 2023-10-08T16:07:08.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6259c700 1 --2- 172.21.15.3:0/1180636970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c641558d0 0x7f9c640c9660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c540098e0 tx=0x7f9c540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca336af8c2d7282 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c61d9b700 1 -- 172.21.15.3:0/1180636970 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400b640 con 0x7f9c641558d0 2023-10-08T16:07:08.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c61d9b700 1 -- 172.21.15.3:0/1180636970 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400b7a0 con 0x7f9c641558d0 2023-10-08T16:07:08.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c61d9b700 1 -- 172.21.15.3:0/1180636970 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400bb40 con 0x7f9c641558d0 2023-10-08T16:07:08.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 -- 172.21.15.3:0/1180636970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c641558d0 msgr2=0x7f9c640c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 --2- 172.21.15.3:0/1180636970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c641558d0 0x7f9c640c9660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c540098e0 tx=0x7f9c540091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 -- 172.21.15.3:0/1180636970 shutdown_connections 2023-10-08T16:07:08.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 --2- 172.21.15.3:0/1180636970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c641558d0 0x7f9c640c9660 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 -- 172.21.15.3:0/1180636970 >> 172.21.15.3:0/1180636970 conn(0x7f9c6406b4f0 msgr2=0x7f9c6406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 -- 172.21.15.3:0/1180636970 shutdown_connections 2023-10-08T16:07:08.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.566+0000 7f9c6359e700 1 -- 172.21.15.3:0/1180636970 wait complete. 2023-10-08T16:07:08.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 Processor -- start 2023-10-08T16:07:08.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 -- start start 2023-10-08T16:07:08.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c640c9ba0 0x7f9c641669f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9c640cc500 0x7f9c641697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 0x7f9c6406cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c641577c0 con 0x7f9c64169ff0 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6416a540 con 0x7f9c640c9ba0 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6416a820 con 0x7f9c640cc500 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 0x7f9c6406cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 0x7f9c6406cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59642/0 (socket says 172.21.15.3:59642) 2023-10-08T16:07:08.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 -- 172.21.15.3:0/3389987292 learned_addr learned my addr 172.21.15.3:0/3389987292 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:08.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c59d9b700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9c640cc500 0x7f9c641697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6259c700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c640c9ba0 0x7f9c641669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 -- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9c640cc500 msgr2=0x7f9c641697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9c640cc500 0x7f9c641697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 -- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c640c9ba0 msgr2=0x7f9c641669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c640c9ba0 0x7f9c641669f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 -- 172.21.15.3:0/3389987292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009420 con 0x7f9c64169ff0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c62d9d700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 0x7f9c6406cf90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c002230 tx=0x7f9c5c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00cea0 con 0x7f9c64169ff0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00a7e0 con 0x7f9c64169ff0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6416ab00 con 0x7f9c64169ff0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00aba0 con 0x7f9c64169ff0 2023-10-08T16:07:08.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.570+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6416ade0 con 0x7f9c64169ff0 2023-10-08T16:07:08.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.574+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c64157970 con 0x7f9c64169ff0 2023-10-08T16:07:08.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.574+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9c5c012420 con 0x7f9c64169ff0 2023-10-08T16:07:08.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.574+0000 7f9c5affd700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9c48060550 0x7f9c48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.574+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c5c07cb10 con 0x7f9c64169ff0 2023-10-08T16:07:08.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.574+0000 7f9c6259c700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9c48060550 0x7f9c48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.574+0000 7f9c6259c700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9c48060550 0x7f9c48062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406cc90 tx=0x7f9c54017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.586+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9c64157970 con 0x7f9c64169ff0 2023-10-08T16:07:08.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.746+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c6404be40 con 0x7f9c64169ff0 2023-10-08T16:07:08.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.746+0000 7f9c5affd700 1 -- 172.21.15.3:0/3389987292 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c5c04d100 con 0x7f9c64169ff0 2023-10-08T16:07:08.750 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.746+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9c48060550 msgr2=0x7f9c48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.746+0000 7f9c6359e700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9c48060550 0x7f9c48062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406cc90 tx=0x7f9c54017000 comp rx=0 tx=0).stop 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.746+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 msgr2=0x7f9c6406cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.746+0000 7f9c6359e700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 0x7f9c6406cf90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c002230 tx=0x7f9c5c0016f0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 shutdown_connections 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9c48060550 0x7f9c48062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c64169ff0 0x7f9c6406cf90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9c640cc500 0x7f9c641697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 --2- 172.21.15.3:0/3389987292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c640c9ba0 0x7f9c641669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 >> 172.21.15.3:0/3389987292 conn(0x7f9c6406b4f0 msgr2=0x7f9c64067060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 shutdown_connections 2023-10-08T16:07:08.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.750+0000 7f9c6359e700 1 -- 172.21.15.3:0/3389987292 wait complete. 2023-10-08T16:07:08.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:07:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 Processor -- start 2023-10-08T16:07:08.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 -- start start 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5fd8158b00 0x7f5fd8158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd806ed30 0x7f5fd80ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd80c9c00 con 0x7f5fd80ca090 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd80c7400 con 0x7f5fd8158b00 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fdcd2e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80c76e0 con 0x7f5fd806ed30 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5fd8158b00 0x7f5fd8158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5fd8158b00 0x7f5fd8158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59644/0 (socket says 172.21.15.3:59644) 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2122222807 learned_addr learned my addr 172.21.15.3:0/2122222807 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd7fff700 1 --2- 172.21.15.3:0/2122222807 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd806ed30 0x7f5fd80ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2122222807 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd806ed30 msgr2=0x7f5fd80ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 --2- 172.21.15.3:0/2122222807 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd806ed30 0x7f5fd80ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2122222807 >> v1:172.21.15.3:6789/0 conn(0x7f5fd80ca090 legacy=0x7f5fd806e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2122222807 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80c95b0 con 0x7f5fd8158b00 2023-10-08T16:07:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd77fe700 1 --2- 172.21.15.3:0/2122222807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd8158b00 0x7f5fd8158ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009990 tx=0x7f5fc8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd2e4453fc5ebcf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd6ffd700 1 -- 172.21.15.3:0/2122222807 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8009e80 con 0x7f5fd8158b00 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd6ffd700 1 -- 172.21.15.3:0/2122222807 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8005c10 con 0x7f5fd8158b00 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.878+0000 7f5fd6ffd700 1 -- 172.21.15.3:0/2122222807 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800b650 con 0x7f5fd8158b00 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2122222807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd8158b00 msgr2=0x7f5fd8158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2122222807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd8158b00 0x7f5fd8158ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009990 tx=0x7f5fc8009220 comp rx=0 tx=0).stop 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2122222807 shutdown_connections 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2122222807 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd806ed30 0x7f5fd80ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2122222807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd8158b00 0x7f5fd8158ed0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2122222807 >> 172.21.15.3:0/2122222807 conn(0x7f5fd80c83b0 msgr2=0x7f5fd80c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2122222807 shutdown_connections 2023-10-08T16:07:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2122222807 wait complete. 2023-10-08T16:07:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 Processor -- start 2023-10-08T16:07:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.882+0000 7f5fdcd2e700 1 -- start start 2023-10-08T16:07:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 0x7f5fd80afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd80ca090 0x7f5fd815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd8158b00 0x7f5fd815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80af760 con 0x7f5fd806ed30 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80aeb50 con 0x7f5fd8158b00 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80aee30 con 0x7f5fd80ca090 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 0x7f5fd80afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 0x7f5fd80afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59646/0 (socket says 172.21.15.3:59646) 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2736771007 learned_addr learned my addr 172.21.15.3:0/2736771007 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd7fff700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd8158b00 0x7f5fd815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fcffff700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd80ca090 0x7f5fd815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd80ca090 msgr2=0x7f5fd815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd80ca090 0x7f5fd815d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd8158b00 msgr2=0x7f5fd815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd8158b00 0x7f5fd815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 -- 172.21.15.3:0/2736771007 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8009480 con 0x7f5fd806ed30 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd7fff700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd8158b00 0x7f5fd815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fd77fe700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 0x7f5fd80afbf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800b3c0 tx=0x7f5fc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8011ae0 con 0x7f5fd806ed30 2023-10-08T16:07:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8020070 con 0x7f5fd806ed30 2023-10-08T16:07:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd80af110 con 0x7f5fd806ed30 2023-10-08T16:07:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8011e90 con 0x7f5fd806ed30 2023-10-08T16:07:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.886+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd80b0130 con 0x7f5fd806ed30 2023-10-08T16:07:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.890+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd804be40 con 0x7f5fd806ed30 2023-10-08T16:07:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.890+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5fc8022030 con 0x7f5fd806ed30 2023-10-08T16:07:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.890+0000 7f5fcf7fe700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5fb8060550 0x7f5fb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.890+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fc807e3d0 con 0x7f5fd806ed30 2023-10-08T16:07:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.890+0000 7f5fcffff700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5fb8060550 0x7f5fb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.890+0000 7f5fcffff700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5fb8060550 0x7f5fb8062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8159a80 tx=0x7f5fc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:08.898+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5fc804e9c0 con 0x7f5fd806ed30 2023-10-08T16:07:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.058+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fd80c9890 con 0x7f5fd806ed30 2023-10-08T16:07:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.058+0000 7f5fcf7fe700 1 -- 172.21.15.3:0/2736771007 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fc8051fe0 con 0x7f5fd806ed30 2023-10-08T16:07:09.062 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5fb8060550 msgr2=0x7f5fb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5fb8060550 0x7f5fb8062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8159a80 tx=0x7f5fc0009040 comp rx=0 tx=0).stop 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 msgr2=0x7f5fd80afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 0x7f5fd80afbf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800b3c0 tx=0x7f5fc8016000 comp rx=0 tx=0).stop 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 shutdown_connections 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5fb8060550 0x7f5fb8062a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd8158b00 0x7f5fd815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5fd80ca090 0x7f5fd815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 --2- 172.21.15.3:0/2736771007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fd806ed30 0x7f5fd80afbf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 >> 172.21.15.3:0/2736771007 conn(0x7f5fd80c83b0 msgr2=0x7f5fd8157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 shutdown_connections 2023-10-08T16:07:09.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.062+0000 7f5fdcd2e700 1 -- 172.21.15.3:0/2736771007 wait complete. 2023-10-08T16:07:09.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:07:09.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 Processor -- start 2023-10-08T16:07:09.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 -- start start 2023-10-08T16:07:09.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c038200 0x7fa21c0513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa21c0385d0 0x7fa21c04c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa21c0531c0 0x7fa21c04c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c053730 con 0x7fa21c0385d0 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c0e2970 con 0x7fa21c0531c0 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.194+0000 7fa229542700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c050f50 con 0x7fa21c038200 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa21c0385d0 0x7fa21c04c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa21c0385d0 0x7fa21c04c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59662/0 (socket says 172.21.15.3:59662) 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 -- 172.21.15.3:0/200333804 learned_addr learned my addr 172.21.15.3:0/200333804 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa228d41700 1 --2- 172.21.15.3:0/200333804 >> v2:172.21.15.27:3300/0 conn(0x7fa21c0531c0 0x7fa21c04c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa223fff700 1 --2- 172.21.15.3:0/200333804 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c038200 0x7fa21c0513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 -- 172.21.15.3:0/200333804 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c038200 msgr2=0x7fa21c0513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 --2- 172.21.15.3:0/200333804 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c038200 0x7fa21c0513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 -- 172.21.15.3:0/200333804 >> v2:172.21.15.27:3300/0 conn(0x7fa21c0531c0 msgr2=0x7fa21c04c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 --2- 172.21.15.3:0/200333804 >> v2:172.21.15.27:3300/0 conn(0x7fa21c0531c0 0x7fa21c04c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 -- 172.21.15.3:0/200333804 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c050620 con 0x7fa21c0385d0 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa228d41700 1 --2- 172.21.15.3:0/200333804 >> v2:172.21.15.27:3300/0 conn(0x7fa21c0531c0 0x7fa21c04c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:09.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa2237fe700 1 --2- 172.21.15.3:0/200333804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c0385d0 0x7fa21c04c2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00f1c0 tx=0x7fa210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657bca69ae5e2f56 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa222ffd700 1 -- 172.21.15.3:0/200333804 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21000b640 con 0x7fa21c0385d0 2023-10-08T16:07:09.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa222ffd700 1 -- 172.21.15.3:0/200333804 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21000b7a0 con 0x7fa21c0385d0 2023-10-08T16:07:09.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa222ffd700 1 -- 172.21.15.3:0/200333804 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21000bb60 con 0x7fa21c0385d0 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 -- 172.21.15.3:0/200333804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c0385d0 msgr2=0x7fa21c04c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 --2- 172.21.15.3:0/200333804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c0385d0 0x7fa21c04c2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00f1c0 tx=0x7fa210009250 comp rx=0 tx=0).stop 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 -- 172.21.15.3:0/200333804 shutdown_connections 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 --2- 172.21.15.3:0/200333804 >> v2:172.21.15.27:3300/0 conn(0x7fa21c0531c0 0x7fa21c04c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 --2- 172.21.15.3:0/200333804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c0385d0 0x7fa21c04c2a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 --2- 172.21.15.3:0/200333804 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c038200 0x7fa21c0513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 -- 172.21.15.3:0/200333804 >> 172.21.15.3:0/200333804 conn(0x7fa21c038d00 msgr2=0x7fa21c039100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 -- 172.21.15.3:0/200333804 shutdown_connections 2023-10-08T16:07:09.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.198+0000 7fa229542700 1 -- 172.21.15.3:0/200333804 wait complete. 2023-10-08T16:07:09.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 Processor -- start 2023-10-08T16:07:09.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 -- start start 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa21c038200 0x7fa21c04d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c0531c0 0x7fa21c0f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 0x7fa21c0390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c04cef0 con 0x7fa21c023680 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c04d4b0 con 0x7fa21c038200 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0f27f0 con 0x7fa21c0531c0 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 0x7fa21c0390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 0x7fa21c0390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59670/0 (socket says 172.21.15.3:59670) 2023-10-08T16:07:09.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa223fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa21c038200 0x7fa21c04d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa2237fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c0531c0 0x7fa21c0f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 -- 172.21.15.3:0/14529871 learned_addr learned my addr 172.21.15.3:0/14529871 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:09.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 -- 172.21.15.3:0/14529871 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c0531c0 msgr2=0x7fa21c0f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c0531c0 0x7fa21c0f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 -- 172.21.15.3:0/14529871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa21c038200 msgr2=0x7fa21c04d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa21c038200 0x7fa21c04d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 -- 172.21.15.3:0/14529871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22406c040 con 0x7fa21c023680 2023-10-08T16:07:09.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa228d41700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 0x7fa21c0390d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa224060f70 tx=0x7fa224063c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240009a0 con 0x7fa21c023680 2023-10-08T16:07:09.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22408b070 con 0x7fa21c023680 2023-10-08T16:07:09.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22406da90 con 0x7fa21c023680 2023-10-08T16:07:09.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2100094f0 con 0x7fa21c023680 2023-10-08T16:07:09.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.202+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c04d140 con 0x7fa21c023680 2023-10-08T16:07:09.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.206+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c005860 con 0x7fa21c023680 2023-10-08T16:07:09.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.206+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa22408d070 con 0x7fa21c023680 2023-10-08T16:07:09.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.206+0000 7fa20ffff700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.206+0000 7fa223fff700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.206+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2240f2ff0 con 0x7fa21c023680 2023-10-08T16:07:09.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.210+0000 7fa223fff700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa218009db0 tx=0x7fa2180091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.218+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2240c7030 con 0x7fa21c023680 2023-10-08T16:07:09.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.386+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa21c050900 con 0x7fa21c023680 2023-10-08T16:07:09.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.386+0000 7fa20ffff700 1 -- 172.21.15.3:0/14529871 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2240c6bc0 con 0x7fa21c023680 2023-10-08T16:07:09.391 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:07:09.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 msgr2=0x7fa208062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa218009db0 tx=0x7fa2180091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 msgr2=0x7fa21c0390d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 0x7fa21c0390d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa224060f70 tx=0x7fa224063c90 comp rx=0 tx=0).stop 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 shutdown_connections 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa21c023680 0x7fa21c0390d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa21c0531c0 0x7fa21c0f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 --2- 172.21.15.3:0/14529871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa21c038200 0x7fa21c04d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 >> 172.21.15.3:0/14529871 conn(0x7fa21c038d00 msgr2=0x7fa21c04b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 shutdown_connections 2023-10-08T16:07:09.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.390+0000 7fa229542700 1 -- 172.21.15.3:0/14529871 wait complete. 2023-10-08T16:07:09.406 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.506+0000 7f10eb59e700 1 Processor -- start 2023-10-08T16:07:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.506+0000 7f10eb59e700 1 -- start start 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10ec158b90 0x7f10ec158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f10ec06a880 0x7f10ec067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0ca2d0 con 0x7f10ec06a400 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec1594a0 con 0x7f10ec06a880 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec06aca0 con 0x7f10ec158b90 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f10ec06a400 0x7f10ec0cad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49424/0 (socket says 172.21.15.3:49424) 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e3fff700 1 -- 172.21.15.3:0/3486758230 learned_addr learned my addr 172.21.15.3:0/3486758230 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ead9d700 1 --2- 172.21.15.3:0/3486758230 >> v2:172.21.15.3:3300/0 conn(0x7f10ec06a880 0x7f10ec067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ea59c700 1 --2- 172.21.15.3:0/3486758230 >> v2:172.21.15.27:3300/0 conn(0x7f10ec158b90 0x7f10ec158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e9d9b700 1 -- 172.21.15.3:0/3486758230 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643815923 0 0) 0x7f10ec0ca2d0 con 0x7f10ec06a400 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e9d9b700 1 -- 172.21.15.3:0/3486758230 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10cc003570 con 0x7f10ec06a400 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e9d9b700 1 -- 172.21.15.3:0/3486758230 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175780251 0 0) 0x7f10cc003570 con 0x7f10ec06a400 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ead9d700 1 -- 172.21.15.3:0/3486758230 >> v2:172.21.15.27:3300/0 conn(0x7f10ec158b90 msgr2=0x7f10ec158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ead9d700 1 --2- 172.21.15.3:0/3486758230 >> v2:172.21.15.27:3300/0 conn(0x7f10ec158b90 0x7f10ec158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ead9d700 1 -- 172.21.15.3:0/3486758230 >> v1:172.21.15.3:6789/0 conn(0x7f10ec06a400 legacy=0x7f10ec0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ead9d700 1 -- 172.21.15.3:0/3486758230 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0ca890 con 0x7f10ec06a880 2023-10-08T16:07:09.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10ead9d700 1 --2- 172.21.15.3:0/3486758230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a880 0x7f10ec067060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10ec069e60 tx=0x7f10e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f67f32745b145e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e9d9b700 1 -- 172.21.15.3:0/3486758230 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e400e070 con 0x7f10ec06a880 2023-10-08T16:07:09.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e9d9b700 1 -- 172.21.15.3:0/3486758230 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e400b7a0 con 0x7f10ec06a880 2023-10-08T16:07:09.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10e9d9b700 1 -- 172.21.15.3:0/3486758230 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc001470 con 0x7f10ec06a880 2023-10-08T16:07:09.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- 172.21.15.3:0/3486758230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a880 msgr2=0x7f10ec067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 --2- 172.21.15.3:0/3486758230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a880 0x7f10ec067060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10ec069e60 tx=0x7f10e4009780 comp rx=0 tx=0).stop 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- 172.21.15.3:0/3486758230 shutdown_connections 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 --2- 172.21.15.3:0/3486758230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a880 0x7f10ec067060 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 --2- 172.21.15.3:0/3486758230 >> v2:172.21.15.27:3300/0 conn(0x7f10ec158b90 0x7f10ec158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- 172.21.15.3:0/3486758230 >> 172.21.15.3:0/3486758230 conn(0x7f10ec0cfd30 msgr2=0x7f10ec0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- 172.21.15.3:0/3486758230 shutdown_connections 2023-10-08T16:07:09.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.510+0000 7f10eb59e700 1 -- 172.21.15.3:0/3486758230 wait complete. 2023-10-08T16:07:09.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 Processor -- start 2023-10-08T16:07:09.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 -- start start 2023-10-08T16:07:09.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 0x7f10ec156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f10ec06a880 0x7f10ec0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ec158b90 0x7f10ec149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec156ab0 con 0x7f10ec06a400 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0c49b0 con 0x7f10ec158b90 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0c4c90 con 0x7f10ec06a880 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 0x7f10ec156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 0x7f10ec156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59684/0 (socket says 172.21.15.3:59684) 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 -- 172.21.15.3:0/1086833999 learned_addr learned my addr 172.21.15.3:0/1086833999 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10e3fff700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f10ec06a880 0x7f10ec0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ead9d700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ec158b90 0x7f10ec149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 -- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f10ec06a880 msgr2=0x7f10ec0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f10ec06a880 0x7f10ec0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 -- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ec158b90 msgr2=0x7f10ec149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ec158b90 0x7f10ec149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 -- 172.21.15.3:0/1086833999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009a20 con 0x7f10ec06a400 2023-10-08T16:07:09.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10ea59c700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 0x7f10ec156570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10d400ec80 tx=0x7f10d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400c9d0 con 0x7f10ec06a400 2023-10-08T16:07:09.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d400cb30 con 0x7f10ec06a400 2023-10-08T16:07:09.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec0c4f70 con 0x7f10ec06a400 2023-10-08T16:07:09.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4013470 con 0x7f10ec06a400 2023-10-08T16:07:09.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.514+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec0c5530 con 0x7f10ec06a400 2023-10-08T16:07:09.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.518+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec04be40 con 0x7f10ec06a400 2023-10-08T16:07:09.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.518+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f10d40137e0 con 0x7f10ec06a400 2023-10-08T16:07:09.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.518+0000 7f10e27fc700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f10d0060580 0x7f10d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.518+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10d407cb30 con 0x7f10ec06a400 2023-10-08T16:07:09.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.518+0000 7f10e3fff700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f10d0060580 0x7f10d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.518+0000 7f10e3fff700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f10d0060580 0x7f10d0062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f10dc001620 tx=0x7f10dc0014c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.522+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f10d404d120 con 0x7f10ec06a400 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.686+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10ec0c5980 con 0x7f10ec06a400 2023-10-08T16:07:09.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.686+0000 7f10e27fc700 1 -- 172.21.15.3:0/1086833999 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f10d4050740 con 0x7f10ec06a400 2023-10-08T16:07:09.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:09.692 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f10d0060580 msgr2=0x7f10d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f10d0060580 0x7f10d0062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f10dc001620 tx=0x7f10dc0014c0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 msgr2=0x7f10ec156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 0x7f10ec156570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10d400ec80 tx=0x7f10d40091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 shutdown_connections 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f10d0060580 0x7f10d0062a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ec158b90 0x7f10ec149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f10ec06a880 0x7f10ec0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 --2- 172.21.15.3:0/1086833999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10ec06a400 0x7f10ec156570 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 >> 172.21.15.3:0/1086833999 conn(0x7f10ec0cfd30 msgr2=0x7f10ec15ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 shutdown_connections 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.690+0000 7f10eb59e700 1 -- 172.21.15.3:0/1086833999 wait complete. 2023-10-08T16:07:09.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:07:09.707 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:09.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.814+0000 7f5373ce3700 1 Processor -- start 2023-10-08T16:07:09.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.814+0000 7f5373ce3700 1 -- start start 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f536c159040 0x7f536c0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f536c159410 0x7f536c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c0cb380 con 0x7f536c0cd420 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536c0b3150 con 0x7f536c159410 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536c06b5e0 con 0x7f536c159040 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f536c159410 0x7f536c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f536c159410 0x7f536c0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41326/0 (socket says 172.21.15.3:41326) 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5371a7f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f536c159040 0x7f536c0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 -- 172.21.15.3:0/4178358024 learned_addr learned my addr 172.21.15.3:0/4178358024 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 -- 172.21.15.3:0/4178358024 >> v2:172.21.15.27:3300/0 conn(0x7f536c159040 msgr2=0x7f536c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 --2- 172.21.15.3:0/4178358024 >> v2:172.21.15.27:3300/0 conn(0x7f536c159040 0x7f536c0b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 -- 172.21.15.3:0/4178358024 >> v1:172.21.15.27:6789/0 conn(0x7f536c0cd420 legacy=0x7f536c06aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 -- 172.21.15.3:0/4178358024 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0caa90 con 0x7f536c159410 2023-10-08T16:07:09.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5372280700 1 --2- 172.21.15.3:0/4178358024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159410 0x7f536c0ce1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f536c069f70 tx=0x7f5364009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1169b4ba22ab6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5370a7d700 1 -- 172.21.15.3:0/4178358024 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536400e070 con 0x7f536c159410 2023-10-08T16:07:09.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5370a7d700 1 -- 172.21.15.3:0/4178358024 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536400ba20 con 0x7f536c159410 2023-10-08T16:07:09.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5370a7d700 1 -- 172.21.15.3:0/4178358024 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640092e0 con 0x7f536c159410 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- 172.21.15.3:0/4178358024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159410 msgr2=0x7f536c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 --2- 172.21.15.3:0/4178358024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159410 0x7f536c0ce1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f536c069f70 tx=0x7f5364009840 comp rx=0 tx=0).stop 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- 172.21.15.3:0/4178358024 shutdown_connections 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 --2- 172.21.15.3:0/4178358024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159410 0x7f536c0ce1c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 --2- 172.21.15.3:0/4178358024 >> v2:172.21.15.27:3300/0 conn(0x7f536c159040 0x7f536c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- 172.21.15.3:0/4178358024 >> 172.21.15.3:0/4178358024 conn(0x7f536c0d0920 msgr2=0x7f536c0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- 172.21.15.3:0/4178358024 shutdown_connections 2023-10-08T16:07:09.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.818+0000 7f5373ce3700 1 -- 172.21.15.3:0/4178358024 wait complete. 2023-10-08T16:07:09.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 Processor -- start 2023-10-08T16:07:09.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 -- start start 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f536c0cd420 0x7f536c0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 0x7f536c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f536c0c96a0 0x7f536c1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c0c9e60 con 0x7f536c159040 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c0c7440 con 0x7f536c0c96a0 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5373ce3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c0c9b80 con 0x7f536c0cd420 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f537127e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 0x7f536c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5371a7f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f536c0cd420 0x7f536c0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f537127e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 0x7f536c155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41340/0 (socket says 172.21.15.3:41340) 2023-10-08T16:07:09.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f537127e700 1 -- 172.21.15.3:0/1892013043 learned_addr learned my addr 172.21.15.3:0/1892013043 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:09.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f5372280700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f536c0c96a0 0x7f536c1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.822+0000 7f537127e700 1 -- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f536c0cd420 msgr2=0x7f536c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f537127e700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f536c0cd420 0x7f536c0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f537127e700 1 -- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f536c0c96a0 msgr2=0x7f536c1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f537127e700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f536c0c96a0 0x7f536c1525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f537127e700 1 -- 172.21.15.3:0/1892013043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364009ae0 con 0x7f536c159040 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f537127e700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 0x7f536c155170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f536800c590 tx=0x7f5368007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368011590 con 0x7f536c159040 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5368011710 con 0x7f536c159040 2023-10-08T16:07:09.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c15a910 con 0x7f536c159040 2023-10-08T16:07:09.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368011ad0 con 0x7f536c159040 2023-10-08T16:07:09.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c15aed0 con 0x7f536c159040 2023-10-08T16:07:09.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c15b0c0 con 0x7f536c159040 2023-10-08T16:07:09.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.826+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f536801b3b0 con 0x7f536c159040 2023-10-08T16:07:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.830+0000 7f5361ffb700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5350060550 0x7f5350062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.830+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f536807baf0 con 0x7f536c159040 2023-10-08T16:07:09.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.830+0000 7f5371a7f700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5350060550 0x7f5350062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.830+0000 7f5371a7f700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5350060550 0x7f5350062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f535c009db0 tx=0x7f535c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.834+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f536804c0e0 con 0x7f536c159040 2023-10-08T16:07:10.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.998+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f536c071180 con 0x7f536c159040 2023-10-08T16:07:10.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:09.998+0000 7f5361ffb700 1 -- 172.21.15.3:0/1892013043 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5368017020 con 0x7f536c159040 2023-10-08T16:07:10.003 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:07:10.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5350060550 msgr2=0x7f5350062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5350060550 0x7f5350062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f535c009db0 tx=0x7f535c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 msgr2=0x7f536c155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 0x7f536c155170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f536800c590 tx=0x7f5368007f50 comp rx=0 tx=0).stop 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 shutdown_connections 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5350060550 0x7f5350062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f536c0c96a0 0x7f536c1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f536c159040 0x7f536c155170 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 --2- 172.21.15.3:0/1892013043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f536c0cd420 0x7f536c0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 >> 172.21.15.3:0/1892013043 conn(0x7f536c0d0920 msgr2=0x7f536c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 shutdown_connections 2023-10-08T16:07:10.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.002+0000 7f5373ce3700 1 -- 172.21.15.3:0/1892013043 wait complete. 2023-10-08T16:07:10.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:07:10.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 Processor -- start 2023-10-08T16:07:10.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 -- start start 2023-10-08T16:07:10.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcdf415ca70 0x7fcdf415c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcdf40ac670 0x7fcdf40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40c7700 con 0x7fcdf415bf50 2023-10-08T16:07:10.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf40cad30 con 0x7fcdf40ac670 2023-10-08T16:07:10.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.122+0000 7fcdf359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf40c8200 con 0x7fcdf415ca70 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf2d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcdf40ac670 0x7fcdf40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf259c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcdf415bf50 0x7fcdf40c6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53232/0 (socket says 172.21.15.3:53232) 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf259c700 1 -- 172.21.15.3:0/456830400 learned_addr learned my addr 172.21.15.3:0/456830400 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf1d9b700 1 --2- 172.21.15.3:0/456830400 >> v2:172.21.15.27:3300/0 conn(0x7fcdf415ca70 0x7fcdf415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf2d9d700 1 -- 172.21.15.3:0/456830400 >> v2:172.21.15.27:3300/0 conn(0x7fcdf415ca70 msgr2=0x7fcdf415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf2d9d700 1 --2- 172.21.15.3:0/456830400 >> v2:172.21.15.27:3300/0 conn(0x7fcdf415ca70 0x7fcdf415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf159a700 1 -- 172.21.15.3:0/456830400 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258026769 0 0) 0x7fcdf40c7700 con 0x7fcdf415bf50 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf2d9d700 1 -- 172.21.15.3:0/456830400 >> v1:172.21.15.3:6789/0 conn(0x7fcdf415bf50 legacy=0x7fcdf40c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf2d9d700 1 -- 172.21.15.3:0/456830400 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40c7960 con 0x7fcdf40ac670 2023-10-08T16:07:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf2d9d700 1 --2- 172.21.15.3:0/456830400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf40ac670 0x7fcdf40c91b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40cae70 tx=0x7fcdec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17755a0fd537a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf159a700 1 -- 172.21.15.3:0/456830400 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec016070 con 0x7fcdf40ac670 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf159a700 1 -- 172.21.15.3:0/456830400 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec00bb30 con 0x7fcdf40ac670 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf159a700 1 -- 172.21.15.3:0/456830400 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00e070 con 0x7fcdf40ac670 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 -- 172.21.15.3:0/456830400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf40ac670 msgr2=0x7fcdf40c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 --2- 172.21.15.3:0/456830400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf40ac670 0x7fcdf40c91b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40cae70 tx=0x7fcdec009780 comp rx=0 tx=0).stop 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 -- 172.21.15.3:0/456830400 shutdown_connections 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 --2- 172.21.15.3:0/456830400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf40ac670 0x7fcdf40c91b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 --2- 172.21.15.3:0/456830400 >> v2:172.21.15.27:3300/0 conn(0x7fcdf415ca70 0x7fcdf415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 -- 172.21.15.3:0/456830400 >> 172.21.15.3:0/456830400 conn(0x7fcdf406b4f0 msgr2=0x7fcdf406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 -- 172.21.15.3:0/456830400 shutdown_connections 2023-10-08T16:07:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.126+0000 7fcdf359e700 1 -- 172.21.15.3:0/456830400 wait complete. 2023-10-08T16:07:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 Processor -- start 2023-10-08T16:07:10.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 -- start start 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 0x7fcdf414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcdf415bf50 0x7fcdf40a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 0x7fcdf40c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40b0800 con 0x7fcdf415ca70 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40b1380 con 0x7fcdf40ac670 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40b0a50 con 0x7fcdf415bf50 2023-10-08T16:07:10.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf2d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 0x7fcdf40c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 0x7fcdf414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 0x7fcdf414a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:57206/0 (socket says 172.21.15.3:57206) 2023-10-08T16:07:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 -- 172.21.15.3:0/2248101793 learned_addr learned my addr 172.21.15.3:0/2248101793 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf2d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 0x7fcdf40c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41362/0 (socket says 172.21.15.3:41362) 2023-10-08T16:07:10.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf1d9b700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcdf415bf50 0x7fcdf40a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 -- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcdf415bf50 msgr2=0x7fcdf40a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcdf415bf50 0x7fcdf40a9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 -- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 msgr2=0x7fcdf40c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 0x7fcdf40c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 -- 172.21.15.3:0/2248101793 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec009a20 con 0x7fcdf40ac670 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf2d9d700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 0x7fcdf40c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf259c700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 0x7fcdf414a140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcde800c7e0 tx=0x7fcde8007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8005b30 con 0x7fcdf40ac670 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8005c90 con 0x7fcdf40ac670 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40b0d30 con 0x7fcdf40ac670 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8007300 con 0x7fcdf40ac670 2023-10-08T16:07:10.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.130+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf414a680 con 0x7fcdf40ac670 2023-10-08T16:07:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.134+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf404be40 con 0x7fcdf40ac670 2023-10-08T16:07:10.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.134+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcde8033a20 con 0x7fcdf40ac670 2023-10-08T16:07:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.134+0000 7fcde27fc700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcdd4060580 0x7fcdd4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.134+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcde807bc60 con 0x7fcdf40ac670 2023-10-08T16:07:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.134+0000 7fcdf1d9b700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcdd4060580 0x7fcdd4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.138+0000 7fcdf1d9b700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcdd4060580 0x7fcdd4062a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcdf416c300 tx=0x7fcde40091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.146+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcde804c2d0 con 0x7fcdf40ac670 2023-10-08T16:07:10.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.310+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdf40c7c40 con 0x7fcdf40ac670 2023-10-08T16:07:10.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.310+0000 7fcde27fc700 1 -- 172.21.15.3:0/2248101793 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcde8001d60 con 0x7fcdf40ac670 2023-10-08T16:07:10.315 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:07:10.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcdd4060580 msgr2=0x7fcdd4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcdd4060580 0x7fcdd4062a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcdf416c300 tx=0x7fcde40091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 msgr2=0x7fcdf414a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 0x7fcdf414a140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcde800c7e0 tx=0x7fcde8007df0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 shutdown_connections 2023-10-08T16:07:10.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcdd4060580 0x7fcdd4062a30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf415ca70 0x7fcdf40c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcdf415bf50 0x7fcdf40a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 --2- 172.21.15.3:0/2248101793 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf40ac670 0x7fcdf414a140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 >> 172.21.15.3:0/2248101793 conn(0x7fcdf406b4f0 msgr2=0x7fcdf4067b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 shutdown_connections 2023-10-08T16:07:10.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.314+0000 7fcdf359e700 1 -- 172.21.15.3:0/2248101793 wait complete. 2023-10-08T16:07:10.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:07:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.446+0000 7fa291e73700 1 Processor -- start 2023-10-08T16:07:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.446+0000 7fa291e73700 1 -- start start 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa291e73700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa28c158510 0x7fa28c0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa291e73700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c068200 0x7fa28c068660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa291e73700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c068ba0 con 0x7fa28c1588e0 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa291e73700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0af9d0 con 0x7fa28c158510 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa291e73700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0b0ef0 con 0x7fa28c068200 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa28c158510 0x7fa28c0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa28c158510 0x7fa28c0afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41364/0 (socket says 172.21.15.3:41364) 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa283fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa28c1588e0 0x7fa28c0b04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53238/0 (socket says 172.21.15.3:53238) 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 -- 172.21.15.3:0/2083729053 learned_addr learned my addr 172.21.15.3:0/2083729053 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:10.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa291672700 1 --2- 172.21.15.3:0/2083729053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c068200 0x7fa28c068660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 -- 172.21.15.3:0/2083729053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c068200 msgr2=0x7fa28c068660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:10.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 --2- 172.21.15.3:0/2083729053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c068200 0x7fa28c068660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 -- 172.21.15.3:0/2083729053 >> v1:172.21.15.3:6789/0 conn(0x7fa28c1588e0 legacy=0x7fa28c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 -- 172.21.15.3:0/2083729053 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0af0a0 con 0x7fa28c158510 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa2837fe700 1 -- 172.21.15.3:0/2083729053 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325718860 0 0) 0x7fa27c001110 con 0x7fa28c1588e0 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa290e71700 1 --2- 172.21.15.3:0/2083729053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c0afe60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2880099b0 tx=0x7fa288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db6bebe3a7015b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa2837fe700 1 -- 172.21.15.3:0/2083729053 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288009ea0 con 0x7fa28c158510 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa2837fe700 1 -- 172.21.15.3:0/2083729053 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800b860 con 0x7fa28c158510 2023-10-08T16:07:10.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.450+0000 7fa2837fe700 1 -- 172.21.15.3:0/2083729053 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800bc00 con 0x7fa28c158510 2023-10-08T16:07:10.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- 172.21.15.3:0/2083729053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 msgr2=0x7fa28c0afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 --2- 172.21.15.3:0/2083729053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c0afe60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2880099b0 tx=0x7fa288009250 comp rx=0 tx=0).stop 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- 172.21.15.3:0/2083729053 shutdown_connections 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 --2- 172.21.15.3:0/2083729053 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c068200 0x7fa28c068660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 --2- 172.21.15.3:0/2083729053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c0afe60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- 172.21.15.3:0/2083729053 >> 172.21.15.3:0/2083729053 conn(0x7fa28c067b30 msgr2=0x7fa28c0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- 172.21.15.3:0/2083729053 shutdown_connections 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- 172.21.15.3:0/2083729053 wait complete. 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 Processor -- start 2023-10-08T16:07:10.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- start start 2023-10-08T16:07:10.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa28c068200 0x7fa28c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c1588e0 0x7fa28c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0c6310 con 0x7fa28c158510 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0c7150 con 0x7fa28c068200 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291e73700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c159c70 con 0x7fa28c1588e0 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291672700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c1588e0 0x7fa28c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa290e71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa28c068200 0x7fa28c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa283fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa290e71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa28c068200 0x7fa28c0c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:57220/0 (socket says 172.21.15.3:57220) 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa291672700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c1588e0 0x7fa28c156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:46908/0 (socket says 172.21.15.3:46908) 2023-10-08T16:07:10.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa283fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41374/0 (socket says 172.21.15.3:41374) 2023-10-08T16:07:10.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.454+0000 7fa290e71700 1 -- 172.21.15.3:0/1891378959 learned_addr learned my addr 172.21.15.3:0/1891378959 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa283fff700 1 -- 172.21.15.3:0/1891378959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c1588e0 msgr2=0x7fa28c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa283fff700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c1588e0 0x7fa28c156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa283fff700 1 -- 172.21.15.3:0/1891378959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa28c068200 msgr2=0x7fa28c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa283fff700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa28c068200 0x7fa28c0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa283fff700 1 -- 172.21.15.3:0/1891378959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880094f0 con 0x7fa28c158510 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa283fff700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c153f90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c840 tx=0x7fa27c007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c005a70 con 0x7fa28c158510 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c005bd0 con 0x7fa28c158510 2023-10-08T16:07:10.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c0c5a70 con 0x7fa28c158510 2023-10-08T16:07:10.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0070d0 con 0x7fa28c158510 2023-10-08T16:07:10.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0c6030 con 0x7fa28c158510 2023-10-08T16:07:10.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c04be40 con 0x7fa28c158510 2023-10-08T16:07:10.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.458+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa27c007480 con 0x7fa28c158510 2023-10-08T16:07:10.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.462+0000 7fa280ff9700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa278060550 0x7fa278062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.462+0000 7fa290e71700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa278060550 0x7fa278062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.462+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa27c0503e0 con 0x7fa28c158510 2023-10-08T16:07:10.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.462+0000 7fa290e71700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa278060550 0x7fa278062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa288003080 tx=0x7fa288017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.470+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa27c04bfe0 con 0x7fa28c158510 2023-10-08T16:07:10.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.626+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa28c068ba0 con 0x7fa28c158510 2023-10-08T16:07:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.626+0000 7fa280ff9700 1 -- 172.21.15.3:0/1891378959 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa28c068ba0 con 0x7fa28c158510 2023-10-08T16:07:10.632 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:07:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa278060550 msgr2=0x7fa278062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa278060550 0x7fa278062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa288003080 tx=0x7fa288017000 comp rx=0 tx=0).stop 2023-10-08T16:07:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 msgr2=0x7fa28c153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c153f90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c840 tx=0x7fa27c007b90 comp rx=0 tx=0).stop 2023-10-08T16:07:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 shutdown_connections 2023-10-08T16:07:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa278060550 0x7fa278062a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa28c1588e0 0x7fa28c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa28c158510 0x7fa28c153f90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 --2- 172.21.15.3:0/1891378959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa28c068200 0x7fa28c0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 >> 172.21.15.3:0/1891378959 conn(0x7fa28c067b30 msgr2=0x7fa28c0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 shutdown_connections 2023-10-08T16:07:10.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.630+0000 7fa291e73700 1 -- 172.21.15.3:0/1891378959 wait complete. 2023-10-08T16:07:10.651 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.750+0000 7f0afcda9700 1 Processor -- start 2023-10-08T16:07:10.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- start start 2023-10-08T16:07:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0af815ce10 0x7f0af8068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0af815d1e0 0x7f0af81589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af80690d0 con 0x7f0af80675f0 2023-10-08T16:07:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af8067a60 con 0x7f0af815ce10 2023-10-08T16:07:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af8067d40 con 0x7f0af815d1e0 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0af815ce10 0x7f0af8068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af6ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0af80675f0 0x7f0af80cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53244/0 (socket says 172.21.15.3:53244) 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af6ffd700 1 -- 172.21.15.3:0/3360226823 learned_addr learned my addr 172.21.15.3:0/3360226823 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af7fff700 1 --2- 172.21.15.3:0/3360226823 >> v2:172.21.15.27:3300/0 conn(0x7f0af815d1e0 0x7f0af81589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af77fe700 1 -- 172.21.15.3:0/3360226823 >> v2:172.21.15.27:3300/0 conn(0x7f0af815d1e0 msgr2=0x7f0af81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af77fe700 1 --2- 172.21.15.3:0/3360226823 >> v2:172.21.15.27:3300/0 conn(0x7f0af815d1e0 0x7f0af81589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af67fc700 1 -- 172.21.15.3:0/3360226823 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263347695 0 0) 0x7f0aec001110 con 0x7f0af80675f0 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af77fe700 1 -- 172.21.15.3:0/3360226823 >> v1:172.21.15.3:6789/0 conn(0x7f0af80675f0 legacy=0x7f0af80cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af77fe700 1 -- 172.21.15.3:0/3360226823 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8068020 con 0x7f0af815ce10 2023-10-08T16:07:10.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af77fe700 1 --2- 172.21.15.3:0/3360226823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af815ce10 0x7f0af8068b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0af80ccd90 tx=0x7f0ae80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2906f13fe97629e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af67fc700 1 -- 172.21.15.3:0/3360226823 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8011630 con 0x7f0af815ce10 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af67fc700 1 -- 172.21.15.3:0/3360226823 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8011790 con 0x7f0af815ce10 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0af67fc700 1 -- 172.21.15.3:0/3360226823 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8011b30 con 0x7f0af815ce10 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- 172.21.15.3:0/3360226823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af815ce10 msgr2=0x7f0af8068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3360226823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af815ce10 0x7f0af8068b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0af80ccd90 tx=0x7f0ae80091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- 172.21.15.3:0/3360226823 shutdown_connections 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3360226823 >> v2:172.21.15.27:3300/0 conn(0x7f0af815d1e0 0x7f0af81589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3360226823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af815ce10 0x7f0af8068b00 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0af80ccd90 tx=0x7f0ae80091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- 172.21.15.3:0/3360226823 >> 172.21.15.3:0/3360226823 conn(0x7f0af80cdb50 msgr2=0x7f0af80cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- 172.21.15.3:0/3360226823 shutdown_connections 2023-10-08T16:07:10.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.754+0000 7f0afcda9700 1 -- 172.21.15.3:0/3360226823 wait complete. 2023-10-08T16:07:10.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.758+0000 7f0afcda9700 1 Processor -- start 2023-10-08T16:07:10.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.758+0000 7f0afcda9700 1 -- start start 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0af80675f0 0x7f0af814bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0af815d1e0 0x7f0af814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 0x7f0af80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af814c260 con 0x7f0af8150240 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80c5d80 con 0x7f0af80675f0 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af814dcd0 con 0x7f0af815d1e0 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 0x7f0af80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0af80675f0 0x7f0af814bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 0x7f0af80b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41392/0 (socket says 172.21.15.3:41392) 2023-10-08T16:07:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0af80675f0 0x7f0af814bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:57234/0 (socket says 172.21.15.3:57234) 2023-10-08T16:07:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 -- 172.21.15.3:0/3788518122 learned_addr learned my addr 172.21.15.3:0/3788518122 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:10.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af6ffd700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0af815d1e0 0x7f0af814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 -- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0af815d1e0 msgr2=0x7f0af814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0af815d1e0 0x7f0af814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 -- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0af80675f0 msgr2=0x7f0af814bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0af80675f0 0x7f0af814bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 -- 172.21.15.3:0/3788518122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009420 con 0x7f0af8150240 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0af7fff700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 0x7f0af80b08f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009df0 tx=0x7f0af000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000caa0 con 0x7f0af8150240 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000f040 con 0x7f0af8150240 2023-10-08T16:07:10.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af814dfb0 con 0x7f0af8150240 2023-10-08T16:07:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000ce70 con 0x7f0af8150240 2023-10-08T16:07:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.762+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af814e570 con 0x7f0af8150240 2023-10-08T16:07:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.766+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0af0014690 con 0x7f0af8150240 2023-10-08T16:07:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.766+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af80c5f80 con 0x7f0af8150240 2023-10-08T16:07:10.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.766+0000 7f0adf7fe700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0ae4060550 0x7f0ae4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.766+0000 7f0af77fe700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0ae4060550 0x7f0ae4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.766+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0af007d290 con 0x7f0af8150240 2023-10-08T16:07:10.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.766+0000 7f0af77fe700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0ae4060550 0x7f0ae4062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0af80c4bb0 tx=0x7f0ae8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.774+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0af80c5f80 con 0x7f0af8150240 2023-10-08T16:07:10.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.938+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af80c5f40 con 0x7f0af8150240 2023-10-08T16:07:10.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.938+0000 7f0adf7fe700 1 -- 172.21.15.3:0/3788518122 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f0af0051310 con 0x7f0af8150240 2023-10-08T16:07:10.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:10.944 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:10.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0ae4060550 msgr2=0x7f0ae4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0ae4060550 0x7f0ae4062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0af80c4bb0 tx=0x7f0ae8017000 comp rx=0 tx=0).stop 2023-10-08T16:07:10.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 msgr2=0x7f0af80b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 0x7f0af80b08f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009df0 tx=0x7f0af000b040 comp rx=0 tx=0).stop 2023-10-08T16:07:10.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 shutdown_connections 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0ae4060550 0x7f0ae4062a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0af8150240 0x7f0af80b08f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0af815d1e0 0x7f0af814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 --2- 172.21.15.3:0/3788518122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0af80675f0 0x7f0af814bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 >> 172.21.15.3:0/3788518122 conn(0x7f0af80cdb50 msgr2=0x7f0af80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 shutdown_connections 2023-10-08T16:07:10.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:10.942+0000 7f0afcda9700 1 -- 172.21.15.3:0/3788518122 wait complete. 2023-10-08T16:07:10.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:07:10.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.066+0000 7fb63a619700 1 Processor -- start 2023-10-08T16:07:11.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.066+0000 7fb63a619700 1 -- start start 2023-10-08T16:07:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb6340adb20 0x7fb63406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb63415b180 0x7fb6340c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6340c6c30 0x7fb6340ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340c70b0 con 0x7fb63415b180 2023-10-08T16:07:11.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63406d640 con 0x7fb6340adb20 2023-10-08T16:07:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63406e010 con 0x7fb6340c6c30 2023-10-08T16:07:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb63415b180 0x7fb6340c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb63415b180 0x7fb6340c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41394/0 (socket says 172.21.15.3:41394) 2023-10-08T16:07:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 -- 172.21.15.3:0/2599159160 learned_addr learned my addr 172.21.15.3:0/2599159160 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb639617700 1 --2- 172.21.15.3:0/2599159160 >> v2:172.21.15.27:3300/0 conn(0x7fb6340adb20 0x7fb63406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb639e18700 1 --2- 172.21.15.3:0/2599159160 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6340c6c30 0x7fb6340ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 -- 172.21.15.3:0/2599159160 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6340c6c30 msgr2=0x7fb6340ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 --2- 172.21.15.3:0/2599159160 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6340c6c30 0x7fb6340ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 -- 172.21.15.3:0/2599159160 >> v2:172.21.15.27:3300/0 conn(0x7fb6340adb20 msgr2=0x7fb63406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 --2- 172.21.15.3:0/2599159160 >> v2:172.21.15.27:3300/0 conn(0x7fb6340adb20 0x7fb63406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 -- 172.21.15.3:0/2599159160 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634157010 con 0x7fb63415b180 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb638e16700 1 --2- 172.21.15.3:0/2599159160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb63415b180 0x7fb6340c66f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb634068130 tx=0x7fb628009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692541a7755f6504 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb633fff700 1 -- 172.21.15.3:0/2599159160 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800e070 con 0x7fb63415b180 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb633fff700 1 -- 172.21.15.3:0/2599159160 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800b9c0 con 0x7fb63415b180 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb633fff700 1 -- 172.21.15.3:0/2599159160 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280092e0 con 0x7fb63415b180 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- 172.21.15.3:0/2599159160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb63415b180 msgr2=0x7fb6340c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- 172.21.15.3:0/2599159160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb63415b180 0x7fb6340c66f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb634068130 tx=0x7fb628009840 comp rx=0 tx=0).stop 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- 172.21.15.3:0/2599159160 shutdown_connections 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- 172.21.15.3:0/2599159160 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6340c6c30 0x7fb6340ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- 172.21.15.3:0/2599159160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb63415b180 0x7fb6340c66f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 --2- 172.21.15.3:0/2599159160 >> v2:172.21.15.27:3300/0 conn(0x7fb6340adb20 0x7fb63406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- 172.21.15.3:0/2599159160 >> 172.21.15.3:0/2599159160 conn(0x7fb6340c83b0 msgr2=0x7fb6340c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- 172.21.15.3:0/2599159160 shutdown_connections 2023-10-08T16:07:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.070+0000 7fb63a619700 1 -- 172.21.15.3:0/2599159160 wait complete. 2023-10-08T16:07:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 Processor -- start 2023-10-08T16:07:11.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 -- start start 2023-10-08T16:07:11.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 0x7fb63414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6340c6c30 0x7fb63414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb63415b180 0x7fb6340ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6341571a0 con 0x7fb6340adb20 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb634157f90 con 0x7fb6340c6c30 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.074+0000 7fb63a619700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63414dc20 con 0x7fb63415b180 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 0x7fb63414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 0x7fb63414d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41398/0 (socket says 172.21.15.3:41398) 2023-10-08T16:07:11.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 -- 172.21.15.3:0/4186513820 learned_addr learned my addr 172.21.15.3:0/4186513820 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb638e16700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6340c6c30 0x7fb63414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639e18700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb63415b180 0x7fb6340ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 -- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb63415b180 msgr2=0x7fb6340ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb63415b180 0x7fb6340ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 -- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6340c6c30 msgr2=0x7fb63414d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6340c6c30 0x7fb63414d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 -- 172.21.15.3:0/4186513820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009ae0 con 0x7fb6340adb20 2023-10-08T16:07:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb639617700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 0x7fb63414d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb62400ea30 tx=0x7fb624009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400ee70 con 0x7fb6340adb20 2023-10-08T16:07:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400c850 con 0x7fb6340adb20 2023-10-08T16:07:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400cbd0 con 0x7fb6340adb20 2023-10-08T16:07:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb634150d20 con 0x7fb6340adb20 2023-10-08T16:07:11.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb634157430 con 0x7fb6340adb20 2023-10-08T16:07:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63404be40 con 0x7fb6340adb20 2023-10-08T16:07:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.078+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb624013470 con 0x7fb6340adb20 2023-10-08T16:07:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.082+0000 7fb6317fa700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb620060550 0x7fb620062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.082+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb62407cce0 con 0x7fb6340adb20 2023-10-08T16:07:11.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.082+0000 7fb638e16700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb620060550 0x7fb620062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.082+0000 7fb638e16700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb620060550 0x7fb620062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb628009ab0 tx=0x7fb628018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.090+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb62404d2d0 con 0x7fb6340adb20 2023-10-08T16:07:11.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb63406f230 con 0x7fb6340adb20 2023-10-08T16:07:11.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb6317fa700 1 -- 172.21.15.3:0/4186513820 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6240170a0 con 0x7fb6340adb20 2023-10-08T16:07:11.250 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:07:11.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb620060550 msgr2=0x7fb620062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb620060550 0x7fb620062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb628009ab0 tx=0x7fb628018000 comp rx=0 tx=0).stop 2023-10-08T16:07:11.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 msgr2=0x7fb63414d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 0x7fb63414d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb62400ea30 tx=0x7fb624009120 comp rx=0 tx=0).stop 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 shutdown_connections 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb620060550 0x7fb620062a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb63415b180 0x7fb6340ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6340c6c30 0x7fb63414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 --2- 172.21.15.3:0/4186513820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6340adb20 0x7fb63414d1a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.246+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 >> 172.21.15.3:0/4186513820 conn(0x7fb6340c83b0 msgr2=0x7fb6340c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.250+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 shutdown_connections 2023-10-08T16:07:11.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.250+0000 7fb63a619700 1 -- 172.21.15.3:0/4186513820 wait complete. 2023-10-08T16:07:11.264 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:07:11.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.370+0000 7fd34169f700 1 Processor -- start 2023-10-08T16:07:11.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.370+0000 7fd34169f700 1 -- start start 2023-10-08T16:07:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c155ce0 0x7fd33c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd33c1560b0 0x7fd33c0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0afc60 con 0x7fd33c0b12a0 2023-10-08T16:07:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c06c700 con 0x7fd33c1560b0 2023-10-08T16:07:11.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b1740 con 0x7fd33c155ce0 2023-10-08T16:07:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd33c1560b0 0x7fd33c0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd33c1560b0 0x7fd33c0b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41400/0 (socket says 172.21.15.3:41400) 2023-10-08T16:07:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 -- 172.21.15.3:0/922480510 learned_addr learned my addr 172.21.15.3:0/922480510 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:11.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd33affd700 1 --2- 172.21.15.3:0/922480510 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c155ce0 0x7fd33c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 -- 172.21.15.3:0/922480510 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c155ce0 msgr2=0x7fd33c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 --2- 172.21.15.3:0/922480510 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c155ce0 0x7fd33c0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 -- 172.21.15.3:0/922480510 >> v1:172.21.15.27:6789/0 conn(0x7fd33c0b12a0 legacy=0x7fd33c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 -- 172.21.15.3:0/922480510 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0aff40 con 0x7fd33c1560b0 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd333fff700 1 --2- 172.21.15.3:0/922480510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c1560b0 0x7fd33c0b0d60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3240099b0 tx=0x7fd324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216ccc1955e46fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd33a7fc700 1 -- 172.21.15.3:0/922480510 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324009ea0 con 0x7fd33c1560b0 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd33a7fc700 1 -- 172.21.15.3:0/922480510 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400b860 con 0x7fd33c1560b0 2023-10-08T16:07:11.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd33a7fc700 1 -- 172.21.15.3:0/922480510 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400bc00 con 0x7fd33c1560b0 2023-10-08T16:07:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 -- 172.21.15.3:0/922480510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c1560b0 msgr2=0x7fd33c0b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 --2- 172.21.15.3:0/922480510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c1560b0 0x7fd33c0b0d60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3240099b0 tx=0x7fd324009250 comp rx=0 tx=0).stop 2023-10-08T16:07:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 -- 172.21.15.3:0/922480510 shutdown_connections 2023-10-08T16:07:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 --2- 172.21.15.3:0/922480510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c1560b0 0x7fd33c0b0d60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 --2- 172.21.15.3:0/922480510 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c155ce0 0x7fd33c0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.374+0000 7fd34169f700 1 -- 172.21.15.3:0/922480510 >> 172.21.15.3:0/922480510 conn(0x7fd33c06ae00 msgr2=0x7fd33c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 -- 172.21.15.3:0/922480510 shutdown_connections 2023-10-08T16:07:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 -- 172.21.15.3:0/922480510 wait complete. 2023-10-08T16:07:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 Processor -- start 2023-10-08T16:07:11.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 -- start start 2023-10-08T16:07:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd33c0b12a0 0x7fd33c0aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 0x7fd33c159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c1560b0 0x7fd33c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15b0f0 con 0x7fd33c155ce0 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15b3d0 con 0x7fd33c0b12a0 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd34169f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15b6b0 con 0x7fd33c1560b0 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd333fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 0x7fd33c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd333fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 0x7fd33c159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41410/0 (socket says 172.21.15.3:41410) 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd333fff700 1 -- 172.21.15.3:0/475846404 learned_addr learned my addr 172.21.15.3:0/475846404 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.378+0000 7fd33affd700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd33c0b12a0 0x7fd33c0aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd33b7fe700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c1560b0 0x7fd33c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd333fff700 1 -- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c1560b0 msgr2=0x7fd33c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd333fff700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c1560b0 0x7fd33c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd333fff700 1 -- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd33c0b12a0 msgr2=0x7fd33c0aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd333fff700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd33c0b12a0 0x7fd33c0aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd333fff700 1 -- 172.21.15.3:0/475846404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240094f0 con 0x7fd33c155ce0 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd333fff700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 0x7fd33c159210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd324009290 tx=0x7fd324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324000d10 con 0x7fd33c155ce0 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400bbe0 con 0x7fd33c155ce0 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324011670 con 0x7fd33c155ce0 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c158a10 con 0x7fd33c155ce0 2023-10-08T16:07:11.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c16b060 con 0x7fd33c155ce0 2023-10-08T16:07:11.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.382+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c158870 con 0x7fd33c155ce0 2023-10-08T16:07:11.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.386+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd324011aa0 con 0x7fd33c155ce0 2023-10-08T16:07:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.386+0000 7fd332ffd700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd31c060550 0x7fd31c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.386+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd32407df60 con 0x7fd33c155ce0 2023-10-08T16:07:11.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.386+0000 7fd33affd700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd31c060550 0x7fd31c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.386+0000 7fd33affd700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd31c060550 0x7fd31c062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009db0 tx=0x7fd32c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.394+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd33c158870 con 0x7fd33c155ce0 2023-10-08T16:07:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.558+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd33c158870 con 0x7fd33c155ce0 2023-10-08T16:07:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.558+0000 7fd332ffd700 1 -- 172.21.15.3:0/475846404 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd33c158870 con 0x7fd33c155ce0 2023-10-08T16:07:11.562 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:07:11.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd31c060550 msgr2=0x7fd31c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd31c060550 0x7fd31c062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009db0 tx=0x7fd32c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 msgr2=0x7fd33c159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 0x7fd33c159210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd324009290 tx=0x7fd324017000 comp rx=0 tx=0).stop 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 shutdown_connections 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd31c060550 0x7fd31c062a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd33c1560b0 0x7fd33c15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd33c155ce0 0x7fd33c159210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 --2- 172.21.15.3:0/475846404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd33c0b12a0 0x7fd33c0aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 >> 172.21.15.3:0/475846404 conn(0x7fd33c06ae00 msgr2=0x7fd33c0b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 shutdown_connections 2023-10-08T16:07:11.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.562+0000 7fd34169f700 1 -- 172.21.15.3:0/475846404 wait complete. 2023-10-08T16:07:11.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:07:11.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.682+0000 7fcb38547700 1 Processor -- start 2023-10-08T16:07:11.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.682+0000 7fcb38547700 1 -- start start 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159410 0x7fcb300ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb300cb380 con 0x7fcb30159040 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3006b5e0 con 0x7fcb300cd420 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300caa90 con 0x7fcb30159410 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb362e3700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcb30159040 0x7fcb300b2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53250/0 (socket says 172.21.15.3:53250) 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb362e3700 1 -- 172.21.15.3:0/3256729836 learned_addr learned my addr 172.21.15.3:0/3256729836 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:11.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb36ae4700 1 --2- 172.21.15.3:0/3256729836 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159410 0x7fcb300ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453608163 0 0) 0x7fcb300cb380 con 0x7fcb30159040 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb1c003570 con 0x7fcb30159040 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814169936 0 0) 0x7fcb3006b5e0 con 0x7fcb300cd420 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb300cb380 con 0x7fcb300cd420 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb36ae4700 1 -- 172.21.15.3:0/3256729836 >> v1:172.21.15.27:6789/0 conn(0x7fcb300cd420 legacy=0x7fcb3006aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb36ae4700 1 -- 172.21.15.3:0/3256729836 >> v1:172.21.15.3:6789/0 conn(0x7fcb30159040 legacy=0x7fcb300b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb36ae4700 1 -- 172.21.15.3:0/3256729836 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3006b850 con 0x7fcb30159410 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb36ae4700 1 --2- 172.21.15.3:0/3256729836 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159410 0x7fcb300ce1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009e90 tx=0x7fcb28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204e44fde3ee4e36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800e070 con 0x7fcb30159410 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800bb80 con 0x7fcb30159410 2023-10-08T16:07:11.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb352e1700 1 -- 172.21.15.3:0/3256729836 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28012430 con 0x7fcb30159410 2023-10-08T16:07:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- 172.21.15.3:0/3256729836 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159410 msgr2=0x7fcb300ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 --2- 172.21.15.3:0/3256729836 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159410 0x7fcb300ce1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009e90 tx=0x7fcb28009780 comp rx=0 tx=0).stop 2023-10-08T16:07:11.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- 172.21.15.3:0/3256729836 shutdown_connections 2023-10-08T16:07:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 --2- 172.21.15.3:0/3256729836 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159410 0x7fcb300ce1c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- 172.21.15.3:0/3256729836 >> 172.21.15.3:0/3256729836 conn(0x7fcb300d0920 msgr2=0x7fcb300cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.686+0000 7fcb38547700 1 -- 172.21.15.3:0/3256729836 shutdown_connections 2023-10-08T16:07:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 -- 172.21.15.3:0/3256729836 wait complete. 2023-10-08T16:07:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 Processor -- start 2023-10-08T16:07:11.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 -- start start 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb300cd420 0x7fcb3015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159040 0x7fcb300b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 0x7fcb301574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300b41d0 con 0x7fcb3014af60 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300b3360 con 0x7fcb300cd420 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb38547700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300b4660 con 0x7fcb30159040 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb36ae4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 0x7fcb301574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb36ae4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 0x7fcb301574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41418/0 (socket says 172.21.15.3:41418) 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.690+0000 7fcb36ae4700 1 -- 172.21.15.3:0/1024144621 learned_addr learned my addr 172.21.15.3:0/1024144621 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb362e3700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb300cd420 0x7fcb3015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb35ae2700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159040 0x7fcb300b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb36ae4700 1 -- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159040 msgr2=0x7fcb300b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb36ae4700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159040 0x7fcb300b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb36ae4700 1 -- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb300cd420 msgr2=0x7fcb3015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb36ae4700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb300cd420 0x7fcb3015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb36ae4700 1 -- 172.21.15.3:0/1024144621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28009a20 con 0x7fcb3014af60 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb362e3700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb300cd420 0x7fcb3015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:11.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb36ae4700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 0x7fcb301574d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb28013000 tx=0x7fcb28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28012e00 con 0x7fcb3014af60 2023-10-08T16:07:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb300b35c0 con 0x7fcb3014af60 2023-10-08T16:07:11.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2801b630 con 0x7fcb3014af60 2023-10-08T16:07:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2801b9f0 con 0x7fcb3014af60 2023-10-08T16:07:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb300b3b80 con 0x7fcb3014af60 2023-10-08T16:07:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb300b4380 con 0x7fcb3014af60 2023-10-08T16:07:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.694+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcb2801c400 con 0x7fcb3014af60 2023-10-08T16:07:11.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.698+0000 7fcb267fc700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcb14060550 0x7fcb14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.698+0000 7fcb362e3700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcb14060550 0x7fcb14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.698+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb2807e1a0 con 0x7fcb3014af60 2023-10-08T16:07:11.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.698+0000 7fcb362e3700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcb14060550 0x7fcb14062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb200058d0 tx=0x7fcb20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.702+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcb300b4380 con 0x7fcb3014af60 2023-10-08T16:07:11.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.862+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb30071180 con 0x7fcb3014af60 2023-10-08T16:07:11.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.862+0000 7fcb267fc700 1 -- 172.21.15.3:0/1024144621 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb2802a020 con 0x7fcb3014af60 2023-10-08T16:07:11.868 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:07:11.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcb14060550 msgr2=0x7fcb14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcb14060550 0x7fcb14062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb200058d0 tx=0x7fcb20009040 comp rx=0 tx=0).stop 2023-10-08T16:07:11.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 msgr2=0x7fcb301574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 0x7fcb301574d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb28013000 tx=0x7fcb28019000 comp rx=0 tx=0).stop 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 shutdown_connections 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fcb14060550 0x7fcb14062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb3014af60 0x7fcb301574d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fcb30159040 0x7fcb300b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 --2- 172.21.15.3:0/1024144621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb300cd420 0x7fcb3015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 >> 172.21.15.3:0/1024144621 conn(0x7fcb300d0920 msgr2=0x7fcb3014b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 shutdown_connections 2023-10-08T16:07:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.866+0000 7fcb38547700 1 -- 172.21.15.3:0/1024144621 wait complete. 2023-10-08T16:07:11.888 INFO:tasks.cephfs_test_runner:Starting test: test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) Mostly readdir acquires caps faster than the mds recalls, so the cap 2023-10-08T16:07:11.888 INFO:tasks.cephfs_test_runner:test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) 2023-10-08T16:07:11.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2023-10-08T16:07:11.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:11.969 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1eaf1b700 1 Processor -- start 2023-10-08T16:07:11.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1eaf1b700 1 -- start start 2023-10-08T16:07:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1eaf1b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 0x7fe1e41640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1eaf1b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e406e340 con 0x7fe1e40684b0 2023-10-08T16:07:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1eaf1b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e406d730 con 0x7fe1e4068880 2023-10-08T16:07:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1eaf1b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e406da10 con 0x7fe1e40c1fd0 2023-10-08T16:07:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe1e40684b0 0x7fe1e406ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53264/0 (socket says 172.21.15.3:53264) 2023-10-08T16:07:11.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 -- 172.21.15.3:0/1171881810 learned_addr learned my addr 172.21.15.3:0/1171881810 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233095609 0 0) 0x7fe1e406e340 con 0x7fe1e40684b0 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1ea71a700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 0x7fe1e41640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d0003570 con 0x7fe1e40684b0 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473135357 0 0) 0x7fe1d0003570 con 0x7fe1e40684b0 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 msgr2=0x7fe1e41640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 0x7fe1e41640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 >> v1:172.21.15.27:6789/0 conn(0x7fe1e4068880 legacy=0x7fe1e4158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e406dcf0 con 0x7fe1e40684b0 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fe1dc0017f0 con 0x7fe1e40684b0 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 >> v1:172.21.15.3:6789/0 conn(0x7fe1e40684b0 legacy=0x7fe1e406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1d0003a90 0x7fe1d0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0004810 0x7fe1d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 0x7fe1d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e406da10 con 0x7fe1d0003a90 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d000bb90 con 0x7fe1d0004810 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d000bd50 con 0x7fe1e40c1fd0 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1d0003a90 0x7fe1d0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9718700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0004810 0x7fe1d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 -- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 msgr2=0x7fe1d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e40c1fd0 0x7fe1d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 -- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0004810 msgr2=0x7fe1d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0004810 0x7fe1d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9f19700 1 -- 172.21.15.3:0/1171881810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0003570 con 0x7fe1d0003a90 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.990+0000 7fe1e9718700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0004810 0x7fe1d0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1d0003a90 0x7fe1d0003e60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00a950 tx=0x7fe1dc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d658ce7de75996c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0070d0 con 0x7fe1d0003a90 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc007230 con 0x7fe1d0003a90 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1e8f17700 1 -- 172.21.15.3:0/1171881810 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0075f0 con 0x7fe1d0003a90 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/1171881810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1d0003a90 msgr2=0x7fe1d0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/1171881810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1d0003a90 0x7fe1d0003e60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00a950 tx=0x7fe1dc0021f0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1ea71a700 1 -- 172.21.15.3:0/1171881810 reap_dead start 2023-10-08T16:07:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/1171881810 shutdown_connections 2023-10-08T16:07:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/1171881810 >> 172.21.15.3:0/1171881810 conn(0x7fe1e40c8c90 msgr2=0x7fe1e40c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/1171881810 shutdown_connections 2023-10-08T16:07:12.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/1171881810 wait complete. 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 Processor -- start 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.994+0000 7fe1eaf1b700 1 -- start start 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0003a90 0x7fe1e4149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e41596e0 0x7fe1e416a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 0x7fe1e40b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e414a4e0 con 0x7fe1e40b03f0 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415e4d0 con 0x7fe1d0003a90 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415a070 con 0x7fe1e41596e0 2023-10-08T16:07:12.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 0x7fe1e40b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 0x7fe1e40b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41446/0 (socket says 172.21.15.3:41446) 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 -- 172.21.15.3:0/2235689827 learned_addr learned my addr 172.21.15.3:0/2235689827 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0003a90 0x7fe1e4149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1e9718700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e41596e0 0x7fe1e416a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 -- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e41596e0 msgr2=0x7fe1e416a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e41596e0 0x7fe1e416a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 -- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0003a90 msgr2=0x7fe1e4149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0003a90 0x7fe1e4149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 -- 172.21.15.3:0/2235689827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e416a790 con 0x7fe1e40b03f0 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0003a90 0x7fe1e4149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1ea71a700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 0x7fe1e40b0870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40c6c20 tx=0x7fe1e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00125f0 con 0x7fe1e40b03f0 2023-10-08T16:07:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0012750 con 0x7fe1e40b03f0 2023-10-08T16:07:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e4159bc0 con 0x7fe1e40b03f0 2023-10-08T16:07:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0012af0 con 0x7fe1e40b03f0 2023-10-08T16:07:12.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e415a5a0 con 0x7fe1e40b03f0 2023-10-08T16:07:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4159ea0 con 0x7fe1e40b03f0 2023-10-08T16:07:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:11.998+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe1e0013480 con 0x7fe1e40b03f0 2023-10-08T16:07:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.002+0000 7fe1d9ffb700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe1c8060550 0x7fe1c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.002+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1e007c770 con 0x7fe1e40b03f0 2023-10-08T16:07:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.002+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe1c8060550 0x7fe1c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.002+0000 7fe1e9f19700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe1c8060550 0x7fe1c8062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc002230 tx=0x7fe1dc016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.014+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe1e004cd60 con 0x7fe1e40b03f0 2023-10-08T16:07:12.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.238+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) v1 -- 0x7fe1e404be40 con 0x7fe1e40b03f0 2023-10-08T16:07:12.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.490+0000 7fe1d9ffb700 1 -- 172.21.15.3:0/2235689827 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v54) v1 ==== 168+0+0 (secure 0 0 0) 0x7fe1e0050380 con 0x7fe1e40b03f0 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe1c8060550 msgr2=0x7fe1c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe1c8060550 0x7fe1c8062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc002230 tx=0x7fe1dc016000 comp rx=0 tx=0).stop 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 msgr2=0x7fe1e40b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 0x7fe1e40b0870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40c6c20 tx=0x7fe1e0008040 comp rx=0 tx=0).stop 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 shutdown_connections 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe1c8060550 0x7fe1c8062a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e40b03f0 0x7fe1e40b0870 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe1e41596e0 0x7fe1e416a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 --2- 172.21.15.3:0/2235689827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1d0003a90 0x7fe1e4149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 >> 172.21.15.3:0/2235689827 conn(0x7fe1e40c8c90 msgr2=0x7fe1e4157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 shutdown_connections 2023-10-08T16:07:12.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.494+0000 7fe1eaf1b700 1 -- 172.21.15.3:0/2235689827 wait complete. 2023-10-08T16:07:12.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:07:12.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.630+0000 7fa6873f3700 1 Processor -- start 2023-10-08T16:07:12.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.630+0000 7fa6873f3700 1 -- start start 2023-10-08T16:07:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa680158c80 0x7fa68015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6800b37c0 0x7fa6800b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800b4140 con 0x7fa68006db60 2023-10-08T16:07:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68015a060 con 0x7fa6800b37c0 2023-10-08T16:07:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68006bb50 con 0x7fa680158c80 2023-10-08T16:07:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa685bf0700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa68006db60 0x7fa68006b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53276/0 (socket says 172.21.15.3:53276) 2023-10-08T16:07:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa685bf0700 1 -- 172.21.15.3:0/4061678090 learned_addr learned my addr 172.21.15.3:0/4061678090 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa686bf2700 1 --2- 172.21.15.3:0/4061678090 >> v2:172.21.15.27:3300/0 conn(0x7fa6800b37c0 0x7fa6800b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6863f1700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa680158c80 0x7fa68015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa686bf2700 1 -- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa680158c80 msgr2=0x7fa68015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa686bf2700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa680158c80 0x7fa68015d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa686bf2700 1 -- 172.21.15.3:0/4061678090 >> v1:172.21.15.3:6789/0 conn(0x7fa68006db60 legacy=0x7fa68006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa686bf2700 1 -- 172.21.15.3:0/4061678090 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800b45a0 con 0x7fa6800b37c0 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6863f1700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa680158c80 0x7fa68015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6853ef700 1 -- 172.21.15.3:0/4061678090 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772143600 0 0) 0x7fa6800b4140 con 0x7fa68006db60 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa686bf2700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6800b37c0 0x7fa6800b3c00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa678009e60 tx=0x7fa678009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab89da7120c611c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6853ef700 1 -- 172.21.15.3:0/4061678090 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67800e070 con 0x7fa6800b37c0 2023-10-08T16:07:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6853ef700 1 -- 172.21.15.3:0/4061678090 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67800bb60 con 0x7fa6800b37c0 2023-10-08T16:07:12.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6853ef700 1 -- 172.21.15.3:0/4061678090 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678012430 con 0x7fa6800b37c0 2023-10-08T16:07:12.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6800b37c0 msgr2=0x7fa6800b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6800b37c0 0x7fa6800b3c00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa678009e60 tx=0x7fa678009780 comp rx=0 tx=0).stop 2023-10-08T16:07:12.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- 172.21.15.3:0/4061678090 shutdown_connections 2023-10-08T16:07:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6800b37c0 0x7fa6800b3c00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 --2- 172.21.15.3:0/4061678090 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa680158c80 0x7fa68015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- 172.21.15.3:0/4061678090 >> 172.21.15.3:0/4061678090 conn(0x7fa6800d0820 msgr2=0x7fa6800b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- 172.21.15.3:0/4061678090 shutdown_connections 2023-10-08T16:07:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.634+0000 7fa6873f3700 1 -- 172.21.15.3:0/4061678090 wait complete. 2023-10-08T16:07:12.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 Processor -- start 2023-10-08T16:07:12.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 -- start start 2023-10-08T16:07:12.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 0x7fa680145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa6800b37c0 0x7fa68016bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa680158c80 0x7fa68016c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800cdab0 con 0x7fa68006db60 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800cdd90 con 0x7fa680158c80 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6873f3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015a1a0 con 0x7fa6800b37c0 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 0x7fa680145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 0x7fa680145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41456/0 (socket says 172.21.15.3:41456) 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa686bf2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa680158c80 0x7fa68016c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 -- 172.21.15.3:0/3297028689 learned_addr learned my addr 172.21.15.3:0/3297028689 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:12.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa685bf0700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa6800b37c0 0x7fa68016bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 -- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa6800b37c0 msgr2=0x7fa68016bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa6800b37c0 0x7fa68016bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 -- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa680158c80 msgr2=0x7fa68016c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa680158c80 0x7fa68016c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.638+0000 7fa6863f1700 1 -- 172.21.15.3:0/3297028689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009420 con 0x7fa68006db60 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6863f1700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 0x7fa680145120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa67000ec80 tx=0x7fa6700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000c920 con 0x7fa68006db60 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa678009a20 con 0x7fa68006db60 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67000ca80 con 0x7fa68006db60 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68015a760 con 0x7fa68006db60 2023-10-08T16:07:12.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000ce00 con 0x7fa68006db60 2023-10-08T16:07:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa670013680 con 0x7fa68006db60 2023-10-08T16:07:12.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68004be40 con 0x7fa68006db60 2023-10-08T16:07:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6767fc700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa66c060550 0x7fa66c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa67007cbe0 con 0x7fa68006db60 2023-10-08T16:07:12.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.642+0000 7fa685bf0700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa66c060550 0x7fa66c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.646+0000 7fa685bf0700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa66c060550 0x7fa66c062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa680067110 tx=0x7fa67c007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.650+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa67004d1d0 con 0x7fa68006db60 2023-10-08T16:07:12.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.814+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa680068070 con 0x7fa68006db60 2023-10-08T16:07:12.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.822+0000 7fa6767fc700 1 -- 172.21.15.3:0/3297028689 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa670054e60 con 0x7fa68006db60 2023-10-08T16:07:12.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa66c060550 msgr2=0x7fa66c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa66c060550 0x7fa66c062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa680067110 tx=0x7fa67c007f30 comp rx=0 tx=0).stop 2023-10-08T16:07:12.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 msgr2=0x7fa680145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 0x7fa680145120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa67000ec80 tx=0x7fa6700091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 shutdown_connections 2023-10-08T16:07:12.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa66c060550 0x7fa66c062a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa680158c80 0x7fa68016c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa6800b37c0 0x7fa68016bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 --2- 172.21.15.3:0/3297028689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa68006db60 0x7fa680145120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 >> 172.21.15.3:0/3297028689 conn(0x7fa6800d0820 msgr2=0x7fa680067510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 shutdown_connections 2023-10-08T16:07:12.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:12.826+0000 7fa6873f3700 1 -- 172.21.15.3:0/3297028689 wait complete. 2023-10-08T16:07:12.844 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:07:12.844 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:07:12.857 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:07:12.876 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:07:12.877 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-10-08T16:07:12.877 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:07:12.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:12.901 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T16:07:12.901 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:07:12.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:12.902 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:07:12.959 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2023-10-08T16:07:12.959 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:07:12.959 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:12.987 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T16:07:12.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:07:12.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:12.987 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:07:13.046 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-10-08T16:07:13.046 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:07:13.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-08T16:07:13.063 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T16:07:13.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:07:13.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:13.064 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T16:07:13.111 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2023-10-08T16:07:13.111 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:07:13.111 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-08T16:07:13.127 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T16:07:13.128 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:07:13.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:13.128 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T16:07:13.134 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:07:13.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:13.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 Processor -- start 2023-10-08T16:07:13.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 -- start start 2023-10-08T16:07:13.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f86300ca810 0x7f863006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863006cae0 con 0x7f86300adc30 2023-10-08T16:07:13.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863006cdc0 con 0x7f863006ab00 2023-10-08T16:07:13.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863006d0a0 con 0x7f86300ca810 2023-10-08T16:07:13.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86350f2700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f86300adc30 0x7f86300ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53292/0 (socket says 172.21.15.3:53292) 2023-10-08T16:07:13.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86350f2700 1 -- 172.21.15.3:0/2994730869 learned_addr learned my addr 172.21.15.3:0/2994730869 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:13.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86358f3700 1 --2- 172.21.15.3:0/2994730869 >> v2:172.21.15.3:3300/0 conn(0x7f86300ca810 0x7f863006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f862ffff700 1 -- 172.21.15.3:0/2994730869 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598286401 0 0) 0x7f863006cae0 con 0x7f86300adc30 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f862ffff700 1 -- 172.21.15.3:0/2994730869 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c003570 con 0x7f86300adc30 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f862ffff700 1 -- 172.21.15.3:0/2994730869 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2925424400 0 0) 0x7f861c003570 con 0x7f86300adc30 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86358f3700 1 -- 172.21.15.3:0/2994730869 >> v1:172.21.15.27:6789/0 conn(0x7f863006ab00 legacy=0x7f86300c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86358f3700 1 -- 172.21.15.3:0/2994730869 >> v1:172.21.15.3:6789/0 conn(0x7f86300adc30 legacy=0x7f86300ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86358f3700 1 -- 172.21.15.3:0/2994730869 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863006d380 con 0x7f86300ca810 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f86358f3700 1 --2- 172.21.15.3:0/2994730869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863006db80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f86280098e0 tx=0x7f86280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7df6b9fdabd2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f862ffff700 1 -- 172.21.15.3:0/2994730869 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200017f0 con 0x7f86300ca810 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f862ffff700 1 -- 172.21.15.3:0/2994730869 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8628011420 con 0x7f86300ca810 2023-10-08T16:07:13.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f862ffff700 1 -- 172.21.15.3:0/2994730869 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280117c0 con 0x7f86300ca810 2023-10-08T16:07:13.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 -- 172.21.15.3:0/2994730869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 msgr2=0x7f863006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.246+0000 7f8637356700 1 --2- 172.21.15.3:0/2994730869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863006db80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f86280098e0 tx=0x7f86280091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- 172.21.15.3:0/2994730869 shutdown_connections 2023-10-08T16:07:13.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 --2- 172.21.15.3:0/2994730869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863006db80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- 172.21.15.3:0/2994730869 >> 172.21.15.3:0/2994730869 conn(0x7f86300cc5d0 msgr2=0x7f86300c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- 172.21.15.3:0/2994730869 shutdown_connections 2023-10-08T16:07:13.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- 172.21.15.3:0/2994730869 wait complete. 2023-10-08T16:07:13.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 Processor -- start 2023-10-08T16:07:13.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- start start 2023-10-08T16:07:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86300adc30 0x7f86300c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f863015e820 0x7f863015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863015f1c0 con 0x7f86300ca810 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c5270 con 0x7f86300adc30 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f8637356700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c4660 con 0x7f863015e820 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f86348f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f86348f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863014ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41478/0 (socket says 172.21.15.3:41478) 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f86348f1700 1 -- 172.21.15.3:0/195191189 learned_addr learned my addr 172.21.15.3:0/195191189 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f86350f2700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86300adc30 0x7f86300c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.250+0000 7f86358f3700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f863015e820 0x7f863015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86348f1700 1 -- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f863015e820 msgr2=0x7f863015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86348f1700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f863015e820 0x7f863015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86348f1700 1 -- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86300adc30 msgr2=0x7f86300c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86348f1700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86300adc30 0x7f86300c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86348f1700 1 -- 172.21.15.3:0/195191189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009420 con 0x7f86300ca810 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86358f3700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f863015e820 0x7f863015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f86348f1700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863014ef40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f861800c4e0 tx=0x7f861800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618011590 con 0x7f86300ca810 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8618011710 con 0x7f86300ca810 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618011ad0 con 0x7f86300ca810 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300c4940 con 0x7f86300ca810 2023-10-08T16:07:13.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300c4f00 con 0x7f86300ca810 2023-10-08T16:07:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863004be40 con 0x7f86300ca810 2023-10-08T16:07:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f861801b3b0 con 0x7f86300ca810 2023-10-08T16:07:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f862d7fa700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8610060550 0x7f8610062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.254+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f861807bbd0 con 0x7f86300ca810 2023-10-08T16:07:13.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.258+0000 7f86350f2700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8610060550 0x7f8610062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.258+0000 7f86350f2700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8610060550 0x7f8610062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8620001560 tx=0x7f8620000f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.262+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f861804c1c0 con 0x7f86300ca810 2023-10-08T16:07:13.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.462+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86300c53b0 con 0x7f86300ca810 2023-10-08T16:07:13.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f862d7fa700 1 -- 172.21.15.3:0/195191189 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f861804f7e0 con 0x7f86300ca810 2023-10-08T16:07:13.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:13.469 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:07:13.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8610060550 msgr2=0x7f8610062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8610060550 0x7f8610062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8620001560 tx=0x7f8620000f40 comp rx=0 tx=0).stop 2023-10-08T16:07:13.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 msgr2=0x7f863014ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863014ef40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f861800c4e0 tx=0x7f861800c7f0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 shutdown_connections 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8610060550 0x7f8610062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f863015e820 0x7f863015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86300ca810 0x7f863014ef40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 --2- 172.21.15.3:0/195191189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86300adc30 0x7f86300c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 >> 172.21.15.3:0/195191189 conn(0x7f86300cc5d0 msgr2=0x7f863015acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 shutdown_connections 2023-10-08T16:07:13.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.466+0000 7f8637356700 1 -- 172.21.15.3:0/195191189 wait complete. 2023-10-08T16:07:13.473 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:07:13.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.590+0000 7f6af48bd700 1 Processor -- start 2023-10-08T16:07:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.590+0000 7f6af48bd700 1 -- start start 2023-10-08T16:07:13.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d590 0x7f6af0154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6af01553d0 0x7f6af00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af006bb40 con 0x7f6af006d1c0 2023-10-08T16:07:13.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af006ac80 con 0x7f6af01553d0 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af006bfd0 con 0x7f6af006d590 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6af01553d0 0x7f6af00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6af01553d0 0x7f6af00c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41486/0 (socket says 172.21.15.3:41486) 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 -- 172.21.15.3:0/2362849161 learned_addr learned my addr 172.21.15.3:0/2362849161 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6ae7fff700 1 --2- 172.21.15.3:0/2362849161 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d590 0x7f6af0154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 -- 172.21.15.3:0/2362849161 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d590 msgr2=0x7f6af0154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 --2- 172.21.15.3:0/2362849161 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d590 0x7f6af0154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 -- 172.21.15.3:0/2362849161 >> v1:172.21.15.3:6789/0 conn(0x7f6af006d1c0 legacy=0x7f6af006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 -- 172.21.15.3:0/2362849161 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af006af30 con 0x7f6af01553d0 2023-10-08T16:07:13.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aef59e700 1 --2- 172.21.15.3:0/2362849161 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af00c9530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009f20 tx=0x7f6ae8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4842e3c521150 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aee59c700 1 -- 172.21.15.3:0/2362849161 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae800e070 con 0x7f6af01553d0 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aee59c700 1 -- 172.21.15.3:0/2362849161 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae800ba80 con 0x7f6af01553d0 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6aee59c700 1 -- 172.21.15.3:0/2362849161 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80092e0 con 0x7f6af01553d0 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- 172.21.15.3:0/2362849161 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 msgr2=0x7f6af00c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2362849161 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af00c9530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009f20 tx=0x7f6ae8009840 comp rx=0 tx=0).stop 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- 172.21.15.3:0/2362849161 shutdown_connections 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2362849161 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af00c9530 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2362849161 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d590 0x7f6af0154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- 172.21.15.3:0/2362849161 >> 172.21.15.3:0/2362849161 conn(0x7f6af00c83d0 msgr2=0x7f6af00c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- 172.21.15.3:0/2362849161 shutdown_connections 2023-10-08T16:07:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.594+0000 7f6af48bd700 1 -- 172.21.15.3:0/2362849161 wait complete. 2023-10-08T16:07:13.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 Processor -- start 2023-10-08T16:07:13.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 -- start start 2023-10-08T16:07:13.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d1c0 0x7f6af0154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6af006d590 0x7f6af00c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00c3d50 con 0x7f6af01553d0 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00c5820 con 0x7f6af006d590 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0151fd0 con 0x7f6af006d1c0 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af0150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41488/0 (socket says 172.21.15.3:41488) 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 -- 172.21.15.3:0/2184408404 learned_addr learned my addr 172.21.15.3:0/2184408404 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aeed9d700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d1c0 0x7f6af0154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6ae7fff700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6af006d590 0x7f6af00c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 -- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d1c0 msgr2=0x7f6af0154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d1c0 0x7f6af0154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 -- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6af006d590 msgr2=0x7f6af00c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6af006d590 0x7f6af00c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 -- 172.21.15.3:0/2184408404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8009ae0 con 0x7f6af01553d0 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6aef59e700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af0150740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009430 tx=0x7f6ae8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80032f0 con 0x7f6af01553d0 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae8008d10 con 0x7f6af01553d0 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af01516a0 con 0x7f6af01553d0 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8026670 con 0x7f6af01553d0 2023-10-08T16:07:13.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.598+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af0151c60 con 0x7f6af01553d0 2023-10-08T16:07:13.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.602+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af0152160 con 0x7f6af01553d0 2023-10-08T16:07:13.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.602+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6ae8003040 con 0x7f6af01553d0 2023-10-08T16:07:13.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.602+0000 7f6ae6ffd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6ad4060550 0x7f6ad4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.602+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ae807e7a0 con 0x7f6af01553d0 2023-10-08T16:07:13.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.602+0000 7f6aeed9d700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6ad4060550 0x7f6ad4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.606+0000 7f6aeed9d700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6ad4060550 0x7f6ad4062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00039e0 tx=0x7f6ae0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.610+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ae804ee40 con 0x7f6af01553d0 2023-10-08T16:07:13.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.770+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6af004be40 con 0x7f6af01553d0 2023-10-08T16:07:13.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6ae6ffd700 1 -- 172.21.15.3:0/2184408404 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f6ae8052460 con 0x7f6af01553d0 2023-10-08T16:07:13.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:13.778 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6ad4060550 msgr2=0x7f6ad4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6ad4060550 0x7f6ad4062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00039e0 tx=0x7f6ae0007ec0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 msgr2=0x7f6af0150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af0150740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009430 tx=0x7f6ae8018000 comp rx=0 tx=0).stop 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 shutdown_connections 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6ad4060550 0x7f6ad4062a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6af01553d0 0x7f6af0150740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6af006d590 0x7f6af00c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 --2- 172.21.15.3:0/2184408404 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6af006d1c0 0x7f6af0154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 >> 172.21.15.3:0/2184408404 conn(0x7f6af00c83d0 msgr2=0x7f6af00c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 shutdown_connections 2023-10-08T16:07:13.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.774+0000 7f6af48bd700 1 -- 172.21.15.3:0/2184408404 wait complete. 2023-10-08T16:07:13.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:38.142599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:38.623014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:07:13.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:13.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 Processor -- start 2023-10-08T16:07:13.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 -- start start 2023-10-08T16:07:13.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65e80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f65e81560b0 0x7f65e80b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e80afc60 con 0x7f65e80b12a0 2023-10-08T16:07:13.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e806c700 con 0x7f65e81560b0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65ecfdb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80b1740 con 0x7f65e8155ce0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e6d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f65e80b12a0 0x7f65e8159ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53308/0 (socket says 172.21.15.3:53308) 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e6d9d700 1 -- 172.21.15.3:0/2043095094 learned_addr learned my addr 172.21.15.3:0/2043095094 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65dffff700 1 --2- 172.21.15.3:0/2043095094 >> v2:172.21.15.27:3300/0 conn(0x7f65e81560b0 0x7f65e80b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e659c700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65e80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542118914 0 0) 0x7f65e80afc60 con 0x7f65e80b12a0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d4003570 con 0x7f65e80b12a0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 767820718 0 0) 0x7f65d4003570 con 0x7f65e80b12a0 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 msgr2=0x7f65e80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65e80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 >> v2:172.21.15.27:3300/0 conn(0x7f65e81560b0 msgr2=0x7f65e80b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 --2- 172.21.15.3:0/2043095094 >> v2:172.21.15.27:3300/0 conn(0x7f65e81560b0 0x7f65e80b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e80aff40 con 0x7f65e80b12a0 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f65e00017f0 con 0x7f65e80b12a0 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 >> v1:172.21.15.3:6789/0 conn(0x7f65e80b12a0 legacy=0x7f65e8159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65d4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65d4003fe0 0x7f65d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d4004d50 0x7f65d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e806c700 con 0x7f65d4003fe0 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80b1740 con 0x7f65d4004d50 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d400ba90 con 0x7f65e8155ce0 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.906+0000 7f65dffff700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65d4003fe0 0x7f65d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e659c700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65d4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e6d9d700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d4004d50 0x7f65d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65dffff700 1 -- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 msgr2=0x7f65d4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65dffff700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65d4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65dffff700 1 -- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d4004d50 msgr2=0x7f65d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65dffff700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d4004d50 0x7f65d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65dffff700 1 -- 172.21.15.3:0/2043095094 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4003570 con 0x7f65d4003fe0 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e659c700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8155ce0 0x7f65d4003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65dffff700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65d4003fe0 0x7f65d4004810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f65e8156500 tx=0x7f65d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1e53c9e3a6f4bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000e6b0 con 0x7f65d4003fe0 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d000e810 con 0x7f65d4003fe0 2023-10-08T16:07:13.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e5d9b700 1 -- 172.21.15.3:0/2043095094 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000ebd0 con 0x7f65d4003fe0 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 -- 172.21.15.3:0/2043095094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65d4003fe0 msgr2=0x7f65d4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/2043095094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65d4003fe0 0x7f65d4004810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f65e8156500 tx=0x7f65d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65e6d9d700 1 -- 172.21.15.3:0/2043095094 reap_dead start 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 -- 172.21.15.3:0/2043095094 shutdown_connections 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 -- 172.21.15.3:0/2043095094 >> 172.21.15.3:0/2043095094 conn(0x7f65e806ae00 msgr2=0x7f65e806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 -- 172.21.15.3:0/2043095094 shutdown_connections 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 -- 172.21.15.3:0/2043095094 wait complete. 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 Processor -- start 2023-10-08T16:07:13.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.910+0000 7f65ecfdb700 1 -- start start 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8140eb0 0x7f65e8152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e8141280 0x7f65e8152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 0x7f65e8152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e814ef00 con 0x7f65e815b4e0 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e81518c0 con 0x7f65e8141280 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8151ba0 con 0x7f65e8140eb0 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 0x7f65e8152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 0x7f65e8152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41500/0 (socket says 172.21.15.3:41500) 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 -- 172.21.15.3:0/999230927 learned_addr learned my addr 172.21.15.3:0/999230927 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e659c700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8140eb0 0x7f65e8152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65dffff700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e8141280 0x7f65e8152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 -- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8140eb0 msgr2=0x7f65e8152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8140eb0 0x7f65e8152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 -- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e8141280 msgr2=0x7f65e8152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e8141280 0x7f65e8152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 -- 172.21.15.3:0/999230927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8151e80 con 0x7f65e815b4e0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e659c700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8140eb0 0x7f65e8152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65e6d9d700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 0x7f65e8152bc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65e0004c10 tx=0x7f65e0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00133f0 con 0x7f65e815b4e0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0013590 con 0x7f65e815b4e0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e8158bb0 con 0x7f65e815b4e0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0013950 con 0x7f65e815b4e0 2023-10-08T16:07:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e8150580 con 0x7f65e815b4e0 2023-10-08T16:07:13.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e8071180 con 0x7f65e815b4e0 2023-10-08T16:07:13.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.914+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65e0013d00 con 0x7f65e815b4e0 2023-10-08T16:07:13.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.918+0000 7f65de7fc700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f65c8060580 0x7f65c8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.918+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65e007d340 con 0x7f65e815b4e0 2023-10-08T16:07:13.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.918+0000 7f65e659c700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f65c8060580 0x7f65c8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.918+0000 7f65e659c700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f65c8060580 0x7f65c8062a30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006dc0 tx=0x7f65d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:13.926+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65e004d930 con 0x7f65e815b4e0 2023-10-08T16:07:14.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65e80b0220 con 0x7f65e815b4e0 2023-10-08T16:07:14.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65de7fc700 1 -- 172.21.15.3:0/999230927 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65e0050f50 con 0x7f65e815b4e0 2023-10-08T16:07:14.090 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f65c8060580 msgr2=0x7f65c8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f65c8060580 0x7f65c8062a30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006dc0 tx=0x7f65d8008040 comp rx=0 tx=0).stop 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 msgr2=0x7f65e8152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 0x7f65e8152bc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65e0004c10 tx=0x7f65e0002210 comp rx=0 tx=0).stop 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 shutdown_connections 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f65c8060580 0x7f65c8062a30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65e815b4e0 0x7f65e8152bc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e8141280 0x7f65e8152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 --2- 172.21.15.3:0/999230927 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f65e8140eb0 0x7f65e8152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 >> 172.21.15.3:0/999230927 conn(0x7f65e806ae00 msgr2=0x7f65e8068280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 shutdown_connections 2023-10-08T16:07:14.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.086+0000 7f65ecfdb700 1 -- 172.21.15.3:0/999230927 wait complete. 2023-10-08T16:07:14.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:07:14.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 Processor -- start 2023-10-08T16:07:14.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 -- start start 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5c98155080 0x7f5c980c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806aaf0 0x7f5c980c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9806d7a0 con 0x7f5c9806c700 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9806cb90 con 0x7f5c98155080 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9c966700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9806ce70 con 0x7f5c9806aaf0 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5c98155080 0x7f5c980c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806aaf0 0x7f5c980c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5c98155080 0x7f5c980c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:57360/0 (socket says 172.21.15.3:57360) 2023-10-08T16:07:14.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c9659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5c9806c700 0x7f5c9806a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:50724/0 (socket says 172.21.15.3:50724) 2023-10-08T16:07:14.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 -- 172.21.15.3:0/4163305411 learned_addr learned my addr 172.21.15.3:0/4163305411 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:14.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 -- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806aaf0 msgr2=0x7f5c980c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 --2- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806aaf0 0x7f5c980c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 -- 172.21.15.3:0/4163305411 >> v1:172.21.15.27:6789/0 conn(0x7f5c9806c700 legacy=0x7f5c9806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 -- 172.21.15.3:0/4163305411 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9806d150 con 0x7f5c98155080 2023-10-08T16:07:14.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c96d9d700 1 --2- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c98155080 0x7f5c980c7b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009990 tx=0x7f5c8c009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c1dc5533c96de42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c95d9b700 1 -- 172.21.15.3:0/4163305411 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c009e80 con 0x7f5c98155080 2023-10-08T16:07:14.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c95d9b700 1 -- 172.21.15.3:0/4163305411 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c005c10 con 0x7f5c98155080 2023-10-08T16:07:14.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.214+0000 7f5c95d9b700 1 -- 172.21.15.3:0/4163305411 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00b650 con 0x7f5c98155080 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c98155080 msgr2=0x7f5c980c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 --2- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c98155080 0x7f5c980c7b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009990 tx=0x7f5c8c009220 comp rx=0 tx=0).stop 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- 172.21.15.3:0/4163305411 shutdown_connections 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 --2- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806aaf0 0x7f5c980c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 --2- 172.21.15.3:0/4163305411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c98155080 0x7f5c980c7b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- 172.21.15.3:0/4163305411 >> 172.21.15.3:0/4163305411 conn(0x7f5c980c83b0 msgr2=0x7f5c980c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- 172.21.15.3:0/4163305411 shutdown_connections 2023-10-08T16:07:14.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- 172.21.15.3:0/4163305411 wait complete. 2023-10-08T16:07:14.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 Processor -- start 2023-10-08T16:07:14.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- start start 2023-10-08T16:07:14.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c9806aaf0 0x7f5c980c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806c700 0x7f5c9816c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 0x7f5c98159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c980c3770 con 0x7f5c98155080 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9816cee0 con 0x7f5c9806aaf0 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.218+0000 7f5c9c966700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9816d0f0 con 0x7f5c9806c700 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 0x7f5c98159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 0x7f5c98159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41512/0 (socket says 172.21.15.3:41512) 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 -- 172.21.15.3:0/2498214307 learned_addr learned my addr 172.21.15.3:0/2498214307 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c96d9d700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c9806aaf0 0x7f5c980c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9659c700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806c700 0x7f5c9816c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 -- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806c700 msgr2=0x7f5c9816c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806c700 0x7f5c9816c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 -- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c9806aaf0 msgr2=0x7f5c980c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c9806aaf0 0x7f5c980c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 -- 172.21.15.3:0/2498214307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009480 con 0x7f5c98155080 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9759e700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 0x7f5c98159030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d40 tx=0x7f5c9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90009ea0 con 0x7f5c98155080 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9000f040 con 0x7f5c98155080 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9816d3d0 con 0x7f5c98155080 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000ccf0 con 0x7f5c98155080 2023-10-08T16:07:14.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c98159570 con 0x7f5c98155080 2023-10-08T16:07:14.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c980c34d0 con 0x7f5c98155080 2023-10-08T16:07:14.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5c90014690 con 0x7f5c98155080 2023-10-08T16:07:14.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c7effd700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5c84060550 0x7f5c84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c9007d1f0 con 0x7f5c98155080 2023-10-08T16:07:14.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.222+0000 7f5c96d9d700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5c84060550 0x7f5c84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.226+0000 7f5c96d9d700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5c84060550 0x7f5c84062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c007fd0 tx=0x7f5c8c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.226+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c980c34d0 con 0x7f5c98155080 2023-10-08T16:07:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.386+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c980c38b0 con 0x7f5c98155080 2023-10-08T16:07:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.386+0000 7f5c7effd700 1 -- 172.21.15.3:0/2498214307 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c980c38b0 con 0x7f5c98155080 2023-10-08T16:07:14.391 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5c84060550 msgr2=0x7f5c84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5c84060550 0x7f5c84062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c007fd0 tx=0x7f5c8c016000 comp rx=0 tx=0).stop 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 msgr2=0x7f5c98159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 0x7f5c98159030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d40 tx=0x7f5c9000b040 comp rx=0 tx=0).stop 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 shutdown_connections 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5c84060550 0x7f5c84062a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c98155080 0x7f5c98159030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5c9806c700 0x7f5c9816c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 --2- 172.21.15.3:0/2498214307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c9806aaf0 0x7f5c980c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 >> 172.21.15.3:0/2498214307 conn(0x7f5c980c83b0 msgr2=0x7f5c980c1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 shutdown_connections 2023-10-08T16:07:14.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.390+0000 7f5c9c966700 1 -- 172.21.15.3:0/2498214307 wait complete. 2023-10-08T16:07:14.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:07:14.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd5114d700 1 Processor -- start 2023-10-08T16:07:14.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd5114d700 1 -- start start 2023-10-08T16:07:14.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd5114d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd5114d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0cb380 con 0x7efd4c159410 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd5114d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0caa90 con 0x7efd4c159040 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd5114d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c06b850 con 0x7efd4c0cd420 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4b59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7efd4c159410 0x7efd4c0ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53316/0 (socket says 172.21.15.3:53316) 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4b59e700 1 -- 172.21.15.3:0/210678109 learned_addr learned my addr 172.21.15.3:0/210678109 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4a59c700 1 --2- 172.21.15.3:0/210678109 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384512631 0 0) 0x7efd4c0cb380 con 0x7efd4c159410 2023-10-08T16:07:14.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd38003570 con 0x7efd4c159410 2023-10-08T16:07:14.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440901360 0 0) 0x7efd4c0caa90 con 0x7efd4c159040 2023-10-08T16:07:14.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd4c0cb380 con 0x7efd4c159040 2023-10-08T16:07:14.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4a59c700 1 -- 172.21.15.3:0/210678109 >> v1:172.21.15.27:6789/0 conn(0x7efd4c159040 legacy=0x7efd4c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4a59c700 1 -- 172.21.15.3:0/210678109 >> v1:172.21.15.3:6789/0 conn(0x7efd4c159410 legacy=0x7efd4c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4a59c700 1 -- 172.21.15.3:0/210678109 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0cad30 con 0x7efd4c0cd420 2023-10-08T16:07:14.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd4a59c700 1 --2- 172.21.15.3:0/210678109 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c06aed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd34009910 tx=0x7efd340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ae4a9a9e90f5da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34011630 con 0x7efd4c0cd420 2023-10-08T16:07:14.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd34011790 con 0x7efd4c0cd420 2023-10-08T16:07:14.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.514+0000 7efd49d9b700 1 -- 172.21.15.3:0/210678109 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34011b30 con 0x7efd4c0cd420 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- 172.21.15.3:0/210678109 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 msgr2=0x7efd4c06aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 --2- 172.21.15.3:0/210678109 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c06aed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd34009910 tx=0x7efd340091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- 172.21.15.3:0/210678109 shutdown_connections 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 --2- 172.21.15.3:0/210678109 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c06aed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- 172.21.15.3:0/210678109 >> 172.21.15.3:0/210678109 conn(0x7efd4c0d0920 msgr2=0x7efd4c0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- 172.21.15.3:0/210678109 shutdown_connections 2023-10-08T16:07:14.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- 172.21.15.3:0/210678109 wait complete. 2023-10-08T16:07:14.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 Processor -- start 2023-10-08T16:07:14.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- start start 2023-10-08T16:07:14.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c0b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 0x7efd4c146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd4c0c6f00 0x7efd4c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b57b0 con 0x7efd4c159040 2023-10-08T16:07:14.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b4870 con 0x7efd4c0c6f00 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd5114d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b4ba0 con 0x7efd4c0cd420 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.518+0000 7efd4a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 0x7efd4c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 0x7efd4c146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41516/0 (socket says 172.21.15.3:41516) 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 -- 172.21.15.3:0/3976948211 learned_addr learned my addr 172.21.15.3:0/3976948211 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4b59e700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd4c0c6f00 0x7efd4c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4ad9d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c0b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 -- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 msgr2=0x7efd4c0b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c0b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 -- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd4c0c6f00 msgr2=0x7efd4c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd4c0c6f00 0x7efd4c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 -- 172.21.15.3:0/3976948211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd34009420 con 0x7efd4c159040 2023-10-08T16:07:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd4a59c700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 0x7efd4c146790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd34009f00 tx=0x7efd34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3401f070 con 0x7efd4c159040 2023-10-08T16:07:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd34002f70 con 0x7efd4c159040 2023-10-08T16:07:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c0b4e80 con 0x7efd4c159040 2023-10-08T16:07:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34011900 con 0x7efd4c159040 2023-10-08T16:07:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c0b5440 con 0x7efd4c159040 2023-10-08T16:07:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efd34023070 con 0x7efd4c159040 2023-10-08T16:07:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c0b5920 con 0x7efd4c159040 2023-10-08T16:07:14.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.522+0000 7efd42ffd700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd2c060550 0x7efd2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.526+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd3407d990 con 0x7efd4c159040 2023-10-08T16:07:14.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.526+0000 7efd4ad9d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd2c060550 0x7efd2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.526+0000 7efd4ad9d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd2c060550 0x7efd2c062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efd3c007fd0 tx=0x7efd3c007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.534+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd3404df80 con 0x7efd4c159040 2023-10-08T16:07:14.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.690+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd4c071180 con 0x7efd4c159040 2023-10-08T16:07:14.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd42ffd700 1 -- 172.21.15.3:0/3976948211 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd3402a020 con 0x7efd4c159040 2023-10-08T16:07:14.697 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd2c060550 msgr2=0x7efd2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd2c060550 0x7efd2c062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efd3c007fd0 tx=0x7efd3c007d50 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 msgr2=0x7efd4c146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 0x7efd4c146790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd34009f00 tx=0x7efd34017000 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 shutdown_connections 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efd2c060550 0x7efd2c062a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd4c0c6f00 0x7efd4c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd4c159040 0x7efd4c146790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 --2- 172.21.15.3:0/3976948211 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efd4c0cd420 0x7efd4c0b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 >> 172.21.15.3:0/3976948211 conn(0x7efd4c0d0920 msgr2=0x7efd4c154870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 shutdown_connections 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.694+0000 7efd5114d700 1 -- 172.21.15.3:0/3976948211 wait complete. 2023-10-08T16:07:14.712 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:14.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 Processor -- start 2023-10-08T16:07:14.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 -- start start 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f644806d1c0 0x7f644806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f6448154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f644806a9a0 0x7f64481553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644806bb40 con 0x7f644806d1c0 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6448155910 con 0x7f644806a9a0 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644e799700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644806bfd0 con 0x7f644806a570 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644d797700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f644806d1c0 0x7f644806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644cf96700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f6448154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644df98700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f644806a9a0 0x7f64481553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644cf96700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f6448154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:47104/0 (socket says 172.21.15.3:47104) 2023-10-08T16:07:14.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644cf96700 1 -- 172.21.15.3:0/3486069209 learned_addr learned my addr 172.21.15.3:0/3486069209 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:14.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644d797700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f644806d1c0 0x7f644806d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41530/0 (socket says 172.21.15.3:41530) 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.814+0000 7f644d797700 1 -- 172.21.15.3:0/3486069209 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 msgr2=0x7f6448154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644d797700 1 --2- 172.21.15.3:0/3486069209 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f6448154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644d797700 1 -- 172.21.15.3:0/3486069209 >> v2:172.21.15.27:3300/0 conn(0x7f644806a9a0 msgr2=0x7f64481553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644d797700 1 --2- 172.21.15.3:0/3486069209 >> v2:172.21.15.27:3300/0 conn(0x7f644806a9a0 0x7f64481553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644d797700 1 -- 172.21.15.3:0/3486069209 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644806af30 con 0x7f644806d1c0 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644cf96700 1 --2- 172.21.15.3:0/3486069209 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f6448154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:14.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644df98700 1 --2- 172.21.15.3:0/3486069209 >> v2:172.21.15.27:3300/0 conn(0x7f644806a9a0 0x7f64481553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644d797700 1 --2- 172.21.15.3:0/3486069209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806d1c0 0x7f644806d590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6448158f80 tx=0x7f64440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929aa4f80320f99c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f643ffff700 1 -- 172.21.15.3:0/3486069209 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444011630 con 0x7f644806d1c0 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f643ffff700 1 -- 172.21.15.3:0/3486069209 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440117b0 con 0x7f644806d1c0 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f643ffff700 1 -- 172.21.15.3:0/3486069209 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444011b70 con 0x7f644806d1c0 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 -- 172.21.15.3:0/3486069209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806d1c0 msgr2=0x7f644806d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 --2- 172.21.15.3:0/3486069209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806d1c0 0x7f644806d590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6448158f80 tx=0x7f64440091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 -- 172.21.15.3:0/3486069209 shutdown_connections 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 --2- 172.21.15.3:0/3486069209 >> v2:172.21.15.27:3300/0 conn(0x7f644806a9a0 0x7f64481553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 --2- 172.21.15.3:0/3486069209 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f6448154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 --2- 172.21.15.3:0/3486069209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806d1c0 0x7f644806d590 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 -- 172.21.15.3:0/3486069209 >> 172.21.15.3:0/3486069209 conn(0x7f64480c83d0 msgr2=0x7f64480c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 -- 172.21.15.3:0/3486069209 shutdown_connections 2023-10-08T16:07:14.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.818+0000 7f644e799700 1 -- 172.21.15.3:0/3486069209 wait complete. 2023-10-08T16:07:14.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 Processor -- start 2023-10-08T16:07:14.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 -- start start 2023-10-08T16:07:14.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f64480c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 0x7f64481505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f644806d1c0 0x7f6448151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481516a0 con 0x7f644806a9a0 2023-10-08T16:07:14.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c5370 con 0x7f644806d1c0 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64481528b0 con 0x7f644806a570 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 0x7f64481505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 0x7f64481505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41538/0 (socket says 172.21.15.3:41538) 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 -- 172.21.15.3:0/3326390074 learned_addr learned my addr 172.21.15.3:0/3326390074 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644df98700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f644806d1c0 0x7f6448151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644d797700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f64480c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 -- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 msgr2=0x7f64480c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f64480c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 -- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f644806d1c0 msgr2=0x7f6448151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f644806d1c0 0x7f6448151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 -- 172.21.15.3:0/3326390074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643800b780 con 0x7f644806a9a0 2023-10-08T16:07:14.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644cf96700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 0x7f64481505a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f643800def0 tx=0x7f643800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438009cb0 con 0x7f644806a9a0 2023-10-08T16:07:14.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438009e10 con 0x7f644806a9a0 2023-10-08T16:07:14.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6440009a20 con 0x7f644806a9a0 2023-10-08T16:07:14.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438017620 con 0x7f644806a9a0 2023-10-08T16:07:14.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.822+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6444009420 con 0x7f644806a9a0 2023-10-08T16:07:14.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.826+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480c4b10 con 0x7f644806a9a0 2023-10-08T16:07:14.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.826+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64380179d0 con 0x7f644806a9a0 2023-10-08T16:07:14.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.826+0000 7f643d7fa700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f642c060580 0x7f642c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.826+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f643807ccf0 con 0x7f644806a9a0 2023-10-08T16:07:14.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.826+0000 7f644d797700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f642c060580 0x7f642c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.826+0000 7f644d797700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f642c060580 0x7f642c062a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6448158f80 tx=0x7f6444017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:14.834+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f643804d280 con 0x7f644806a9a0 2023-10-08T16:07:15.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.030+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f644806b210 con 0x7f644806a9a0 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.030+0000 7f643d7fa700 1 -- 172.21.15.3:0/3326390074 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f64380508a0 con 0x7f644806a9a0 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f642c060580 msgr2=0x7f642c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f642c060580 0x7f642c062a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6448158f80 tx=0x7f6444017000 comp rx=0 tx=0).stop 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 msgr2=0x7f64481505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 0x7f64481505a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f643800def0 tx=0x7f643800f040 comp rx=0 tx=0).stop 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 shutdown_connections 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f642c060580 0x7f642c062a30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f644806d1c0 0x7f6448151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644806a9a0 0x7f64481505a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 --2- 172.21.15.3:0/3326390074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f644806a570 0x7f64480c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 >> 172.21.15.3:0/3326390074 conn(0x7f64480c83d0 msgr2=0x7f64480c9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 shutdown_connections 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.034+0000 7f644e799700 1 -- 172.21.15.3:0/3326390074 wait complete. 2023-10-08T16:07:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:07:15.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:15.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 Processor -- start 2023-10-08T16:07:15.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- start start 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc67015a390 0x7fc6700cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67015ab10 con 0x7fc6700adff0 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6700cb930 con 0x7fc6700ca5a0 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc670157580 con 0x7fc67015a390 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc6756d0700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc6700adff0 0x7fc670159c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53332/0 (socket says 172.21.15.3:53332) 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc6756d0700 1 -- 172.21.15.3:0/2043579157 learned_addr learned my addr 172.21.15.3:0/2043579157 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:15.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc674ecf700 1 --2- 172.21.15.3:0/2043579157 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc67015a390 0x7fc6700cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc663fff700 1 -- 172.21.15.3:0/2043579157 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769196428 0 0) 0x7fc67015ab10 con 0x7fc6700adff0 2023-10-08T16:07:15.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc663fff700 1 -- 172.21.15.3:0/2043579157 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc65c003570 con 0x7fc6700adff0 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc663fff700 1 -- 172.21.15.3:0/2043579157 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823672412 0 0) 0x7fc6700cb930 con 0x7fc6700ca5a0 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc674ecf700 1 -- 172.21.15.3:0/2043579157 >> v1:172.21.15.27:6789/0 conn(0x7fc6700ca5a0 legacy=0x7fc67006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc674ecf700 1 -- 172.21.15.3:0/2043579157 >> v1:172.21.15.3:6789/0 conn(0x7fc6700adff0 legacy=0x7fc670159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc674ecf700 1 -- 172.21.15.3:0/2043579157 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700c97e0 con 0x7fc67015a390 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc674ecf700 1 --2- 172.21.15.3:0/2043579157 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc67015a390 0x7fc6700cb350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc664009910 tx=0x7fc6640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=610bbd8d0f659d8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc663fff700 1 -- 172.21.15.3:0/2043579157 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400b680 con 0x7fc67015a390 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc663fff700 1 -- 172.21.15.3:0/2043579157 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66400b7e0 con 0x7fc67015a390 2023-10-08T16:07:15.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc663fff700 1 -- 172.21.15.3:0/2043579157 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400bba0 con 0x7fc67015a390 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- 172.21.15.3:0/2043579157 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc67015a390 msgr2=0x7fc6700cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 --2- 172.21.15.3:0/2043579157 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc67015a390 0x7fc6700cb350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc664009910 tx=0x7fc6640091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- 172.21.15.3:0/2043579157 shutdown_connections 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 --2- 172.21.15.3:0/2043579157 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc67015a390 0x7fc6700cb350 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- 172.21.15.3:0/2043579157 >> 172.21.15.3:0/2043579157 conn(0x7fc6700cc5d0 msgr2=0x7fc6700c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- 172.21.15.3:0/2043579157 shutdown_connections 2023-10-08T16:07:15.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.150+0000 7fc677934700 1 -- 172.21.15.3:0/2043579157 wait complete. 2023-10-08T16:07:15.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 Processor -- start 2023-10-08T16:07:15.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 -- start start 2023-10-08T16:07:15.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc6700adff0 0x7fc670147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6700ca5a0 0x7fc6700c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 0x7fc670157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc670153d10 con 0x7fc67015a390 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6701684c0 con 0x7fc6700ca5a0 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc677934700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6701681e0 con 0x7fc6700adff0 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 0x7fc670157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 0x7fc670157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41540/0 (socket says 172.21.15.3:41540) 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc674ecf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6700ca5a0 0x7fc6700c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 -- 172.21.15.3:0/3865440877 learned_addr learned my addr 172.21.15.3:0/3865440877 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:15.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc6756d0700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc6700adff0 0x7fc670147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 -- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc6700adff0 msgr2=0x7fc670147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc6700adff0 0x7fc670147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 -- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6700ca5a0 msgr2=0x7fc6700c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6700ca5a0 0x7fc6700c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 -- 172.21.15.3:0/3865440877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664009420 con 0x7fc67015a390 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.154+0000 7fc675ed1700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 0x7fc670157700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc668001560 tx=0x7fc668001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668002060 con 0x7fc67015a390 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66800a7e0 con 0x7fc67015a390 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6700c2ce0 con 0x7fc67015a390 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66800aba0 con 0x7fc67015a390 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6700c32a0 con 0x7fc67015a390 2023-10-08T16:07:15.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67004be40 con 0x7fc67015a390 2023-10-08T16:07:15.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc668003030 con 0x7fc67015a390 2023-10-08T16:07:15.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.158+0000 7fc6617fa700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc654060550 0x7fc654062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.162+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc66807c7e0 con 0x7fc67015a390 2023-10-08T16:07:15.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.162+0000 7fc6756d0700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc654060550 0x7fc654062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.162+0000 7fc6756d0700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc654060550 0x7fc654062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc67006ad50 tx=0x7fc66c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.170+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc66804cd30 con 0x7fc67015a390 2023-10-08T16:07:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.334+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6700cb350 con 0x7fc67015a390 2023-10-08T16:07:15.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.334+0000 7fc6617fa700 1 -- 172.21.15.3:0/3865440877 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fc668050350 con 0x7fc67015a390 2023-10-08T16:07:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:15.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc654060550 msgr2=0x7fc654062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc654060550 0x7fc654062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc67006ad50 tx=0x7fc66c009040 comp rx=0 tx=0).stop 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 msgr2=0x7fc670157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 0x7fc670157700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc668001560 tx=0x7fc668001770 comp rx=0 tx=0).stop 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 shutdown_connections 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc654060550 0x7fc654062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc67015a390 0x7fc670157700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6700ca5a0 0x7fc6700c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 --2- 172.21.15.3:0/3865440877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc6700adff0 0x7fc670147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 >> 172.21.15.3:0/3865440877 conn(0x7fc6700cc5d0 msgr2=0x7fc6700b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 shutdown_connections 2023-10-08T16:07:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.338+0000 7fc677934700 1 -- 172.21.15.3:0/3865440877 wait complete. 2023-10-08T16:07:15.354 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:07:15.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:15.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 Processor -- start 2023-10-08T16:07:15.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- start start 2023-10-08T16:07:15.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcbc0cc0b0 0x7efcbc0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0c3560 0x7efcbc156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efcbc0c85f0 0x7efcbc155780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc156990 con 0x7efcbc0cc0b0 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc0c8e70 con 0x7efcbc0c85f0 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c9150 con 0x7efcbc0c3560 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcbc0cc0b0 0x7efcbc0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcbc0cc0b0 0x7efcbc0cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41554/0 (socket says 172.21.15.3:41554) 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 -- 172.21.15.3:0/2688313800 learned_addr learned my addr 172.21.15.3:0/2688313800 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcb9d9b700 1 --2- 172.21.15.3:0/2688313800 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0c3560 0x7efcbc156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbad9d700 1 --2- 172.21.15.3:0/2688313800 >> v2:172.21.15.27:3300/0 conn(0x7efcbc0c85f0 0x7efcbc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 -- 172.21.15.3:0/2688313800 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0c3560 msgr2=0x7efcbc156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 --2- 172.21.15.3:0/2688313800 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0c3560 0x7efcbc156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 -- 172.21.15.3:0/2688313800 >> v2:172.21.15.27:3300/0 conn(0x7efcbc0c85f0 msgr2=0x7efcbc155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 --2- 172.21.15.3:0/2688313800 >> v2:172.21.15.27:3300/0 conn(0x7efcbc0c85f0 0x7efcbc155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 -- 172.21.15.3:0/2688313800 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc156620 con 0x7efcbc0cc0b0 2023-10-08T16:07:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcba59c700 1 --2- 172.21.15.3:0/2688313800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0cc0b0 0x7efcbc0cc480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0c7b70 tx=0x7efcac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e262f07a11ccc05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcb959a700 1 -- 172.21.15.3:0/2688313800 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac00e070 con 0x7efcbc0cc0b0 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcb959a700 1 -- 172.21.15.3:0/2688313800 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac00ba50 con 0x7efcbc0cc0b0 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcb959a700 1 -- 172.21.15.3:0/2688313800 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0092e0 con 0x7efcbc0cc0b0 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- 172.21.15.3:0/2688313800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0cc0b0 msgr2=0x7efcbc0cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- 172.21.15.3:0/2688313800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0cc0b0 0x7efcbc0cc480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0c7b70 tx=0x7efcac009840 comp rx=0 tx=0).stop 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- 172.21.15.3:0/2688313800 shutdown_connections 2023-10-08T16:07:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- 172.21.15.3:0/2688313800 >> v2:172.21.15.27:3300/0 conn(0x7efcbc0c85f0 0x7efcbc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- 172.21.15.3:0/2688313800 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0c3560 0x7efcbc156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 --2- 172.21.15.3:0/2688313800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0cc0b0 0x7efcbc0cc480 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- 172.21.15.3:0/2688313800 >> 172.21.15.3:0/2688313800 conn(0x7efcbc06b5b0 msgr2=0x7efcbc06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- 172.21.15.3:0/2688313800 shutdown_connections 2023-10-08T16:07:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.462+0000 7efcbb59e700 1 -- 172.21.15.3:0/2688313800 wait complete. 2023-10-08T16:07:15.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 Processor -- start 2023-10-08T16:07:15.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 -- start start 2023-10-08T16:07:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcbc0c3560 0x7efcbc0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 0x7efcbc147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0cc0b0 0x7efcbc1697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc16a2e0 con 0x7efcbc0c85f0 2023-10-08T16:07:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc16a5c0 con 0x7efcbc0c3560 2023-10-08T16:07:15.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbb59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c5f40 con 0x7efcbc0cc0b0 2023-10-08T16:07:15.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcb9d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 0x7efcbc147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcb9d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 0x7efcbc147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41560/0 (socket says 172.21.15.3:41560) 2023-10-08T16:07:15.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcb9d9b700 1 -- 172.21.15.3:0/3696070329 learned_addr learned my addr 172.21.15.3:0/3696070329 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:15.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcbad9d700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0cc0b0 0x7efcbc1697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.466+0000 7efcba59c700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcbc0c3560 0x7efcbc0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcb9d9b700 1 -- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0cc0b0 msgr2=0x7efcbc1697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcb9d9b700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0cc0b0 0x7efcbc1697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcb9d9b700 1 -- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcbc0c3560 msgr2=0x7efcbc0c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcb9d9b700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcbc0c3560 0x7efcbc0c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcb9d9b700 1 -- 172.21.15.3:0/3696070329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac009ae0 con 0x7efcbc0c85f0 2023-10-08T16:07:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcb9d9b700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 0x7efcbc147710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d890 tx=0x7efcb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00125f0 con 0x7efcbc0c85f0 2023-10-08T16:07:15.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0012750 con 0x7efcbc0c85f0 2023-10-08T16:07:15.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc0c6220 con 0x7efcbc0c85f0 2023-10-08T16:07:15.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0012af0 con 0x7efcbc0c85f0 2023-10-08T16:07:15.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc0b2520 con 0x7efcbc0c85f0 2023-10-08T16:07:15.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc04be40 con 0x7efcbc0c85f0 2023-10-08T16:07:15.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.470+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efcb001e460 con 0x7efcbc0c85f0 2023-10-08T16:07:15.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.474+0000 7efcaa7fc700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc9c060550 0x7efc9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.474+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcb007cd10 con 0x7efcbc0c85f0 2023-10-08T16:07:15.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.474+0000 7efcba59c700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc9c060550 0x7efc9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.474+0000 7efcba59c700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc9c060550 0x7efc9c062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcac009880 tx=0x7efcac018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.478+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efcb0050d90 con 0x7efcbc0c85f0 2023-10-08T16:07:15.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.678+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcbc160a50 con 0x7efcbc0c85f0 2023-10-08T16:07:15.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.678+0000 7efcaa7fc700 1 -- 172.21.15.3:0/3696070329 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7efcb0050920 con 0x7efcbc0c85f0 2023-10-08T16:07:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:15.683 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:07:15.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc9c060550 msgr2=0x7efc9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc9c060550 0x7efc9c062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcac009880 tx=0x7efcac018000 comp rx=0 tx=0).stop 2023-10-08T16:07:15.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 msgr2=0x7efcbc147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 0x7efcbc147710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d890 tx=0x7efcb0008040 comp rx=0 tx=0).stop 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 shutdown_connections 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efc9c060550 0x7efc9c062a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efcbc0cc0b0 0x7efcbc1697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcbc0c85f0 0x7efcbc147710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 --2- 172.21.15.3:0/3696070329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcbc0c3560 0x7efcbc0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 >> 172.21.15.3:0/3696070329 conn(0x7efcbc06b5b0 msgr2=0x7efcbc0ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 shutdown_connections 2023-10-08T16:07:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.682+0000 7efcbb59e700 1 -- 172.21.15.3:0/3696070329 wait complete. 2023-10-08T16:07:15.687 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:07:15.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:15.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 Processor -- start 2023-10-08T16:07:15.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 -- start start 2023-10-08T16:07:15.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a7c0684b0 0x7f2a7c068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a7c06ccc0 0x7f2a7c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c06e340 con 0x7f2a7c158ba0 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c06d730 con 0x7f2a7c0684b0 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a83171700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c06da10 con 0x7f2a7c06ccc0 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a7c0684b0 0x7f2a7c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a7c0684b0 0x7f2a7c068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41562/0 (socket says 172.21.15.3:41562) 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 -- 172.21.15.3:0/1351736139 learned_addr learned my addr 172.21.15.3:0/1351736139 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:15.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a82970700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2a7c158ba0 0x7f2a7c159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53342/0 (socket says 172.21.15.3:53342) 2023-10-08T16:07:15.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8196e700 1 --2- 172.21.15.3:0/1351736139 >> v2:172.21.15.27:3300/0 conn(0x7f2a7c06ccc0 0x7f2a7c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 -- 172.21.15.3:0/1351736139 >> v2:172.21.15.27:3300/0 conn(0x7f2a7c06ccc0 msgr2=0x7f2a7c06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 --2- 172.21.15.3:0/1351736139 >> v2:172.21.15.27:3300/0 conn(0x7f2a7c06ccc0 0x7f2a7c06d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 -- 172.21.15.3:0/1351736139 >> v1:172.21.15.3:6789/0 conn(0x7f2a7c158ba0 legacy=0x7f2a7c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 -- 172.21.15.3:0/1351736139 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c06dcf0 con 0x7f2a7c0684b0 2023-10-08T16:07:15.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8196e700 1 --2- 172.21.15.3:0/1351736139 >> v2:172.21.15.27:3300/0 conn(0x7f2a7c06ccc0 0x7f2a7c06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:15.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8216f700 1 --2- 172.21.15.3:0/1351736139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c068880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0705b0 tx=0x7f2a78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236e81814a3719ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8116d700 1 -- 172.21.15.3:0/1351736139 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800b860 con 0x7f2a7c0684b0 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8116d700 1 -- 172.21.15.3:0/1351736139 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7800b9c0 con 0x7f2a7c0684b0 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.802+0000 7f2a8116d700 1 -- 172.21.15.3:0/1351736139 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800bd60 con 0x7f2a7c0684b0 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- 172.21.15.3:0/1351736139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 msgr2=0x7f2a7c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 --2- 172.21.15.3:0/1351736139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c068880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0705b0 tx=0x7f2a78009250 comp rx=0 tx=0).stop 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- 172.21.15.3:0/1351736139 shutdown_connections 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 --2- 172.21.15.3:0/1351736139 >> v2:172.21.15.27:3300/0 conn(0x7f2a7c06ccc0 0x7f2a7c06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 --2- 172.21.15.3:0/1351736139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c068880 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- 172.21.15.3:0/1351736139 >> 172.21.15.3:0/1351736139 conn(0x7f2a7c0c8c90 msgr2=0x7f2a7c0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- 172.21.15.3:0/1351736139 shutdown_connections 2023-10-08T16:07:15.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- 172.21.15.3:0/1351736139 wait complete. 2023-10-08T16:07:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 Processor -- start 2023-10-08T16:07:15.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- start start 2023-10-08T16:07:15.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c15e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a7c06ccc0 0x7f2a7c149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a7c158ba0 0x7f2a7c0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c15ee50 con 0x7f2a7c0684b0 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c15c080 con 0x7f2a7c06ccc0 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a83171700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c15ac30 con 0x7f2a7c158ba0 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a8216f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a8216f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c15e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41578/0 (socket says 172.21.15.3:41578) 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.806+0000 7f2a8216f700 1 -- 172.21.15.3:0/3312553585 learned_addr learned my addr 172.21.15.3:0/3312553585 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a82970700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a7c158ba0 0x7f2a7c0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8196e700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a7c06ccc0 0x7f2a7c149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8216f700 1 -- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a7c158ba0 msgr2=0x7f2a7c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8216f700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a7c158ba0 0x7f2a7c0c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8216f700 1 -- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a7c06ccc0 msgr2=0x7f2a7c149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8216f700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a7c06ccc0 0x7f2a7c149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8216f700 1 -- 172.21.15.3:0/3312553585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780094f0 con 0x7f2a7c0684b0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a8216f700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c15e910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009290 tx=0x7f2a78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78011e60 con 0x7f2a7c0684b0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7801f070 con 0x7f2a7c0684b0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c15af10 con 0x7f2a7c0684b0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7801a870 con 0x7f2a7c0684b0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c157590 con 0x7f2a7c0684b0 2023-10-08T16:07:15.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c04be40 con 0x7f2a7c0684b0 2023-10-08T16:07:15.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.810+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a7801abe0 con 0x7f2a7c0684b0 2023-10-08T16:07:15.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.814+0000 7f2a727fc700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a60060550 0x7f2a60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.814+0000 7f2a8196e700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a60060550 0x7f2a60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.814+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a78021070 con 0x7f2a7c0684b0 2023-10-08T16:07:15.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.814+0000 7f2a8196e700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a60060550 0x7f2a60062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c006f00 tx=0x7f2a6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:15.822+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a7804ec80 con 0x7f2a7c0684b0 2023-10-08T16:07:16.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.018+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a7c0b2050 con 0x7f2a7c0684b0 2023-10-08T16:07:16.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.018+0000 7f2a727fc700 1 -- 172.21.15.3:0/3312553585 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4576 (secure 0 0 0) 0x7f2a780522a0 con 0x7f2a7c0684b0 2023-10-08T16:07:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:16.025 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/990010021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":990010021},{"type":"v1","addr":"172.21.15.27:6833","nonce":990010021}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1219803141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1219803141},{"type":"v1","addr":"172.21.15.27:6835","nonce":1219803141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/607021472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":607021472},{"type":"v1","addr":"172.21.15.3:6835","nonce":607021472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:39.636023+0000","modified":"2023-10-08T16:06:42.298675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/820109692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":820109692},{"type":"v1","addr":"172.21.15.3:6837","nonce":820109692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a60060550 msgr2=0x7f2a60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a60060550 0x7f2a60062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c006f00 tx=0x7f2a6c008040 comp rx=0 tx=0).stop 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 msgr2=0x7f2a7c15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c15e910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009290 tx=0x7f2a78017000 comp rx=0 tx=0).stop 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 shutdown_connections 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2a60060550 0x7f2a60062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2a7c158ba0 0x7f2a7c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a7c06ccc0 0x7f2a7c149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 --2- 172.21.15.3:0/3312553585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a7c0684b0 0x7f2a7c15e910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 >> 172.21.15.3:0/3312553585 conn(0x7f2a7c0c8c90 msgr2=0x7f2a7c0c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 shutdown_connections 2023-10-08T16:07:16.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.022+0000 7f2a83171700 1 -- 172.21.15.3:0/3312553585 wait complete. 2023-10-08T16:07:16.028 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T16:07:16.039 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:16.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.142+0000 7f0e5df4c700 1 Processor -- start 2023-10-08T16:07:16.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.142+0000 7f0e5df4c700 1 -- start start 2023-10-08T16:07:16.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e5815ce10 0x7f0e58068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 0x7f0e581589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e58069040 con 0x7f0e580675f0 2023-10-08T16:07:16.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e58067a60 con 0x7f0e5815ce10 2023-10-08T16:07:16.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58067d40 con 0x7f0e5815d1e0 2023-10-08T16:07:16.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0e580675f0 0x7f0e580cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53358/0 (socket says 172.21.15.3:53358) 2023-10-08T16:07:16.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 -- 172.21.15.3:0/2726378069 learned_addr learned my addr 172.21.15.3:0/2726378069 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:16.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5d74b700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 0x7f0e581589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5cf4a700 1 --2- 172.21.15.3:0/2726378069 >> v2:172.21.15.27:3300/0 conn(0x7f0e5815ce10 0x7f0e58068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259227374 0 0) 0x7f0e58069040 con 0x7f0e580675f0 2023-10-08T16:07:16.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e40003570 con 0x7f0e580675f0 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223914867 0 0) 0x7f0e40003570 con 0x7f0e580675f0 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 msgr2=0x7f0e581589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 0x7f0e581589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 >> v2:172.21.15.27:3300/0 conn(0x7f0e5815ce10 msgr2=0x7f0e58068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 --2- 172.21.15.3:0/2726378069 >> v2:172.21.15.27:3300/0 conn(0x7f0e5815ce10 0x7f0e58068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58068020 con 0x7f0e580675f0 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f0e4c0017f0 con 0x7f0e580675f0 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 >> v1:172.21.15.3:6789/0 conn(0x7f0e580675f0 legacy=0x7f0e580cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e40003a60 0x7f0e40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e40004810 0x7f0e40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 0x7f0e400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58067a60 con 0x7f0e40004810 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58067d40 con 0x7f0e40003a60 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4000ba60 con 0x7f0e5815d1e0 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e40004810 0x7f0e40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5cf4a700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e40003a60 0x7f0e40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5d74b700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 0x7f0e400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 -- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 msgr2=0x7f0e400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e5815d1e0 0x7f0e400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 -- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e40003a60 msgr2=0x7f0e40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e40003a60 0x7f0e40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 -- 172.21.15.3:0/2726378069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40003570 con 0x7f0e40004810 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e57fff700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e40004810 0x7f0e40004c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00a970 tx=0x7f0e4c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c14ef2f749df7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0070d0 con 0x7f0e40004810 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c007270 con 0x7f0e40004810 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e577fe700 1 -- 172.21.15.3:0/2726378069 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c007630 con 0x7f0e40004810 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- 172.21.15.3:0/2726378069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e40004810 msgr2=0x7f0e40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/2726378069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e40004810 0x7f0e40004c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00a970 tx=0x7f0e4c002210 comp rx=0 tx=0).stop 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5d74b700 1 -- 172.21.15.3:0/2726378069 reap_dead start 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- 172.21.15.3:0/2726378069 shutdown_connections 2023-10-08T16:07:16.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- 172.21.15.3:0/2726378069 >> 172.21.15.3:0/2726378069 conn(0x7f0e580cdb50 msgr2=0x7f0e580cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- 172.21.15.3:0/2726378069 shutdown_connections 2023-10-08T16:07:16.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.146+0000 7f0e5df4c700 1 -- 172.21.15.3:0/2726378069 wait complete. 2023-10-08T16:07:16.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 Processor -- start 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 -- start start 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e5814c940 0x7f0e580cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 0x7f0e5806da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e58155000 0x7f0e58155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5816aa30 con 0x7f0e5806d610 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5816a880 con 0x7f0e5814c940 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5df4c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5806dfc0 con 0x7f0e58155000 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 0x7f0e5806da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 0x7f0e5806da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41590/0 (socket says 172.21.15.3:41590) 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e57fff700 1 -- 172.21.15.3:0/1446852121 learned_addr learned my addr 172.21.15.3:0/1446852121 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5cf4a700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e5814c940 0x7f0e580cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.150+0000 7f0e5d74b700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e58155000 0x7f0e58155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e57fff700 1 -- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e58155000 msgr2=0x7f0e58155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e57fff700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e58155000 0x7f0e58155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e57fff700 1 -- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e5814c940 msgr2=0x7f0e580cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e57fff700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e5814c940 0x7f0e580cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e57fff700 1 -- 172.21.15.3:0/1446852121 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580cb330 con 0x7f0e5806d610 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e57fff700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 0x7f0e5806da80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c012000 tx=0x7f0e4c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0075f0 con 0x7f0e5806d610 2023-10-08T16:07:16.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c027420 con 0x7f0e5806d610 2023-10-08T16:07:16.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e58169c70 con 0x7f0e5806d610 2023-10-08T16:07:16.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0275b0 con 0x7f0e5806d610 2023-10-08T16:07:16.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5816a230 con 0x7f0e5806d610 2023-10-08T16:07:16.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58156220 con 0x7f0e5806d610 2023-10-08T16:07:16.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.154+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0e4c024020 con 0x7f0e5806d610 2023-10-08T16:07:16.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.158+0000 7f0e54ff9700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e44060580 0x7f0e44062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.158+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e4c07e580 con 0x7f0e5806d610 2023-10-08T16:07:16.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.158+0000 7f0e5cf4a700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e44060580 0x7f0e44062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.158+0000 7f0e5cf4a700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e44060580 0x7f0e44062a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0e48006f00 tx=0x7f0e480091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.162+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0e58156220 con 0x7f0e5806d610 2023-10-08T16:07:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.326+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e580cb330 con 0x7f0e5806d610 2023-10-08T16:07:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.326+0000 7f0e54ff9700 1 -- 172.21.15.3:0/1446852121 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f0e580cb330 con 0x7f0e5806d610 2023-10-08T16:07:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:16.331 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:06:41.242059+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:38.142599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:38.623014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e44060580 msgr2=0x7f0e44062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e44060580 0x7f0e44062a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0e48006f00 tx=0x7f0e480091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 msgr2=0x7f0e5806da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 0x7f0e5806da80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c012000 tx=0x7f0e4c015000 comp rx=0 tx=0).stop 2023-10-08T16:07:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 shutdown_connections 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0e44060580 0x7f0e44062a30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0e58155000 0x7f0e58155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e5806d610 0x7f0e5806da80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 --2- 172.21.15.3:0/1446852121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e5814c940 0x7f0e580cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 >> 172.21.15.3:0/1446852121 conn(0x7f0e580cdb50 msgr2=0x7f0e580b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 shutdown_connections 2023-10-08T16:07:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.330+0000 7f0e5df4c700 1 -- 172.21.15.3:0/1446852121 wait complete. 2023-10-08T16:07:16.351 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:07:16.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.458+0000 7f1bb59ef700 1 Processor -- start 2023-10-08T16:07:16.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.458+0000 7f1bb59ef700 1 -- start start 2023-10-08T16:07:16.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ade60 0x7f1bb00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1bb00c7d70 0x7f1bb00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb01562c0 con 0x7f1bb00ae230 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb006b0b0 con 0x7f1bb00c7d70 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb006b390 con 0x7f1bb00ade60 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1bb00ae230 0x7f1bb00c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53370/0 (socket says 172.21.15.3:53370) 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baffff700 1 -- 172.21.15.3:0/3325958410 learned_addr learned my addr 172.21.15.3:0/3325958410 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb51ee700 1 --2- 172.21.15.3:0/3325958410 >> v2:172.21.15.3:3300/0 conn(0x7f1bb00c7d70 0x7f1bb00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb49ed700 1 --2- 172.21.15.3:0/3325958410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ade60 0x7f1bb00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baf7fe700 1 -- 172.21.15.3:0/3325958410 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673857130 0 0) 0x7f1bb01562c0 con 0x7f1bb00ae230 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baf7fe700 1 -- 172.21.15.3:0/3325958410 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b9c003570 con 0x7f1bb00ae230 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb51ee700 1 -- 172.21.15.3:0/3325958410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ade60 msgr2=0x7f1bb00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb51ee700 1 --2- 172.21.15.3:0/3325958410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ade60 0x7f1bb00cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb51ee700 1 -- 172.21.15.3:0/3325958410 >> v1:172.21.15.3:6789/0 conn(0x7f1bb00ae230 legacy=0x7f1bb00c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb51ee700 1 -- 172.21.15.3:0/3325958410 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb006b670 con 0x7f1bb00c7d70 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb51ee700 1 --2- 172.21.15.3:0/3325958410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb00cb390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00098e0 tx=0x7f1ba00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8054260727cae233 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baf7fe700 1 -- 172.21.15.3:0/3325958410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011630 con 0x7f1bb00c7d70 2023-10-08T16:07:16.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baf7fe700 1 -- 172.21.15.3:0/3325958410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba0011790 con 0x7f1bb00c7d70 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1baf7fe700 1 -- 172.21.15.3:0/3325958410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011b30 con 0x7f1bb00c7d70 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- 172.21.15.3:0/3325958410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 msgr2=0x7f1bb00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/3325958410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb00cb390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00098e0 tx=0x7f1ba00091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- 172.21.15.3:0/3325958410 shutdown_connections 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/3325958410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb00cb390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/3325958410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ade60 0x7f1bb00cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- 172.21.15.3:0/3325958410 >> 172.21.15.3:0/3325958410 conn(0x7f1bb00c83d0 msgr2=0x7f1bb00c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- 172.21.15.3:0/3325958410 shutdown_connections 2023-10-08T16:07:16.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.462+0000 7f1bb59ef700 1 -- 172.21.15.3:0/3325958410 wait complete. 2023-10-08T16:07:16.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 Processor -- start 2023-10-08T16:07:16.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 -- start start 2023-10-08T16:07:16.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bb00ade60 0x7f1bb0158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ae230 0x7f1bb014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb0150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb0143a80 con 0x7f1bb00c7d70 2023-10-08T16:07:16.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb0150840 con 0x7f1bb00ade60 2023-10-08T16:07:16.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb59ef700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb0157f90 con 0x7f1bb00ae230 2023-10-08T16:07:16.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb51ee700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb0150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb51ee700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb0150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41614/0 (socket says 172.21.15.3:41614) 2023-10-08T16:07:16.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb49ed700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bb00ade60 0x7f1bb0158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1bb51ee700 1 -- 172.21.15.3:0/1468174193 learned_addr learned my addr 172.21.15.3:0/1468174193 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:16.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.466+0000 7f1baffff700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ae230 0x7f1bb014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb51ee700 1 -- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ae230 msgr2=0x7f1bb014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb51ee700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ae230 0x7f1bb014fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb51ee700 1 -- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bb00ade60 msgr2=0x7f1bb0158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb51ee700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bb00ade60 0x7f1bb0158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb51ee700 1 -- 172.21.15.3:0/1468174193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009420 con 0x7f1bb00c7d70 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb49ed700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bb00ade60 0x7f1bb0158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb51ee700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb0150300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009ed0 tx=0x7f1ba0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011b10 con 0x7f1bb00c7d70 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba00253f0 con 0x7f1bb00c7d70 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0025790 con 0x7f1bb00c7d70 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb0157660 con 0x7f1bb00c7d70 2023-10-08T16:07:16.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb0157c20 con 0x7f1bb00c7d70 2023-10-08T16:07:16.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.470+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb0158120 con 0x7f1bb00c7d70 2023-10-08T16:07:16.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.474+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ba0025b80 con 0x7f1bb00c7d70 2023-10-08T16:07:16.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.474+0000 7f1bacff9700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b90060580 0x7f1b90062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.474+0000 7f1bb49ed700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b90060580 0x7f1b90062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.474+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ba007e0d0 con 0x7f1bb00c7d70 2023-10-08T16:07:16.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.474+0000 7f1bb49ed700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b90060580 0x7f1b90062a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80113e0 tx=0x7f1ba80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.478+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ba004e6c0 con 0x7f1bb00c7d70 2023-10-08T16:07:16.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.678+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1bb004be40 con 0x7f1bb00c7d70 2023-10-08T16:07:16.682 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T16:07:16.678+0000 7ff88634f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:07:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.682+0000 7f1bacff9700 1 -- 172.21.15.3:0/1468174193 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1ba0051ce0 con 0x7f1bb00c7d70 2023-10-08T16:07:16.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b90060580 msgr2=0x7f1b90062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b90060580 0x7f1b90062a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80113e0 tx=0x7f1ba80091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 msgr2=0x7f1bb0150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb0150300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009ed0 tx=0x7f1ba0017000 comp rx=0 tx=0).stop 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 shutdown_connections 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b90060580 0x7f1b90062a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb00c7d70 0x7f1bb0150300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1bb00ae230 0x7f1bb014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 --2- 172.21.15.3:0/1468174193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bb00ade60 0x7f1bb0158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 >> 172.21.15.3:0/1468174193 conn(0x7f1bb00c83d0 msgr2=0x7f1bb00c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 shutdown_connections 2023-10-08T16:07:16.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.690+0000 7f1bb59ef700 1 -- 172.21.15.3:0/1468174193 wait complete. 2023-10-08T16:07:16.695 INFO:tasks.ceph.mds.a.smithi003.stderr: -2137> 2023-10-08T16:06:43.555+0000 7f0442a29700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:07:16.695 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:07:16.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:07:16.718 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T16:07:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.810+0000 7f0348804700 1 Processor -- start 2023-10-08T16:07:16.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.810+0000 7f0348804700 1 -- start start 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156b10 0x7f03440af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f03440ae800 0x7f03440aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440c80b0 con 0x7f0344156ee0 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03440c9fc0 con 0x7f03440ae800 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440ad400 con 0x7f0344156b10 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f033bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0344156ee0 0x7f03440c9450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53372/0 (socket says 172.21.15.3:53372) 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0343fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f03440ae800 0x7f03440aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f033bfff700 1 -- 172.21.15.3:0/1323348174 learned_addr learned my addr 172.21.15.3:0/1323348174 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:16.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f03437fe700 1 --2- 172.21.15.3:0/1323348174 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156b10 0x7f03440af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0343fff700 1 -- 172.21.15.3:0/1323348174 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156b10 msgr2=0x7f03440af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0343fff700 1 --2- 172.21.15.3:0/1323348174 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156b10 0x7f03440af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0343fff700 1 -- 172.21.15.3:0/1323348174 >> v1:172.21.15.3:6789/0 conn(0x7f0344156ee0 legacy=0x7f03440c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0343fff700 1 -- 172.21.15.3:0/1323348174 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034415b6d0 con 0x7f03440ae800 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0342ffd700 1 -- 172.21.15.3:0/1323348174 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185403992 0 0) 0x7f03440c80b0 con 0x7f0344156ee0 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0343fff700 1 --2- 172.21.15.3:0/1323348174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440aeca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e90 tx=0x7f033c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac87539f1f14d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0342ffd700 1 -- 172.21.15.3:0/1323348174 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00e070 con 0x7f03440ae800 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0342ffd700 1 -- 172.21.15.3:0/1323348174 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00bbf0 con 0x7f03440ae800 2023-10-08T16:07:16.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0342ffd700 1 -- 172.21.15.3:0/1323348174 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c012430 con 0x7f03440ae800 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 -- 172.21.15.3:0/1323348174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 msgr2=0x7f03440aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.814+0000 7f0348804700 1 --2- 172.21.15.3:0/1323348174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440aeca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e90 tx=0x7f033c009780 comp rx=0 tx=0).stop 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- 172.21.15.3:0/1323348174 shutdown_connections 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 --2- 172.21.15.3:0/1323348174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440aeca0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 --2- 172.21.15.3:0/1323348174 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156b10 0x7f03440af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- 172.21.15.3:0/1323348174 >> 172.21.15.3:0/1323348174 conn(0x7f034406b4f0 msgr2=0x7f034406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- 172.21.15.3:0/1323348174 shutdown_connections 2023-10-08T16:07:16.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- 172.21.15.3:0/1323348174 wait complete. 2023-10-08T16:07:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 Processor -- start 2023-10-08T16:07:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- start start 2023-10-08T16:07:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0344156b10 0x7f0344150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156ee0 0x7f0344151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344151740 con 0x7f03440ae800 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440c6540 con 0x7f0344156b10 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440c5930 con 0x7f0344156ee0 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41666/0 (socket says 172.21.15.3:41666) 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 -- 172.21.15.3:0/1890361682 learned_addr learned my addr 172.21.15.3:0/1890361682 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f033bfff700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0344156b10 0x7f0344150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0343fff700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156ee0 0x7f0344151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 -- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156ee0 msgr2=0x7f0344151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156ee0 0x7f0344151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 -- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0344156b10 msgr2=0x7f0344150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0344156b10 0x7f0344150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 -- 172.21.15.3:0/1890361682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c009a20 con 0x7f03440ae800 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0343fff700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156ee0 0x7f0344151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f03437fe700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440c50e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f033400ec80 tx=0x7f03340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400c9d0 con 0x7f03440ae800 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033400cb30 con 0x7f03440ae800 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03440c5c10 con 0x7f03440ae800 2023-10-08T16:07:16.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334013470 con 0x7f03440ae800 2023-10-08T16:07:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.818+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03440c61d0 con 0x7f03440ae800 2023-10-08T16:07:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.822+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034404be40 con 0x7f03440ae800 2023-10-08T16:07:16.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.822+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0334013820 con 0x7f03440ae800 2023-10-08T16:07:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.822+0000 7f033b7fe700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0324060550 0x7f0324062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.822+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f033407cc50 con 0x7f03440ae800 2023-10-08T16:07:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.822+0000 7f033bfff700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0324060550 0x7f0324062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.822+0000 7f033bfff700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0324060550 0x7f0324062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f03441568b0 tx=0x7f032c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:16.834+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0334082020 con 0x7f03440ae800 2023-10-08T16:07:17.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.034+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f03440c7780 con 0x7f03440ae800 2023-10-08T16:07:17.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.686+0000 7f033b7fe700 1 -- 172.21.15.3:0/1890361682 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f033404d1f0 con 0x7f03440ae800 2023-10-08T16:07:17.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0324060550 msgr2=0x7f0324062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0324060550 0x7f0324062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f03441568b0 tx=0x7f032c009040 comp rx=0 tx=0).stop 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 msgr2=0x7f03440c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440c50e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f033400ec80 tx=0x7f03340091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 shutdown_connections 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0324060550 0x7f0324062a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0344156ee0 0x7f0344151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0344156b10 0x7f0344150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 --2- 172.21.15.3:0/1890361682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03440ae800 0x7f03440c50e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 >> 172.21.15.3:0/1890361682 conn(0x7f034406b4f0 msgr2=0x7f03440b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:17.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 shutdown_connections 2023-10-08T16:07:17.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.694+0000 7f0348804700 1 -- 172.21.15.3:0/1890361682 wait complete. 2023-10-08T16:07:17.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:07:17.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.834+0000 7fbc69d04700 1 Processor -- start 2023-10-08T16:07:17.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.834+0000 7fbc69d04700 1 -- start start 2023-10-08T16:07:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbc640b2080 0x7fbc6406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc64067770 0x7fbc640ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6406dab0 con 0x7fbc6406c9a0 2023-10-08T16:07:17.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6406cea0 con 0x7fbc640b2080 2023-10-08T16:07:17.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6406d180 con 0x7fbc64067770 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbc640b2080 0x7fbc6406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbc640b2080 0x7fbc6406acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41680/0 (socket says 172.21.15.3:41680) 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 -- 172.21.15.3:0/1343051888 learned_addr learned my addr 172.21.15.3:0/1343051888 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69503700 1 --2- 172.21.15.3:0/1343051888 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc64067770 0x7fbc640ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc637fe700 1 -- 172.21.15.3:0/1343051888 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404562575 0 0) 0x7fbc6406dab0 con 0x7fbc6406c9a0 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc637fe700 1 -- 172.21.15.3:0/1343051888 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc50003570 con 0x7fbc6406c9a0 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 -- 172.21.15.3:0/1343051888 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc64067770 msgr2=0x7fbc640ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 --2- 172.21.15.3:0/1343051888 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc64067770 0x7fbc640ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 -- 172.21.15.3:0/1343051888 >> v1:172.21.15.27:6789/0 conn(0x7fbc6406c9a0 legacy=0x7fbc64067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 -- 172.21.15.3:0/1343051888 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6406d460 con 0x7fbc640b2080 2023-10-08T16:07:17.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc68d02700 1 --2- 172.21.15.3:0/1343051888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc6406acf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbc540099b0 tx=0x7fbc54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd41956fc4ab0b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc637fe700 1 -- 172.21.15.3:0/1343051888 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400b680 con 0x7fbc640b2080 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc637fe700 1 -- 172.21.15.3:0/1343051888 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400b7e0 con 0x7fbc640b2080 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc637fe700 1 -- 172.21.15.3:0/1343051888 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400bb80 con 0x7fbc640b2080 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 -- 172.21.15.3:0/1343051888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 msgr2=0x7fbc6406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.838+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1343051888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc6406acf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbc540099b0 tx=0x7fbc54009250 comp rx=0 tx=0).stop 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- 172.21.15.3:0/1343051888 shutdown_connections 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1343051888 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc64067770 0x7fbc640ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1343051888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc6406acf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- 172.21.15.3:0/1343051888 >> 172.21.15.3:0/1343051888 conn(0x7fbc640cfd50 msgr2=0x7fbc640d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:17.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- 172.21.15.3:0/1343051888 shutdown_connections 2023-10-08T16:07:17.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- 172.21.15.3:0/1343051888 wait complete. 2023-10-08T16:07:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 Processor -- start 2023-10-08T16:07:17.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- start start 2023-10-08T16:07:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc64067770 0x7fbc6414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc6406c9a0 0x7fbc640c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc64158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6414cf70 con 0x7fbc640b2080 2023-10-08T16:07:17.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6415ad80 con 0x7fbc64067770 2023-10-08T16:07:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69d04700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6415a170 con 0x7fbc6406c9a0 2023-10-08T16:07:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69503700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc64158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69503700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc64158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41696/0 (socket says 172.21.15.3:41696) 2023-10-08T16:07:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc69503700 1 -- 172.21.15.3:0/1720740763 learned_addr learned my addr 172.21.15.3:0/1720740763 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc63fff700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc6406c9a0 0x7fbc640c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.842+0000 7fbc68d02700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc64067770 0x7fbc6414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69503700 1 -- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc6406c9a0 msgr2=0x7fbc640c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69503700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc6406c9a0 0x7fbc640c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69503700 1 -- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc64067770 msgr2=0x7fbc6414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69503700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc64067770 0x7fbc6414ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69503700 1 -- 172.21.15.3:0/1720740763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540094f0 con 0x7fbc640b2080 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc63fff700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc6406c9a0 0x7fbc640c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69503700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc64158450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009d70 tx=0x7fbc5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00caa0 con 0x7fbc640b2080 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00f040 con 0x7fbc640b2080 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6415a450 con 0x7fbc640b2080 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00ce50 con 0x7fbc640b2080 2023-10-08T16:07:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6415aa10 con 0x7fbc640b2080 2023-10-08T16:07:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6415af10 con 0x7fbc640b2080 2023-10-08T16:07:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.846+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbc5c014690 con 0x7fbc640b2080 2023-10-08T16:07:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.850+0000 7fbc60ff9700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbc44060550 0x7fbc44062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.850+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbc5c07d310 con 0x7fbc640b2080 2023-10-08T16:07:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.850+0000 7fbc68d02700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbc44060550 0x7fbc44062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.850+0000 7fbc68d02700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbc44060550 0x7fbc44062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc540099b0 tx=0x7fbc54017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:17.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:17.854+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc5c04d8b0 con 0x7fbc640b2080 2023-10-08T16:07:18.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.022+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc6404be40 con 0x7fbc640b2080 2023-10-08T16:07:18.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.698+0000 7fbc60ff9700 1 -- 172.21.15.3:0/1720740763 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbc5c050ed0 con 0x7fbc640b2080 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbc44060550 msgr2=0x7fbc44062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbc44060550 0x7fbc44062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc540099b0 tx=0x7fbc54017000 comp rx=0 tx=0).stop 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 msgr2=0x7fbc64158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc64158450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009d70 tx=0x7fbc5c00b040 comp rx=0 tx=0).stop 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 shutdown_connections 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbc44060550 0x7fbc44062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc640b2080 0x7fbc64158450 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbc6406c9a0 0x7fbc640c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 --2- 172.21.15.3:0/1720740763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc64067770 0x7fbc6414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 >> 172.21.15.3:0/1720740763 conn(0x7fbc640cfd50 msgr2=0x7fbc6414d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 shutdown_connections 2023-10-08T16:07:18.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.702+0000 7fbc69d04700 1 -- 172.21.15.3:0/1720740763 wait complete. 2023-10-08T16:07:18.709 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:07:18.721 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:07:18.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8cb217700 1 Processor -- start 2023-10-08T16:07:18.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8cb217700 1 -- start start 2023-10-08T16:07:18.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8cb217700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c4151410 0x7fe8c40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8cb217700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c40caaf0 con 0x7fe8c4151040 2023-10-08T16:07:18.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8cb217700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c40cadd0 con 0x7fe8c415ae50 2023-10-08T16:07:18.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8cb217700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40cb0b0 con 0x7fe8c4151410 2023-10-08T16:07:18.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8ca215700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe8c4151040 0x7fe8c415a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53384/0 (socket says 172.21.15.3:53384) 2023-10-08T16:07:18.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.830+0000 7fe8ca215700 1 -- 172.21.15.3:0/4149628625 learned_addr learned my addr 172.21.15.3:0/4149628625 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9a14700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c4151410 0x7fe8c40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519351932 0 0) 0x7fe8c40caaf0 con 0x7fe8c4151040 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b0003570 con 0x7fe8c4151040 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592380456 0 0) 0x7fe8b0003570 con 0x7fe8c4151040 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c4151410 msgr2=0x7fe8c40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c4151410 0x7fe8c40c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 >> v1:172.21.15.27:6789/0 conn(0x7fe8c415ae50 legacy=0x7fe8c40ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40cb390 con 0x7fe8c4151040 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fe8b8001470 con 0x7fe8c4151040 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 >> v1:172.21.15.3:6789/0 conn(0x7fe8c4151040 legacy=0x7fe8c415a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b0003a90 0x7fe8b0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b0004810 0x7fe8b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b0005180 0x7fe8b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40cb0b0 con 0x7fe8b0005180 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b000bfa0 con 0x7fe8b0003a90 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b000c0e0 con 0x7fe8b0004810 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b0005180 0x7fe8b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8ca215700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b0003a90 0x7fe8b0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9a14700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b0004810 0x7fe8b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 -- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b0004810 msgr2=0x7fe8b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b0004810 0x7fe8b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 -- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b0003a90 msgr2=0x7fe8b0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b0003a90 0x7fe8b0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 -- 172.21.15.3:0/4149628625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0003570 con 0x7fe8b0005180 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b0005180 0x7fe8b000ba60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc002070 tx=0x7fe8bc0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fdaa7f3f9499ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0019e0 con 0x7fe8b0005180 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc00c8b0 con 0x7fe8b0005180 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8c9213700 1 -- 172.21.15.3:0/4149628625 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00cc50 con 0x7fe8b0005180 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8cb217700 1 -- 172.21.15.3:0/4149628625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b0005180 msgr2=0x7fe8b000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8cb217700 1 --2- 172.21.15.3:0/4149628625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b0005180 0x7fe8b000ba60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc002070 tx=0x7fe8bc0016d0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8caa16700 1 -- 172.21.15.3:0/4149628625 reap_dead start 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8cb217700 1 -- 172.21.15.3:0/4149628625 shutdown_connections 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8cb217700 1 -- 172.21.15.3:0/4149628625 >> 172.21.15.3:0/4149628625 conn(0x7fe8c40cc410 msgr2=0x7fe8c40c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8cb217700 1 -- 172.21.15.3:0/4149628625 shutdown_connections 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.834+0000 7fe8cb217700 1 -- 172.21.15.3:0/4149628625 wait complete. 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.838+0000 7fe8cb217700 1 Processor -- start 2023-10-08T16:07:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.838+0000 7fe8cb217700 1 -- start start 2023-10-08T16:07:18.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c414d600 0x7fe8c40adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c414d9d0 0x7fe8c4156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 0x7fe8c4157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4151410 con 0x7fe8c4155770 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4155c00 con 0x7fe8c414d600 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4155ee0 con 0x7fe8c414d9d0 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 0x7fe8c4157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 0x7fe8c4157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41724/0 (socket says 172.21.15.3:41724) 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 -- 172.21.15.3:0/2358662172 learned_addr learned my addr 172.21.15.3:0/2358662172 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8c9a14700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c414d9d0 0x7fe8c4156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8ca215700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c414d600 0x7fe8c40adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 -- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c414d9d0 msgr2=0x7fe8c4156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c414d9d0 0x7fe8c4156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 -- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c414d600 msgr2=0x7fe8c40adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c414d600 0x7fe8c40adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 -- 172.21.15.3:0/2358662172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c41561c0 con 0x7fe8c4155770 2023-10-08T16:07:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8caa16700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 0x7fe8c4157040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00056f0 tx=0x7fe8bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0019e0 con 0x7fe8c4155770 2023-10-08T16:07:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc006db0 con 0x7fe8c4155770 2023-10-08T16:07:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c41564a0 con 0x7fe8c4155770 2023-10-08T16:07:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc012dd0 con 0x7fe8c4155770 2023-10-08T16:07:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c41518a0 con 0x7fe8c4155770 2023-10-08T16:07:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c41515c0 con 0x7fe8c4155770 2023-10-08T16:07:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.842+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe8bc019070 con 0x7fe8c4155770 2023-10-08T16:07:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.846+0000 7fe8b67fc700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8a8060550 0x7fe8a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.846+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe8bc07de90 con 0x7fe8c4155770 2023-10-08T16:07:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.846+0000 7fe8ca215700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8a8060550 0x7fe8a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.846+0000 7fe8ca215700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8a8060550 0x7fe8a8062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8001ed0 tx=0x7fe8b8007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:18.850+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe8c41515c0 con 0x7fe8c4155770 2023-10-08T16:07:19.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.014+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8c404be40 con 0x7fe8c4155770 2023-10-08T16:07:19.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.702+0000 7fe8b67fc700 1 -- 172.21.15.3:0/2358662172 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8bc04e620 con 0x7fe8c4155770 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.706+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8a8060550 msgr2=0x7fe8a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.706+0000 7fe8cb217700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8a8060550 0x7fe8a8062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8001ed0 tx=0x7fe8b8007040 comp rx=0 tx=0).stop 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 msgr2=0x7fe8c4157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 0x7fe8c4157040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00056f0 tx=0x7fe8bc015000 comp rx=0 tx=0).stop 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 shutdown_connections 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8a8060550 0x7fe8a8062a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8c4155770 0x7fe8c4157040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8c414d9d0 0x7fe8c4156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 --2- 172.21.15.3:0/2358662172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c414d600 0x7fe8c40adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 >> 172.21.15.3:0/2358662172 conn(0x7fe8c40cc410 msgr2=0x7fe8c414e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 shutdown_connections 2023-10-08T16:07:19.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.710+0000 7fe8cb217700 1 -- 172.21.15.3:0/2358662172 wait complete. 2023-10-08T16:07:19.762 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T16:07:19.762 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:07:19.763 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:07:19.763 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:07:19.763 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:19.763 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:07:19.763 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:07:19.764 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:07:19.764 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:19.764 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:07:19.764 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:07:19.764 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:07:19.764 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:19.764 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:07:19.765 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:07:19.765 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:07:19.765 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:19.777 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:07:19.778 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:07:19.779 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:07:19.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:07:19.780 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:07:19.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:07:19.781 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:07:19.782 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:19.782 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:07:19.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:07:19.784 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:07:19.784 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:19.822 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:07:19.822 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:19.823 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:07:19.823 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:19.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:07:19.850 INFO:tasks.ceph.mds.d.smithi027.stdout:starting mds.d at 2023-10-08T16:07:19.851 INFO:tasks.ceph.mds.b.smithi027.stdout:starting mds.b at 2023-10-08T16:07:19.926 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T16:07:19.936 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-10-08T16:07:19.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 Processor -- start 2023-10-08T16:07:19.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 -- start start 2023-10-08T16:07:19.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6541591f0 0x7fb6540b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 0x7fb6540caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65406ce20 con 0x7fb6540ca5d0 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540cb090 con 0x7fb6541591f0 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb659d10700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540cb370 con 0x7fb654067770 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 0x7fb6540caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb658d0e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb6541591f0 0x7fb6540b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 0x7fb6540caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:49628/0 (socket says 172.21.15.3:49628) 2023-10-08T16:07:19.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 -- 172.21.15.3:0/3912835409 learned_addr learned my addr 172.21.15.3:0/3912835409 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:19.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 -- 172.21.15.3:0/3912835409 >> v2:172.21.15.3:3300/0 conn(0x7fb6541591f0 msgr2=0x7fb6540b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:19.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 --2- 172.21.15.3:0/3912835409 >> v2:172.21.15.3:3300/0 conn(0x7fb6541591f0 0x7fb6540b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 -- 172.21.15.3:0/3912835409 >> v1:172.21.15.3:6789/0 conn(0x7fb6540ca5d0 legacy=0x7fb654067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.934+0000 7fb65950f700 1 -- 172.21.15.3:0/3912835409 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540cb650 con 0x7fb654067770 2023-10-08T16:07:19.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb65950f700 1 --2- 172.21.15.3:0/3912835409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 0x7fb6540caa40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009f20 tx=0x7fb64c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110098383810fb47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb6537fe700 1 -- 172.21.15.3:0/3912835409 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00e070 con 0x7fb654067770 2023-10-08T16:07:19.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb6537fe700 1 -- 172.21.15.3:0/3912835409 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c00ba80 con 0x7fb654067770 2023-10-08T16:07:19.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb6537fe700 1 -- 172.21.15.3:0/3912835409 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0092e0 con 0x7fb654067770 2023-10-08T16:07:19.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 -- 172.21.15.3:0/3912835409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 msgr2=0x7fb6540caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 --2- 172.21.15.3:0/3912835409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 0x7fb6540caa40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009f20 tx=0x7fb64c009840 comp rx=0 tx=0).stop 2023-10-08T16:07:19.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 -- 172.21.15.3:0/3912835409 shutdown_connections 2023-10-08T16:07:19.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 --2- 172.21.15.3:0/3912835409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb654067770 0x7fb6540caa40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 --2- 172.21.15.3:0/3912835409 >> v2:172.21.15.3:3300/0 conn(0x7fb6541591f0 0x7fb6540b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 -- 172.21.15.3:0/3912835409 >> 172.21.15.3:0/3912835409 conn(0x7fb6540cfd80 msgr2=0x7fb6540d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 -- 172.21.15.3:0/3912835409 shutdown_connections 2023-10-08T16:07:19.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.938+0000 7fb659d10700 1 -- 172.21.15.3:0/3912835409 wait complete. 2023-10-08T16:07:19.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 Processor -- start 2023-10-08T16:07:19.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- start start 2023-10-08T16:07:19.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb654067770 0x7fb654142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 0x7fb6540c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6541591f0 0x7fb65414b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c4b30 con 0x7fb6540ca5d0 2023-10-08T16:07:19.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65416d900 con 0x7fb654067770 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541433b0 con 0x7fb6541591f0 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 0x7fb6540c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 0x7fb6540c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40506/0 (socket says 172.21.15.3:40506) 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 -- 172.21.15.3:0/1668958703 learned_addr learned my addr 172.21.15.3:0/1668958703 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 -- 172.21.15.3:0/1668958703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6541591f0 msgr2=0x7fb65414b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6541591f0 0x7fb65414b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 -- 172.21.15.3:0/1668958703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb654067770 msgr2=0x7fb654142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb654067770 0x7fb654142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 -- 172.21.15.3:0/1668958703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c009ae0 con 0x7fb6540ca5d0 2023-10-08T16:07:19.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb653fff700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 0x7fb6540c2c20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c590 tx=0x7fb640007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640011590 con 0x7fb6540ca5d0 2023-10-08T16:07:19.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb640011710 con 0x7fb6540ca5d0 2023-10-08T16:07:19.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb654143690 con 0x7fb6540ca5d0 2023-10-08T16:07:19.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640011ad0 con 0x7fb6540ca5d0 2023-10-08T16:07:19.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540b5850 con 0x7fb6540ca5d0 2023-10-08T16:07:19.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.942+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65404be40 con 0x7fb6540ca5d0 2023-10-08T16:07:19.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.946+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb640000f90 con 0x7fb6540ca5d0 2023-10-08T16:07:19.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.946+0000 7fb650ff9700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb638060580 0x7fb638062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.946+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb64007bf40 con 0x7fb6540ca5d0 2023-10-08T16:07:19.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.946+0000 7fb658d0e700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb638060580 0x7fb638062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.946+0000 7fb658d0e700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb638060580 0x7fb638062a30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb648009a40 tx=0x7fb648008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:19.950+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb64004c960 con 0x7fb6540ca5d0 2023-10-08T16:07:20.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:20.122+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb6540c4c70 con 0x7fb6540ca5d0 2023-10-08T16:07:21.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.294+0000 7fb650ff9700 1 -- 172.21.15.3:0/1668958703 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb640021020 con 0x7fb6540ca5d0 2023-10-08T16:07:21.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb638060580 msgr2=0x7fb638062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb638060580 0x7fb638062a30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb648009a40 tx=0x7fb648008040 comp rx=0 tx=0).stop 2023-10-08T16:07:21.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 msgr2=0x7fb6540c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 0x7fb6540c2c20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c590 tx=0x7fb640007f30 comp rx=0 tx=0).stop 2023-10-08T16:07:21.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 shutdown_connections 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb638060580 0x7fb638062a30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6541591f0 0x7fb65414b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6540ca5d0 0x7fb6540c2c20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 --2- 172.21.15.3:0/1668958703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb654067770 0x7fb654142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 >> 172.21.15.3:0/1668958703 conn(0x7fb6540cfd80 msgr2=0x7fb6540b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 shutdown_connections 2023-10-08T16:07:21.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.298+0000 7fb659d10700 1 -- 172.21.15.3:0/1668958703 wait complete. 2023-10-08T16:07:21.305 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T16:07:21.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:07:21.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbec84700 1 Processor -- start 2023-10-08T16:07:21.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbec84700 1 -- start start 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbec84700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6cb8067770 0x7f6cb80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbec84700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb806ce20 con 0x7f6cb81591f0 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbec84700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80cb090 con 0x7f6cb80ca5d0 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbec84700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb80cb370 con 0x7f6cb8067770 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbdc82700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6cb81591f0 0x7f6cb80b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33140/0 (socket says 172.21.15.3:33140) 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbdc82700 1 -- 172.21.15.3:0/1789524999 learned_addr learned my addr 172.21.15.3:0/1789524999 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbe483700 1 --2- 172.21.15.3:0/1789524999 >> v2:172.21.15.3:3300/0 conn(0x7f6cb8067770 0x7f6cb80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbcc80700 1 -- 172.21.15.3:0/1789524999 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410341860 0 0) 0x7f6cb806ce20 con 0x7f6cb81591f0 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbcc80700 1 -- 172.21.15.3:0/1789524999 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca4003570 con 0x7f6cb81591f0 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbe483700 1 -- 172.21.15.3:0/1789524999 >> v1:172.21.15.27:6789/0 conn(0x7f6cb80ca5d0 legacy=0x7f6cb8067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbe483700 1 -- 172.21.15.3:0/1789524999 >> v1:172.21.15.3:6789/0 conn(0x7f6cb81591f0 legacy=0x7f6cb80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbe483700 1 -- 172.21.15.3:0/1789524999 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80cb650 con 0x7f6cb8067770 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbe483700 1 --2- 172.21.15.3:0/1789524999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb80caa40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009e60 tx=0x7f6cb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f70557ff25eb79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbcc80700 1 -- 172.21.15.3:0/1789524999 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000e070 con 0x7f6cb8067770 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbcc80700 1 -- 172.21.15.3:0/1789524999 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000bb60 con 0x7f6cb8067770 2023-10-08T16:07:21.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.430+0000 7f6cbcc80700 1 -- 172.21.15.3:0/1789524999 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012430 con 0x7f6cb8067770 2023-10-08T16:07:21.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 -- 172.21.15.3:0/1789524999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 msgr2=0x7f6cb80caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 --2- 172.21.15.3:0/1789524999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb80caa40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009e60 tx=0x7f6cb0009780 comp rx=0 tx=0).stop 2023-10-08T16:07:21.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 -- 172.21.15.3:0/1789524999 shutdown_connections 2023-10-08T16:07:21.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 --2- 172.21.15.3:0/1789524999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb80caa40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 -- 172.21.15.3:0/1789524999 >> 172.21.15.3:0/1789524999 conn(0x7f6cb80cfd80 msgr2=0x7f6cb80d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:21.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 -- 172.21.15.3:0/1789524999 shutdown_connections 2023-10-08T16:07:21.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 -- 172.21.15.3:0/1789524999 wait complete. 2023-10-08T16:07:21.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.434+0000 7f6cbec84700 1 Processor -- start 2023-10-08T16:07:21.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 -- start start 2023-10-08T16:07:21.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb81524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6cb80ca5d0 0x7f6cb80c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb81591f0 0x7f6cb815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb815b830 con 0x7f6cb8067770 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb815ac20 con 0x7f6cb81591f0 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb815af00 con 0x7f6cb80ca5d0 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb81524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb81524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40524/0 (socket says 172.21.15.3:40524) 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 -- 172.21.15.3:0/383638394 learned_addr learned my addr 172.21.15.3:0/383638394 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:21.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbd481700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6cb80ca5d0 0x7f6cb80c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbe483700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb81591f0 0x7f6cb815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 -- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6cb80ca5d0 msgr2=0x7f6cb80c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6cb80ca5d0 0x7f6cb80c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 -- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb81591f0 msgr2=0x7f6cb815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb81591f0 0x7f6cb815bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 -- 172.21.15.3:0/383638394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0009a20 con 0x7f6cb8067770 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbd481700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6cb80ca5d0 0x7f6cb80c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:21.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbdc82700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb81524c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400c590 tx=0x7f6cb4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4005b30 con 0x7f6cb8067770 2023-10-08T16:07:21.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb4005cb0 con 0x7f6cb8067770 2023-10-08T16:07:21.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb815b1e0 con 0x7f6cb8067770 2023-10-08T16:07:21.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4007320 con 0x7f6cb8067770 2023-10-08T16:07:21.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.438+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb80c4ae0 con 0x7f6cb8067770 2023-10-08T16:07:21.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.442+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb804be40 con 0x7f6cb8067770 2023-10-08T16:07:21.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.442+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6cb401b3b0 con 0x7f6cb8067770 2023-10-08T16:07:21.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.442+0000 7f6ca9ffb700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c9c060550 0x7f6c9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.442+0000 7f6cbd481700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c9c060550 0x7f6c9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.442+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6cb407ba70 con 0x7f6cb8067770 2023-10-08T16:07:21.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.446+0000 7f6cbd481700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c9c060550 0x7f6c9c062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6cac007fd0 tx=0x7f6cac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.454+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6cb404c3b0 con 0x7f6cb8067770 2023-10-08T16:07:21.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.670+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6cb806b990 con 0x7f6cb8067770 2023-10-08T16:07:21.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6ca9ffb700 1 -- 172.21.15.3:0/383638394 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6cb4017020 con 0x7f6cb8067770 2023-10-08T16:07:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:07:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T16:07:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl1/8ILhAAyKLwO7/Ctogmlzw9Nlh2EQ==", 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJlCvCjNBAAfhsbLyOg/EVp1XW4Jr9LJQ==", 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.c", 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJlP70ZMRAAh+ahn+CKXBXJJV57hLmsbg==", 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.d", 2023-10-08T16:07:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl9Z7hNxAAcAN+TJ5pxlpl9HjSannwCA==", 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBZ0yJlgfzEKhAAwDxiw16aqOzNkcJbCI4ncQ==", 2023-10-08T16:07:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBd0yJlPl4WARAAhXD6n5SOm0mEbZzn4cToYw==", 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBg0yJlNSseBBAA/Xzx+O6bgrc4W0BhSzhumw==", 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBj0yJlskmsCRAAOmjrOSwgaxuwXWy93JU8OQ==", 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBo0yJl/HqaMhAAHDfaHSmtumyI9YZILWACkw==", 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBs0yJlsxHeCRAA00mNdz2Cs7DmNX6QTIDZZA==", 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBv0yJlRzR5DBAASd+vxCwHW4+cqcY7han+6g==", 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBy0yJlwAt6ERAAy9CTIOqeZgW7mx0SPn6w4g==", 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlZDIHAhAAzDCJhj1kSsHWF6uzqAZX+A==", 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T16:07:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlI3TABxAA3Q9fhC7mcsEG6gTgZf++7g==", 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlOeq5BBAAHe7rJQfMMjJdT9T25nAvXQ==", 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.3", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlGXuSChAA8kVCX/d1wfYqXJmwS2nfUA==", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:07:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl7GP9HxAAk8e6OU1qzs8bZSQCHUHe0A==", 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-mds", 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQB30yJlfQdBHRAA2N/ksI9P3NQO9g1rneF4Fg==", 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQB30yJlLSVBHRAAqkHCUl4vwgYuHHRq+skCgg==", 2023-10-08T16:07:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-osd", 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQB30yJlCjtBHRAA/Xp1xUXhEbKNmQeyPV55vg==", 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQB30yJlJFNBHRAAczkUQ1iJQcrYWpKX81nGEA==", 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQB30yJlUWlBHRAANCIzCYpM32SoRWB059LGmA==", 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T16:07:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQB30yJl239BHRAAPbfO+a9SIXaYY0bH8GxRsw==", 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJltBo5KxAAiIBcjJ0B063R9P6Xu6cOHQ==", 2023-10-08T16:07:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl7/U/KBAAQmD+MsjUF24AqK2YG+MMMg==", 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T16:07:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:07:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:07:21.697 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:07:21.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c9c060550 msgr2=0x7f6c9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c9c060550 0x7f6c9c062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6cac007fd0 tx=0x7f6cac009040 comp rx=0 tx=0).stop 2023-10-08T16:07:21.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 msgr2=0x7f6cb81524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb81524c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400c590 tx=0x7f6cb4007e00 comp rx=0 tx=0).stop 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 shutdown_connections 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c9c060550 0x7f6c9c062a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb81591f0 0x7f6cb815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6cb80ca5d0 0x7f6cb80c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 --2- 172.21.15.3:0/383638394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cb8067770 0x7f6cb81524c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 >> 172.21.15.3:0/383638394 conn(0x7f6cb80cfd80 msgr2=0x7f6cb80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 shutdown_connections 2023-10-08T16:07:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.674+0000 7f6cbec84700 1 -- 172.21.15.3:0/383638394 wait complete. 2023-10-08T16:07:21.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T16:07:21.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 Processor -- start 2023-10-08T16:07:21.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 -- start start 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3ff00c90c0 0x7f3ff01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ff0157910 0x7f3ff006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff006c700 con 0x7f3ff0157000 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff01584a0 con 0x7f3ff0157910 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff00c95c0 con 0x7f3ff00c90c0 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ff0157910 0x7f3ff006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3ff0157910 0x7f3ff006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40540/0 (socket says 172.21.15.3:40540) 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3fef7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3ff0157000 0x7f3ff00c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33144/0 (socket says 172.21.15.3:33144) 2023-10-08T16:07:21.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 -- 172.21.15.3:0/1723835582 learned_addr learned my addr 172.21.15.3:0/1723835582 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:21.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feeffd700 1 --2- 172.21.15.3:0/1723835582 >> v2:172.21.15.27:3300/0 conn(0x7f3ff00c90c0 0x7f3ff01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 -- 172.21.15.3:0/1723835582 >> v2:172.21.15.27:3300/0 conn(0x7f3ff00c90c0 msgr2=0x7f3ff01573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:21.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 --2- 172.21.15.3:0/1723835582 >> v2:172.21.15.27:3300/0 conn(0x7f3ff00c90c0 0x7f3ff01573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 -- 172.21.15.3:0/1723835582 >> v1:172.21.15.3:6789/0 conn(0x7f3ff0157000 legacy=0x7f3ff00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3fee7fc700 1 -- 172.21.15.3:0/1723835582 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956358080 0 0) 0x7f3ff006c700 con 0x7f3ff0157000 2023-10-08T16:07:21.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 -- 172.21.15.3:0/1723835582 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff00c98a0 con 0x7f3ff0157910 2023-10-08T16:07:21.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3feffff700 1 --2- 172.21.15.3:0/1723835582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff006cb90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ff006a110 tx=0x7f3fe8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c255a4ce003386f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3fee7fc700 1 -- 172.21.15.3:0/1723835582 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800e070 con 0x7f3ff0157910 2023-10-08T16:07:21.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3fee7fc700 1 -- 172.21.15.3:0/1723835582 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe800ba20 con 0x7f3ff0157910 2023-10-08T16:07:21.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3fee7fc700 1 -- 172.21.15.3:0/1723835582 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80092e0 con 0x7f3ff0157910 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 -- 172.21.15.3:0/1723835582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 msgr2=0x7f3ff006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.806+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/1723835582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff006cb90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ff006a110 tx=0x7f3fe8009840 comp rx=0 tx=0).stop 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- 172.21.15.3:0/1723835582 shutdown_connections 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/1723835582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff006cb90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/1723835582 >> v2:172.21.15.27:3300/0 conn(0x7f3ff00c90c0 0x7f3ff01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- 172.21.15.3:0/1723835582 >> 172.21.15.3:0/1723835582 conn(0x7f3ff0069d10 msgr2=0x7f3ff00cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- 172.21.15.3:0/1723835582 shutdown_connections 2023-10-08T16:07:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- 172.21.15.3:0/1723835582 wait complete. 2023-10-08T16:07:21.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 Processor -- start 2023-10-08T16:07:21.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- start start 2023-10-08T16:07:21.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ff00c90c0 0x7f3ff00c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ff0157000 0x7f3ff01560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff0148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00c2010 con 0x7f3ff0157910 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00c67a0 con 0x7f3ff00c90c0 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3ff5d47700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00c2290 con 0x7f3ff0157000 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff0148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff0148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40542/0 (socket says 172.21.15.3:40542) 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 -- 172.21.15.3:0/2322625243 learned_addr learned my addr 172.21.15.3:0/2322625243 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feeffd700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ff0157000 0x7f3ff01560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3fef7fe700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ff00c90c0 0x7f3ff00c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 -- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ff0157000 msgr2=0x7f3ff01560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ff0157000 0x7f3ff01560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 -- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ff00c90c0 msgr2=0x7f3ff00c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ff00c90c0 0x7f3ff00c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 -- 172.21.15.3:0/2322625243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009ae0 con 0x7f3ff0157910 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3fef7fe700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ff00c90c0 0x7f3ff00c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.810+0000 7f3feffff700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff0148cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009880 tx=0x7f3fe8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8008b70 con 0x7f3ff0157910 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8008cf0 con 0x7f3ff0157910 2023-10-08T16:07:21.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff00c2880 con 0x7f3ff0157910 2023-10-08T16:07:21.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe801c660 con 0x7f3ff0157910 2023-10-08T16:07:21.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff00c2e40 con 0x7f3ff0157910 2023-10-08T16:07:21.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff00c3060 con 0x7f3ff0157910 2023-10-08T16:07:21.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3fe8003040 con 0x7f3ff0157910 2023-10-08T16:07:21.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fd77fe700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3fdc060550 0x7f3fdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3fe807dc50 con 0x7f3ff0157910 2023-10-08T16:07:21.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.814+0000 7f3fef7fe700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3fdc060550 0x7f3fdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.818+0000 7f3fef7fe700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3fdc060550 0x7f3fdc062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00011e0 tx=0x7f3fe0007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:21.822+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3fe804e590 con 0x7f3ff0157910 2023-10-08T16:07:22.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.038+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3ff004be40 con 0x7f3ff0157910 2023-10-08T16:07:22.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3fd77fe700 1 -- 172.21.15.3:0/2322625243 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3fe8051bb0 con 0x7f3ff0157910 2023-10-08T16:07:22.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3fdc060550 msgr2=0x7f3fdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3fdc060550 0x7f3fdc062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00011e0 tx=0x7f3fe0007c90 comp rx=0 tx=0).stop 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 msgr2=0x7f3ff0148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff0148cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009880 tx=0x7f3fe8018000 comp rx=0 tx=0).stop 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 shutdown_connections 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3fdc060550 0x7f3fdc062a00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ff0157910 0x7f3ff0148cf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3ff0157000 0x7f3ff01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 --2- 172.21.15.3:0/2322625243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ff00c90c0 0x7f3ff00c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 >> 172.21.15.3:0/2322625243 conn(0x7f3ff0069d10 msgr2=0x7f3ff00cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.046+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 shutdown_connections 2023-10-08T16:07:22.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.050+0000 7f3ff5d47700 1 -- 172.21.15.3:0/2322625243 wait complete. 2023-10-08T16:07:22.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T16:07:22.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 Processor -- start 2023-10-08T16:07:22.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 -- start start 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7c7806aeb0 0x7f7c780ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7806c3a0 con 0x7f7c7806d900 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7806c8a0 con 0x7f7c780ca070 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7806cb40 con 0x7f7c7806aeb0 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c6effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7c7806aeb0 0x7f7c780ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c77fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7c7806d900 0x7f7c7815ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33150/0 (socket says 172.21.15.3:33150) 2023-10-08T16:07:22.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c77fff700 1 -- 172.21.15.3:0/3346960204 learned_addr learned my addr 172.21.15.3:0/3346960204 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:22.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c76ffd700 1 -- 172.21.15.3:0/3346960204 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678717896 0 0) 0x7f7c7806c3a0 con 0x7f7c7806d900 2023-10-08T16:07:22.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c6effd700 1 -- 172.21.15.3:0/3346960204 >> v1:172.21.15.27:6789/0 conn(0x7f7c780ca070 legacy=0x7f7c7806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c6effd700 1 -- 172.21.15.3:0/3346960204 >> v1:172.21.15.3:6789/0 conn(0x7f7c7806d900 legacy=0x7f7c7815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c6effd700 1 -- 172.21.15.3:0/3346960204 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7806ce20 con 0x7f7c7806aeb0 2023-10-08T16:07:22.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c6effd700 1 --2- 172.21.15.3:0/3346960204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7806aeb0 0x7f7c780ca440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009910 tx=0x7f7c600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ceb33a557723c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c76ffd700 1 -- 172.21.15.3:0/3346960204 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000b820 con 0x7f7c7806aeb0 2023-10-08T16:07:22.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c76ffd700 1 -- 172.21.15.3:0/3346960204 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000b980 con 0x7f7c7806aeb0 2023-10-08T16:07:22.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c76ffd700 1 -- 172.21.15.3:0/3346960204 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000bd20 con 0x7f7c7806aeb0 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 -- 172.21.15.3:0/3346960204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7806aeb0 msgr2=0x7f7c780ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.170+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/3346960204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7806aeb0 0x7f7c780ca440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009910 tx=0x7f7c600091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- 172.21.15.3:0/3346960204 shutdown_connections 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/3346960204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7806aeb0 0x7f7c780ca440 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- 172.21.15.3:0/3346960204 >> 172.21.15.3:0/3346960204 conn(0x7f7c780c83d0 msgr2=0x7f7c780c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- 172.21.15.3:0/3346960204 shutdown_connections 2023-10-08T16:07:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- 172.21.15.3:0/3346960204 wait complete. 2023-10-08T16:07:22.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 Processor -- start 2023-10-08T16:07:22.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- start start 2023-10-08T16:07:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c7806d900 0x7f7c78150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7c780ca070 0x7f7c78150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 0x7f7c78157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78152f40 con 0x7f7c78152aa0 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780aefa0 con 0x7f7c7806d900 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c7cb13700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78153180 con 0x7f7c780ca070 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 0x7f7c78157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 0x7f7c78157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40562/0 (socket says 172.21.15.3:40562) 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 -- 172.21.15.3:0/488958373 learned_addr learned my addr 172.21.15.3:0/488958373 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c6effd700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7c780ca070 0x7f7c78150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c777fe700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c7806d900 0x7f7c78150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 -- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7c780ca070 msgr2=0x7f7c78150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7c780ca070 0x7f7c78150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 -- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c7806d900 msgr2=0x7f7c78150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c7806d900 0x7f7c78150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 -- 172.21.15.3:0/488958373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009420 con 0x7f7c78152aa0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.174+0000 7f7c77fff700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 0x7f7c78157150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cc90 tx=0x7f7c70001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000a870 con 0x7f7c78152aa0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000a9d0 con 0x7f7c78152aa0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c78153460 con 0x7f7c78152aa0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000ad90 con 0x7f7c78152aa0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c780aec30 con 0x7f7c78152aa0 2023-10-08T16:07:22.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7804be40 con 0x7f7c78152aa0 2023-10-08T16:07:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7c70007300 con 0x7f7c78152aa0 2023-10-08T16:07:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.178+0000 7f7c6ffff700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7c58060550 0x7f7c58062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.182+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7c7007c7e0 con 0x7f7c78152aa0 2023-10-08T16:07:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.182+0000 7f7c777fe700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7c58060550 0x7f7c58062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.182+0000 7f7c777fe700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7c58060550 0x7f7c58062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c780688e0 tx=0x7f7c68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.186+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c7004d1a0 con 0x7f7c78152aa0 2023-10-08T16:07:22.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.406+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7c7806d100 con 0x7f7c78152aa0 2023-10-08T16:07:22.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.410+0000 7f7c6ffff700 1 -- 172.21.15.3:0/488958373 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c700507c0 con 0x7f7c78152aa0 2023-10-08T16:07:22.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7c58060550 msgr2=0x7f7c58062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7c58060550 0x7f7c58062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c780688e0 tx=0x7f7c68009040 comp rx=0 tx=0).stop 2023-10-08T16:07:22.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 msgr2=0x7f7c78157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 0x7f7c78157150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cc90 tx=0x7f7c70001a20 comp rx=0 tx=0).stop 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 shutdown_connections 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7c58060550 0x7f7c58062a00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c78152aa0 0x7f7c78157150 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f7c780ca070 0x7f7c78150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 --2- 172.21.15.3:0/488958373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c7806d900 0x7f7c78150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 >> 172.21.15.3:0/488958373 conn(0x7f7c780c83d0 msgr2=0x7f7c780c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 shutdown_connections 2023-10-08T16:07:22.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.414+0000 7f7c7cb13700 1 -- 172.21.15.3:0/488958373 wait complete. 2023-10-08T16:07:22.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T16:07:22.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ef59e700 1 Processor -- start 2023-10-08T16:07:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ef59e700 1 -- start start 2023-10-08T16:07:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ef59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f61f00ade60 0x7f61f00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ef59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f01562c0 con 0x7f61f00ae230 2023-10-08T16:07:22.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ef59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f006b0b0 con 0x7f61f00c7d70 2023-10-08T16:07:22.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ef59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f006b390 con 0x7f61f00ade60 2023-10-08T16:07:22.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ee59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f61f00ade60 0x7f61f00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61edd9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f61f00ae230 0x7f61f00c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33160/0 (socket says 172.21.15.3:33160) 2023-10-08T16:07:22.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61edd9b700 1 -- 172.21.15.3:0/1913009338 learned_addr learned my addr 172.21.15.3:0/1913009338 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:22.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ed59a700 1 -- 172.21.15.3:0/1913009338 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289504149 0 0) 0x7f61f01562c0 con 0x7f61f00ae230 2023-10-08T16:07:22.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ed59a700 1 -- 172.21.15.3:0/1913009338 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61dc003570 con 0x7f61f00ae230 2023-10-08T16:07:22.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ee59c700 1 -- 172.21.15.3:0/1913009338 >> v1:172.21.15.27:6789/0 conn(0x7f61f00c7d70 legacy=0x7f61f00ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ee59c700 1 -- 172.21.15.3:0/1913009338 >> v1:172.21.15.3:6789/0 conn(0x7f61f00ae230 legacy=0x7f61f00c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ee59c700 1 -- 172.21.15.3:0/1913009338 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f006b670 con 0x7f61f00ade60 2023-10-08T16:07:22.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ee59c700 1 --2- 172.21.15.3:0/1913009338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ade60 0x7f61f00cae50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098e0 tx=0x7f61e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fdaee061d2cc2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ed59a700 1 -- 172.21.15.3:0/1913009338 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000b640 con 0x7f61f00ade60 2023-10-08T16:07:22.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ed59a700 1 -- 172.21.15.3:0/1913009338 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000b7a0 con 0x7f61f00ade60 2023-10-08T16:07:22.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.542+0000 7f61ed59a700 1 -- 172.21.15.3:0/1913009338 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000bb40 con 0x7f61f00ade60 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 -- 172.21.15.3:0/1913009338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ade60 msgr2=0x7f61f00cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1913009338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ade60 0x7f61f00cae50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098e0 tx=0x7f61e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 -- 172.21.15.3:0/1913009338 shutdown_connections 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1913009338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ade60 0x7f61f00cae50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 -- 172.21.15.3:0/1913009338 >> 172.21.15.3:0/1913009338 conn(0x7f61f00c83d0 msgr2=0x7f61f00c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 -- 172.21.15.3:0/1913009338 shutdown_connections 2023-10-08T16:07:22.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 -- 172.21.15.3:0/1913009338 wait complete. 2023-10-08T16:07:22.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 Processor -- start 2023-10-08T16:07:22.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.546+0000 7f61ef59e700 1 -- start start 2023-10-08T16:07:22.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61f00ade60 0x7f61f00c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 0x7f61f014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61f00c7d70 0x7f61f00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c3c90 con 0x7f61f00ae230 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c3080 con 0x7f61f00c7d70 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c3360 con 0x7f61f00ade60 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 0x7f61f014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 0x7f61f014a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40574/0 (socket says 172.21.15.3:40574) 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 -- 172.21.15.3:0/1862979406 learned_addr learned my addr 172.21.15.3:0/1862979406 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ee59c700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61f00ade60 0x7f61f00c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61eed9d700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61f00c7d70 0x7f61f00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 -- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61f00ade60 msgr2=0x7f61f00c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61f00ade60 0x7f61f00c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 -- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61f00c7d70 msgr2=0x7f61f00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61f00c7d70 0x7f61f00c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 -- 172.21.15.3:0/1862979406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009420 con 0x7f61f00ae230 2023-10-08T16:07:22.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61eed9d700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61f00c7d70 0x7f61f00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:22.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61edd9b700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 0x7f61f014a800 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7c0 tx=0x7f61d8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8005b30 con 0x7f61f00ae230 2023-10-08T16:07:22.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d8005cb0 con 0x7f61f00ae230 2023-10-08T16:07:22.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f00c3640 con 0x7f61f00ae230 2023-10-08T16:07:22.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8007320 con 0x7f61f00ae230 2023-10-08T16:07:22.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f0153b50 con 0x7f61f00ae230 2023-10-08T16:07:22.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.550+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f004be40 con 0x7f61f00ae230 2023-10-08T16:07:22.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.554+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61d801b3b0 con 0x7f61f00ae230 2023-10-08T16:07:22.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.554+0000 7f61e67fc700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61d0060550 0x7f61d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.554+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f61d807ba00 con 0x7f61f00ae230 2023-10-08T16:07:22.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.554+0000 7f61ee59c700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61d0060550 0x7f61d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.554+0000 7f61ee59c700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61d0060550 0x7f61d0062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61e00093f0 tx=0x7f61e0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.562+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61d804c2a0 con 0x7f61f00ae230 2023-10-08T16:07:22.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.782+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f61f0068860 con 0x7f61f00ae230 2023-10-08T16:07:22.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.794+0000 7f61e67fc700 1 -- 172.21.15.3:0/1862979406 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f61d80170a0 con 0x7f61f00ae230 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.794+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61d0060550 msgr2=0x7f61d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.794+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61d0060550 0x7f61d0062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61e00093f0 tx=0x7f61e0017000 comp rx=0 tx=0).stop 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.794+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 msgr2=0x7f61f014a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.794+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 0x7f61f014a800 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7c0 tx=0x7f61d8007e00 comp rx=0 tx=0).stop 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 shutdown_connections 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f61d0060550 0x7f61d0062a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61f00c7d70 0x7f61f00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61f00ae230 0x7f61f014a800 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 --2- 172.21.15.3:0/1862979406 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61f00ade60 0x7f61f00c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 >> 172.21.15.3:0/1862979406 conn(0x7f61f00c83d0 msgr2=0x7f61f0155670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 shutdown_connections 2023-10-08T16:07:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.798+0000 7f61ef59e700 1 -- 172.21.15.3:0/1862979406 wait complete. 2023-10-08T16:07:22.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T16:07:22.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 Processor -- start 2023-10-08T16:07:22.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 -- start start 2023-10-08T16:07:22.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156fe0 0x7f869c068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f869c069500 0x7f869c068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c0c7720 con 0x7f869c156c10 2023-10-08T16:07:22.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c0c6b10 con 0x7f869c069500 2023-10-08T16:07:22.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f86a0b07700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c6df0 con 0x7f869c156fe0 2023-10-08T16:07:22.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f869a59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f869c156c10 0x7f869c0abfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33170/0 (socket says 172.21.15.3:33170) 2023-10-08T16:07:22.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f869a59c700 1 -- 172.21.15.3:0/3914432587 learned_addr learned my addr 172.21.15.3:0/3914432587 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:22.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.922+0000 7f869ad9d700 1 --2- 172.21.15.3:0/3914432587 >> v2:172.21.15.3:3300/0 conn(0x7f869c069500 0x7f869c068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f8691d9b700 1 --2- 172.21.15.3:0/3914432587 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156fe0 0x7f869c068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f8699d9b700 1 -- 172.21.15.3:0/3914432587 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291270087 0 0) 0x7f869c0c7720 con 0x7f869c156c10 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f8699d9b700 1 -- 172.21.15.3:0/3914432587 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8688003570 con 0x7f869c156c10 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f869ad9d700 1 -- 172.21.15.3:0/3914432587 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156fe0 msgr2=0x7f869c068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f869ad9d700 1 --2- 172.21.15.3:0/3914432587 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156fe0 0x7f869c068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f869ad9d700 1 -- 172.21.15.3:0/3914432587 >> v1:172.21.15.3:6789/0 conn(0x7f869c156c10 legacy=0x7f869c0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f869ad9d700 1 -- 172.21.15.3:0/3914432587 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c0c70d0 con 0x7f869c069500 2023-10-08T16:07:22.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f869ad9d700 1 --2- 172.21.15.3:0/3914432587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c069500 0x7f869c068280 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8694009e60 tx=0x7f8694009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cec4d694805613 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f8699d9b700 1 -- 172.21.15.3:0/3914432587 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400e070 con 0x7f869c069500 2023-10-08T16:07:22.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f8699d9b700 1 -- 172.21.15.3:0/3914432587 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869400bab0 con 0x7f869c069500 2023-10-08T16:07:22.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f8699d9b700 1 -- 172.21.15.3:0/3914432587 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400be30 con 0x7f869c069500 2023-10-08T16:07:22.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 -- 172.21.15.3:0/3914432587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c069500 msgr2=0x7f869c068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 --2- 172.21.15.3:0/3914432587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c069500 0x7f869c068280 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8694009e60 tx=0x7f8694009780 comp rx=0 tx=0).stop 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 -- 172.21.15.3:0/3914432587 shutdown_connections 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 --2- 172.21.15.3:0/3914432587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c069500 0x7f869c068280 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 --2- 172.21.15.3:0/3914432587 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156fe0 0x7f869c068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 -- 172.21.15.3:0/3914432587 >> 172.21.15.3:0/3914432587 conn(0x7f869c0c8da0 msgr2=0x7f869c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 -- 172.21.15.3:0/3914432587 shutdown_connections 2023-10-08T16:07:22.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.926+0000 7f86a0b07700 1 -- 172.21.15.3:0/3914432587 wait complete. 2023-10-08T16:07:22.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 Processor -- start 2023-10-08T16:07:22.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 -- start start 2023-10-08T16:07:22.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f869c069500 0x7f869c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156c10 0x7f869c0c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 0x7f869c0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c166db0 con 0x7f869c156fe0 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c5710 con 0x7f869c069500 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f86a0b07700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c167920 con 0x7f869c156c10 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f869ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 0x7f869c0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f869ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 0x7f869c0c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40588/0 (socket says 172.21.15.3:40588) 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.930+0000 7f869ad9d700 1 -- 172.21.15.3:0/2337431049 learned_addr learned my addr 172.21.15.3:0/2337431049 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8691d9b700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156c10 0x7f869c0c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869a59c700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f869c069500 0x7f869c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869ad9d700 1 -- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156c10 msgr2=0x7f869c0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869ad9d700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156c10 0x7f869c0c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869ad9d700 1 -- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f869c069500 msgr2=0x7f869c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869ad9d700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f869c069500 0x7f869c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869ad9d700 1 -- 172.21.15.3:0/2337431049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694009a20 con 0x7f869c156fe0 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869a59c700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f869c069500 0x7f869c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869ad9d700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 0x7f869c0c1610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f869c06f4e0 tx=0x7f8694019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694027470 con 0x7f869c156fe0 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694027610 con 0x7f869c156fe0 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c167db0 con 0x7f869c156fe0 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940279d0 con 0x7f869c156fe0 2023-10-08T16:07:22.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c166ff0 con 0x7f869c156fe0 2023-10-08T16:07:22.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c167ad0 con 0x7f869c156fe0 2023-10-08T16:07:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8694024070 con 0x7f869c156fe0 2023-10-08T16:07:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8692ffd700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f867c060550 0x7f867c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f869407ed80 con 0x7f869c156fe0 2023-10-08T16:07:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.934+0000 7f869a59c700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f867c060550 0x7f867c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.938+0000 7f869a59c700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f867c060550 0x7f867c062a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:22.942+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f869c167ad0 con 0x7f869c156fe0 2023-10-08T16:07:23.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.162+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f869c167a90 con 0x7f869c156fe0 2023-10-08T16:07:23.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f8692ffd700 1 -- 172.21.15.3:0/2337431049 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f869404f6c0 con 0x7f869c156fe0 2023-10-08T16:07:23.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f867c060550 msgr2=0x7f867c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f867c060550 0x7f867c062a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c009040 comp rx=0 tx=0).stop 2023-10-08T16:07:23.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 msgr2=0x7f869c0c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 0x7f869c0c1610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f869c06f4e0 tx=0x7f8694019000 comp rx=0 tx=0).stop 2023-10-08T16:07:23.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 shutdown_connections 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f867c060550 0x7f867c062a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f869c156fe0 0x7f869c0c1610 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f869c156c10 0x7f869c0c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 --2- 172.21.15.3:0/2337431049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f869c069500 0x7f869c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 >> 172.21.15.3:0/2337431049 conn(0x7f869c0c8da0 msgr2=0x7f869c154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 shutdown_connections 2023-10-08T16:07:23.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.170+0000 7f86a0b07700 1 -- 172.21.15.3:0/2337431049 wait complete. 2023-10-08T16:07:23.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T16:07:23.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 Processor -- start 2023-10-08T16:07:23.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- start start 2023-10-08T16:07:23.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f61540ca5d0 0x7f61540caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615406ce20 con 0x7f6154067060 2023-10-08T16:07:23.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61540cb090 con 0x7f61540ca5d0 2023-10-08T16:07:23.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540cb370 con 0x7f61541591f0 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615359e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6154067060 0x7f615406d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33178/0 (socket says 172.21.15.3:33178) 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615359e700 1 -- 172.21.15.3:0/607319915 learned_addr learned my addr 172.21.15.3:0/607319915 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f614a59c700 1 --2- 172.21.15.3:0/607319915 >> v2:172.21.15.27:3300/0 conn(0x7f61540ca5d0 0x7f61540caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f6152d9d700 1 --2- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615259c700 1 -- 172.21.15.3:0/607319915 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073421384 0 0) 0x7f615406ce20 con 0x7f6154067060 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615259c700 1 -- 172.21.15.3:0/607319915 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6140003570 con 0x7f6154067060 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f614a59c700 1 -- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 msgr2=0x7f61540b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f614a59c700 1 --2- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f614a59c700 1 -- 172.21.15.3:0/607319915 >> v1:172.21.15.3:6789/0 conn(0x7f6154067060 legacy=0x7f615406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f614a59c700 1 -- 172.21.15.3:0/607319915 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540cb650 con 0x7f61540ca5d0 2023-10-08T16:07:23.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f614a59c700 1 --2- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61540ca5d0 0x7f61540caa40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f613c0098e0 tx=0x7f613c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daabed7c303ccc48 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615259c700 1 -- 172.21.15.3:0/607319915 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011630 con 0x7f61540ca5d0 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615259c700 1 -- 172.21.15.3:0/607319915 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c011790 con 0x7f61540ca5d0 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615259c700 1 -- 172.21.15.3:0/607319915 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011b10 con 0x7f61540ca5d0 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61540ca5d0 msgr2=0x7f61540caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 --2- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61540ca5d0 0x7f61540caa40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f613c0098e0 tx=0x7f613c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- 172.21.15.3:0/607319915 shutdown_connections 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 --2- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61540ca5d0 0x7f61540caa40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 --2- 172.21.15.3:0/607319915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- 172.21.15.3:0/607319915 >> 172.21.15.3:0/607319915 conn(0x7f61540cfd80 msgr2=0x7f61540d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:23.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- 172.21.15.3:0/607319915 shutdown_connections 2023-10-08T16:07:23.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.302+0000 7f615898b700 1 -- 172.21.15.3:0/607319915 wait complete. 2023-10-08T16:07:23.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 Processor -- start 2023-10-08T16:07:23.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 -- start start 2023-10-08T16:07:23.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6154067060 0x7f61541515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 0x7f61540c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540c3880 con 0x7f61540ca5d0 2023-10-08T16:07:23.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540c3ad0 con 0x7f6154067060 2023-10-08T16:07:23.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540c3db0 con 0x7f61541591f0 2023-10-08T16:07:23.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 0x7f61540c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 0x7f61540c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40590/0 (socket says 172.21.15.3:40590) 2023-10-08T16:07:23.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 -- 172.21.15.3:0/581986511 learned_addr learned my addr 172.21.15.3:0/581986511 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:23.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f6152d9d700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6154067060 0x7f61541515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615359e700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 -- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 msgr2=0x7f61540c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 -- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6154067060 msgr2=0x7f61541515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6154067060 0x7f61541515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 -- 172.21.15.3:0/581986511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c009420 con 0x7f61540ca5d0 2023-10-08T16:07:23.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614a59c700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 0x7f61540c7f70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f615406a0f0 tx=0x7f613c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:23.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011900 con 0x7f61540ca5d0 2023-10-08T16:07:23.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c011a60 con 0x7f61540ca5d0 2023-10-08T16:07:23.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.306+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61540c4090 con 0x7f61540ca5d0 2023-10-08T16:07:23.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c01a680 con 0x7f61540ca5d0 2023-10-08T16:07:23.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6154151b00 con 0x7f61540ca5d0 2023-10-08T16:07:23.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61540c4590 con 0x7f61540ca5d0 2023-10-08T16:07:23.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f613c01aab0 con 0x7f61540ca5d0 2023-10-08T16:07:23.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f614b7fe700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6134060550 0x7f6134062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f613c07df60 con 0x7f61540ca5d0 2023-10-08T16:07:23.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.310+0000 7f6152d9d700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6134060550 0x7f6134062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.314+0000 7f6152d9d700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6134060550 0x7f6134062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6144009d10 tx=0x7f61440091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:23.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.318+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f613c04e800 con 0x7f61540ca5d0 2023-10-08T16:07:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.538+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f615404be40 con 0x7f61540ca5d0 2023-10-08T16:07:23.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f614b7fe700 1 -- 172.21.15.3:0/581986511 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f613c051e20 con 0x7f61540ca5d0 2023-10-08T16:07:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6134060550 msgr2=0x7f6134062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6134060550 0x7f6134062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6144009d10 tx=0x7f61440091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 msgr2=0x7f61540c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 0x7f61540c7f70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f615406a0f0 tx=0x7f613c017000 comp rx=0 tx=0).stop 2023-10-08T16:07:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 shutdown_connections 2023-10-08T16:07:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6134060550 0x7f6134062a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f61541591f0 0x7f61540c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61540ca5d0 0x7f61540c7f70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 --2- 172.21.15.3:0/581986511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6154067060 0x7f61541515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 >> 172.21.15.3:0/581986511 conn(0x7f61540cfd80 msgr2=0x7f61541524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 shutdown_connections 2023-10-08T16:07:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.546+0000 7f615898b700 1 -- 172.21.15.3:0/581986511 wait complete. 2023-10-08T16:07:23.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T16:07:23.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.670+0000 7f020359e700 1 Processor -- start 2023-10-08T16:07:23.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.670+0000 7f020359e700 1 -- start start 2023-10-08T16:07:23.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0204155ba0 0x7f02040af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155f70 0x7f02040c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02040c8fd0 con 0x7f02040afd60 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040c83c0 con 0x7f0204155ba0 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02040c86a0 con 0x7f0204155f70 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f0202d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f02040afd60 0x7f02040ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33194/0 (socket says 172.21.15.3:33194) 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0204155ba0 0x7f02040af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f0202d9d700 1 -- 172.21.15.3:0/532326745 learned_addr learned my addr 172.21.15.3:0/532326745 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f0201d9b700 1 --2- 172.21.15.3:0/532326745 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155f70 0x7f02040c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020159a700 1 -- 172.21.15.3:0/532326745 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201527170 0 0) 0x7f02040c8fd0 con 0x7f02040afd60 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020159a700 1 -- 172.21.15.3:0/532326745 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ec003570 con 0x7f02040afd60 2023-10-08T16:07:23.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020259c700 1 -- 172.21.15.3:0/532326745 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155f70 msgr2=0x7f02040c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:23.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020259c700 1 --2- 172.21.15.3:0/532326745 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155f70 0x7f02040c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020259c700 1 -- 172.21.15.3:0/532326745 >> v1:172.21.15.3:6789/0 conn(0x7f02040afd60 legacy=0x7f02040ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020159a700 1 -- 172.21.15.3:0/532326745 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1324291211 0 0) 0x7f01ec003570 con 0x7f02040afd60 2023-10-08T16:07:23.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020259c700 1 -- 172.21.15.3:0/532326745 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040c8980 con 0x7f0204155ba0 2023-10-08T16:07:23.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020259c700 1 --2- 172.21.15.3:0/532326745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f02040af820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01f40098e0 tx=0x7f01f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeeac779d4214c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020159a700 1 -- 172.21.15.3:0/532326745 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0017f0 con 0x7f0204155ba0 2023-10-08T16:07:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020159a700 1 -- 172.21.15.3:0/532326745 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f4011420 con 0x7f0204155ba0 2023-10-08T16:07:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020159a700 1 -- 172.21.15.3:0/532326745 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40117a0 con 0x7f0204155ba0 2023-10-08T16:07:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- 172.21.15.3:0/532326745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 msgr2=0x7f02040af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 --2- 172.21.15.3:0/532326745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f02040af820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01f40098e0 tx=0x7f01f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- 172.21.15.3:0/532326745 shutdown_connections 2023-10-08T16:07:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 --2- 172.21.15.3:0/532326745 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155f70 0x7f02040c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 --2- 172.21.15.3:0/532326745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f02040af820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- 172.21.15.3:0/532326745 >> 172.21.15.3:0/532326745 conn(0x7f020406b6b0 msgr2=0x7f020406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- 172.21.15.3:0/532326745 shutdown_connections 2023-10-08T16:07:23.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.674+0000 7f020359e700 1 -- 172.21.15.3:0/532326745 wait complete. 2023-10-08T16:07:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 Processor -- start 2023-10-08T16:07:23.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 -- start start 2023-10-08T16:07:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02040afd60 0x7f02041588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f0204154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155280 0x7f020414d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02040c4230 con 0x7f0204155ba0 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02040c3c40 con 0x7f02040afd60 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0204156d60 con 0x7f0204155280 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f0204154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f0204154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40598/0 (socket says 172.21.15.3:40598) 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 -- 172.21.15.3:0/2485814652 learned_addr learned my addr 172.21.15.3:0/2485814652 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0202d9d700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155280 0x7f020414d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f020259c700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02040afd60 0x7f02041588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 -- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155280 msgr2=0x7f020414d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155280 0x7f020414d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 -- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02040afd60 msgr2=0x7f02041588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02040afd60 0x7f02041588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.678+0000 7f0201d9b700 1 -- 172.21.15.3:0/2485814652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4009420 con 0x7f0204155ba0 2023-10-08T16:07:23.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f0201d9b700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f0204154d40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f01f800e960 tx=0x7f01f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8013680 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80137e0 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0204157020 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8013b80 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02040c3f40 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02040c6db0 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01f800c490 con 0x7f0204155ba0 2023-10-08T16:07:23.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f01f27fc700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01e4060550 0x7f01e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f020259c700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01e4060550 0x7f01e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:23.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.682+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f01f807cdf0 con 0x7f0204155ba0 2023-10-08T16:07:23.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.686+0000 7f020259c700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01e4060550 0x7f01e4062a00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f01f40091e0 tx=0x7f01f4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:23.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.690+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01f804d710 con 0x7f0204155ba0 2023-10-08T16:07:23.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.910+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f02041574f0 con 0x7f0204155ba0 2023-10-08T16:07:23.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.918+0000 7f01f27fc700 1 -- 172.21.15.3:0/2485814652 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f01f80170a0 con 0x7f0204155ba0 2023-10-08T16:07:23.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01e4060550 msgr2=0x7f01e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01e4060550 0x7f01e4062a00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f01f40091e0 tx=0x7f01f4016000 comp rx=0 tx=0).stop 2023-10-08T16:07:23.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 msgr2=0x7f0204154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:23.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f0204154d40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f01f800e960 tx=0x7f01f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 shutdown_connections 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01e4060550 0x7f01e4062a00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0204155280 0x7f020414d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0204155ba0 0x7f0204154d40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 --2- 172.21.15.3:0/2485814652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02040afd60 0x7f02041588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 >> 172.21.15.3:0/2485814652 conn(0x7f020406b6b0 msgr2=0x7f02040b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 shutdown_connections 2023-10-08T16:07:23.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:23.922+0000 7f020359e700 1 -- 172.21.15.3:0/2485814652 wait complete. 2023-10-08T16:07:23.939 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 Processor -- start 2023-10-08T16:07:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 -- start start 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1e5806d3d0 0x7f1e5815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e58068280 0x7f1e580686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e58068c20 con 0x7f1e5815d290 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5806d880 con 0x7f1e5806d3d0 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5806db60 con 0x7f1e58068280 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e577fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1e5806d3d0 0x7f1e5815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e57fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1e5815d290 0x7f1e5806ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33198/0 (socket says 172.21.15.3:33198) 2023-10-08T16:07:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e57fff700 1 -- 172.21.15.3:0/1222642504 learned_addr learned my addr 172.21.15.3:0/1222642504 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5cfb2700 1 --2- 172.21.15.3:0/1222642504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e58068280 0x7f1e580686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e577fe700 1 -- 172.21.15.3:0/1222642504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e58068280 msgr2=0x7f1e580686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e577fe700 1 --2- 172.21.15.3:0/1222642504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e58068280 0x7f1e580686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e577fe700 1 -- 172.21.15.3:0/1222642504 >> v1:172.21.15.3:6789/0 conn(0x7f1e5815d290 legacy=0x7f1e5806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e577fe700 1 -- 172.21.15.3:0/1222642504 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5806de40 con 0x7f1e5806d3d0 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e56ffd700 1 -- 172.21.15.3:0/1222642504 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391901831 0 0) 0x7f1e48001490 con 0x7f1e5815d290 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e577fe700 1 --2- 172.21.15.3:0/1222642504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e5815d660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e400098e0 tx=0x7f1e400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ab488ed1a6f1fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e56ffd700 1 -- 172.21.15.3:0/1222642504 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000b640 con 0x7f1e5806d3d0 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e56ffd700 1 -- 172.21.15.3:0/1222642504 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000b7a0 con 0x7f1e5806d3d0 2023-10-08T16:07:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e56ffd700 1 -- 172.21.15.3:0/1222642504 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000bb40 con 0x7f1e5806d3d0 2023-10-08T16:07:24.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1222642504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 msgr2=0x7f1e5815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.042+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1222642504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e5815d660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e400098e0 tx=0x7f1e400091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1222642504 shutdown_connections 2023-10-08T16:07:24.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1222642504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e58068280 0x7f1e580686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1222642504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e5815d660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1222642504 >> 172.21.15.3:0/1222642504 conn(0x7f1e580c8de0 msgr2=0x7f1e580c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1222642504 shutdown_connections 2023-10-08T16:07:24.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1222642504 wait complete. 2023-10-08T16:07:24.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 Processor -- start 2023-10-08T16:07:24.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- start start 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e58068280 0x7f1e5814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e580cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e5815d290 0x7f1e580cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e580c6c80 con 0x7f1e5806d3d0 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5816d900 con 0x7f1e58068280 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5ea15700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5814ede0 con 0x7f1e5815d290 2023-10-08T16:07:24.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e580cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e580cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40628/0 (socket says 172.21.15.3:40628) 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 -- 172.21.15.3:0/1306118840 learned_addr learned my addr 172.21.15.3:0/1306118840 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e5cfb2700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e5815d290 0x7f1e580cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e57fff700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e58068280 0x7f1e5814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 -- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e5815d290 msgr2=0x7f1e580cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e5815d290 0x7f1e580cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 -- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e58068280 msgr2=0x7f1e5814e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e58068280 0x7f1e5814e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 -- 172.21.15.3:0/1306118840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e40009420 con 0x7f1e5806d3d0 2023-10-08T16:07:24.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.046+0000 7f1e577fe700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e580cb690 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1e400093f0 tx=0x7f1e40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40000bc0 con 0x7f1e5806d3d0 2023-10-08T16:07:24.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000b910 con 0x7f1e5806d3d0 2023-10-08T16:07:24.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40025670 con 0x7f1e5806d3d0 2023-10-08T16:07:24.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5816e140 con 0x7f1e5806d3d0 2023-10-08T16:07:24.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e580c6a50 con 0x7f1e5806d3d0 2023-10-08T16:07:24.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1e40023070 con 0x7f1e5806d3d0 2023-10-08T16:07:24.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5816e2d0 con 0x7f1e5806d3d0 2023-10-08T16:07:24.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e4ffff700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1e3c060550 0x7f1e3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1e4007d740 con 0x7f1e5806d3d0 2023-10-08T16:07:24.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e57fff700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1e3c060550 0x7f1e3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.050+0000 7f1e57fff700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1e3c060550 0x7f1e3c062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e580c3ba0 tx=0x7f1e48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.058+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e4004e080 con 0x7f1e5806d3d0 2023-10-08T16:07:24.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e5804be40 con 0x7f1e5806d3d0 2023-10-08T16:07:24.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e4ffff700 1 -- 172.21.15.3:0/1306118840 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12038 (secure 0 0 0) 0x7f1e400516a0 con 0x7f1e5806d3d0 2023-10-08T16:07:24.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:24.226 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:21.289879+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:24.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1e3c060550 msgr2=0x7f1e3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1e3c060550 0x7f1e3c062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e580c3ba0 tx=0x7f1e48009040 comp rx=0 tx=0).stop 2023-10-08T16:07:24.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 msgr2=0x7f1e580cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e580cb690 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1e400093f0 tx=0x7f1e40017000 comp rx=0 tx=0).stop 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 shutdown_connections 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1e3c060550 0x7f1e3c062a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1e5815d290 0x7f1e580cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e5806d3d0 0x7f1e580cb690 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 --2- 172.21.15.3:0/1306118840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e58068280 0x7f1e5814e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 >> 172.21.15.3:0/1306118840 conn(0x7f1e580c8de0 msgr2=0x7f1e580af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 shutdown_connections 2023-10-08T16:07:24.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.222+0000 7f1e5ea15700 1 -- 172.21.15.3:0/1306118840 wait complete. 2023-10-08T16:07:24.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:07:24.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:24.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 Processor -- start 2023-10-08T16:07:24.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 -- start start 2023-10-08T16:07:24.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c7c068200 0x7f4c7c0af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4c7c069270 0x7f4c7c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c06dbb0 0x7f4c7c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c159400 con 0x7f4c7c069270 2023-10-08T16:07:24.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c15a3b0 con 0x7f4c7c068200 2023-10-08T16:07:24.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c80ce2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c06e590 con 0x7f4c7c06dbb0 2023-10-08T16:07:24.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c7affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4c7c069270 0x7f4c7c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c7affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4c7c069270 0x7f4c7c0685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40638/0 (socket says 172.21.15.3:40638) 2023-10-08T16:07:24.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c7affd700 1 -- 172.21.15.3:0/4167533803 learned_addr learned my addr 172.21.15.3:0/4167533803 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:24.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c7b7fe700 1 --2- 172.21.15.3:0/4167533803 >> v2:172.21.15.27:3300/0 conn(0x7f4c7c068200 0x7f4c7c0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.354+0000 7f4c7bfff700 1 --2- 172.21.15.3:0/4167533803 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c06dbb0 0x7f4c7c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7affd700 1 -- 172.21.15.3:0/4167533803 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c06dbb0 msgr2=0x7f4c7c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7affd700 1 --2- 172.21.15.3:0/4167533803 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c06dbb0 0x7f4c7c06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7affd700 1 -- 172.21.15.3:0/4167533803 >> v2:172.21.15.27:3300/0 conn(0x7f4c7c068200 msgr2=0x7f4c7c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7affd700 1 --2- 172.21.15.3:0/4167533803 >> v2:172.21.15.27:3300/0 conn(0x7f4c7c068200 0x7f4c7c0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7affd700 1 -- 172.21.15.3:0/4167533803 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c0af540 con 0x7f4c7c069270 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7affd700 1 --2- 172.21.15.3:0/4167533803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c0685d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c067fc0 tx=0x7f4c64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b78fc00d9efc64f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7a7fc700 1 -- 172.21.15.3:0/4167533803 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64011630 con 0x7f4c7c069270 2023-10-08T16:07:24.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7a7fc700 1 -- 172.21.15.3:0/4167533803 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64011790 con 0x7f4c7c069270 2023-10-08T16:07:24.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c7a7fc700 1 -- 172.21.15.3:0/4167533803 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64011b30 con 0x7f4c7c069270 2023-10-08T16:07:24.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 -- 172.21.15.3:0/4167533803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 msgr2=0x7f4c7c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/4167533803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c0685d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c067fc0 tx=0x7f4c64009250 comp rx=0 tx=0).stop 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 -- 172.21.15.3:0/4167533803 shutdown_connections 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/4167533803 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c06dbb0 0x7f4c7c06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/4167533803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c0685d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/4167533803 >> v2:172.21.15.27:3300/0 conn(0x7f4c7c068200 0x7f4c7c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 -- 172.21.15.3:0/4167533803 >> 172.21.15.3:0/4167533803 conn(0x7f4c7c067b30 msgr2=0x7f4c7c0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 -- 172.21.15.3:0/4167533803 shutdown_connections 2023-10-08T16:07:24.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.358+0000 7f4c80ce2700 1 -- 172.21.15.3:0/4167533803 wait complete. 2023-10-08T16:07:24.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 Processor -- start 2023-10-08T16:07:24.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 -- start start 2023-10-08T16:07:24.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c068200 0x7f4c7c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7c06dbb0 0x7f4c7c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c15ccc0 con 0x7f4c7c069270 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c15d800 con 0x7f4c7c06dbb0 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c80ce2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c15cf60 con 0x7f4c7c068200 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c7affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c7affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40654/0 (socket says 172.21.15.3:40654) 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c7affd700 1 -- 172.21.15.3:0/1402166423 learned_addr learned my addr 172.21.15.3:0/1402166423 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.362+0000 7f4c7b7fe700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c068200 0x7f4c7c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7bfff700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7c06dbb0 0x7f4c7c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7affd700 1 -- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c068200 msgr2=0x7f4c7c15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7affd700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c068200 0x7f4c7c15c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7affd700 1 -- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7c06dbb0 msgr2=0x7f4c7c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7affd700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7c06dbb0 0x7f4c7c152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7affd700 1 -- 172.21.15.3:0/1402166423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640094f0 con 0x7f4c7c069270 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7bfff700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7c06dbb0 0x7f4c7c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c7affd700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c151db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009290 tx=0x7f4c64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64000d10 con 0x7f4c7c069270 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64011b10 con 0x7f4c7c069270 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c15d240 con 0x7f4c7c069270 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64025640 con 0x7f4c7c069270 2023-10-08T16:07:24.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c168dd0 con 0x7f4c7c069270 2023-10-08T16:07:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.366+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c168fc0 con 0x7f4c7c069270 2023-10-08T16:07:24.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.370+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c6402e450 con 0x7f4c7c069270 2023-10-08T16:07:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.370+0000 7f4c737fe700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4c60060550 0x7f4c60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.370+0000 7f4c7b7fe700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4c60060550 0x7f4c60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.370+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4c6407db70 con 0x7f4c7c069270 2023-10-08T16:07:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.370+0000 7f4c7b7fe700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4c60060550 0x7f4c60062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009d10 tx=0x7f4c6c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.378+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c6404e4b0 con 0x7f4c7c069270 2023-10-08T16:07:24.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.534+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c7c04be40 con 0x7f4c7c069270 2023-10-08T16:07:24.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c737fe700 1 -- 172.21.15.3:0/1402166423 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c64015070 con 0x7f4c7c069270 2023-10-08T16:07:24.541 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:07:24.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4c60060550 msgr2=0x7f4c60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4c60060550 0x7f4c60062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009d10 tx=0x7f4c6c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 msgr2=0x7f4c7c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c151db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009290 tx=0x7f4c64017000 comp rx=0 tx=0).stop 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 shutdown_connections 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4c60060550 0x7f4c60062a00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7c06dbb0 0x7f4c7c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c7c069270 0x7f4c7c151db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 --2- 172.21.15.3:0/1402166423 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4c7c068200 0x7f4c7c15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 >> 172.21.15.3:0/1402166423 conn(0x7f4c7c067b30 msgr2=0x7f4c7c0ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 shutdown_connections 2023-10-08T16:07:24.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.538+0000 7f4c80ce2700 1 -- 172.21.15.3:0/1402166423 wait complete. 2023-10-08T16:07:24.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:07:24.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 Processor -- start 2023-10-08T16:07:24.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 -- start start 2023-10-08T16:07:24.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f68d40ca070 0x7f68d40ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68d406d900 0x7f68d415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d406c3a0 con 0x7f68d406aeb0 2023-10-08T16:07:24.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d406c8a0 con 0x7f68d406d900 2023-10-08T16:07:24.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68db464700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d406cb40 con 0x7f68d40ca070 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.654+0000 7f68dac63700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68d406d900 0x7f68d415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68d406d900 0x7f68d415ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40662/0 (socket says 172.21.15.3:40662) 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 -- 172.21.15.3:0/1792706601 learned_addr learned my addr 172.21.15.3:0/1792706601 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68da462700 1 --2- 172.21.15.3:0/1792706601 >> v2:172.21.15.27:3300/0 conn(0x7f68d40ca070 0x7f68d40ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68d9460700 1 -- 172.21.15.3:0/1792706601 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592050359 0 0) 0x7f68d406c3a0 con 0x7f68d406aeb0 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68d9460700 1 -- 172.21.15.3:0/1792706601 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68bc003570 con 0x7f68d406aeb0 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 -- 172.21.15.3:0/1792706601 >> v2:172.21.15.27:3300/0 conn(0x7f68d40ca070 msgr2=0x7f68d40ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 --2- 172.21.15.3:0/1792706601 >> v2:172.21.15.27:3300/0 conn(0x7f68d40ca070 0x7f68d40ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 -- 172.21.15.3:0/1792706601 >> v1:172.21.15.27:6789/0 conn(0x7f68d406aeb0 legacy=0x7f68d406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 -- 172.21.15.3:0/1792706601 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d406ce20 con 0x7f68d406d900 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68dac63700 1 --2- 172.21.15.3:0/1792706601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d406d900 0x7f68d415ce90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0099b0 tx=0x7f68cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105de5b3c7afd479 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68d9460700 1 -- 172.21.15.3:0/1792706601 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00b640 con 0x7f68d406d900 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68d9460700 1 -- 172.21.15.3:0/1792706601 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00b7a0 con 0x7f68d406d900 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68d9460700 1 -- 172.21.15.3:0/1792706601 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00bb40 con 0x7f68d406d900 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 -- 172.21.15.3:0/1792706601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d406d900 msgr2=0x7f68d415ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 --2- 172.21.15.3:0/1792706601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d406d900 0x7f68d415ce90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0099b0 tx=0x7f68cc009250 comp rx=0 tx=0).stop 2023-10-08T16:07:24.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 -- 172.21.15.3:0/1792706601 shutdown_connections 2023-10-08T16:07:24.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 --2- 172.21.15.3:0/1792706601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d406d900 0x7f68d415ce90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 --2- 172.21.15.3:0/1792706601 >> v2:172.21.15.27:3300/0 conn(0x7f68d40ca070 0x7f68d40ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 -- 172.21.15.3:0/1792706601 >> 172.21.15.3:0/1792706601 conn(0x7f68d40c83d0 msgr2=0x7f68d40c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 -- 172.21.15.3:0/1792706601 shutdown_connections 2023-10-08T16:07:24.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.658+0000 7f68db464700 1 -- 172.21.15.3:0/1792706601 wait complete. 2023-10-08T16:07:24.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 Processor -- start 2023-10-08T16:07:24.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 -- start start 2023-10-08T16:07:24.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f68d406d900 0x7f68d414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 0x7f68d4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68d4153dd0 0x7f68d4158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4154b70 con 0x7f68d40ca070 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d414f710 con 0x7f68d4153dd0 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41542d0 con 0x7f68d406d900 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d9c61700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 0x7f68d4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d9c61700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 0x7f68d4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40664/0 (socket says 172.21.15.3:40664) 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d9c61700 1 -- 172.21.15.3:0/3399363353 learned_addr learned my addr 172.21.15.3:0/3399363353 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f68d406d900 0x7f68d414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68dac63700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68d4153dd0 0x7f68d4158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 -- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68d4153dd0 msgr2=0x7f68d4158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68d4153dd0 0x7f68d4158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 -- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 msgr2=0x7f68d4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 0x7f68d4158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 -- 172.21.15.3:0/3399363353 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc0094f0 con 0x7f68d406d900 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d9c61700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 0x7f68d4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68da462700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f68d406d900 0x7f68d414f1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68c400ea50 tx=0x7f68c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c400ee90 con 0x7f68d406d900 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c400c7f0 con 0x7f68d406d900 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d41545b0 con 0x7f68d406d900 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c400cb90 con 0x7f68d406d900 2023-10-08T16:07:24.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.662+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d40ae9a0 con 0x7f68d406d900 2023-10-08T16:07:24.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.666+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d404be40 con 0x7f68d406d900 2023-10-08T16:07:24.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.666+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f68c4013470 con 0x7f68d406d900 2023-10-08T16:07:24.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.666+0000 7f68d27fc700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f68c0060550 0x7f68c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.666+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f68c407c750 con 0x7f68d406d900 2023-10-08T16:07:24.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.666+0000 7f68d9c61700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f68c0060550 0x7f68c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.666+0000 7f68d9c61700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f68c0060550 0x7f68c0062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68d40c1320 tx=0x7f68c8002700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.678+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f68c404cff0 con 0x7f68d406d900 2023-10-08T16:07:24.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.846+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68d406d100 con 0x7f68d406d900 2023-10-08T16:07:24.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.846+0000 7f68d27fc700 1 -- 172.21.15.3:0/3399363353 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f68c4050610 con 0x7f68d406d900 2023-10-08T16:07:24.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:24.851 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T16:07:24.851 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:24.851 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T16:07:24.851 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T16:07:24.852 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:24.852 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T16:07:24.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f68c0060550 msgr2=0x7f68c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f68c0060550 0x7f68c0062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68d40c1320 tx=0x7f68c8002700 comp rx=0 tx=0).stop 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f68d406d900 msgr2=0x7f68d414f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f68d406d900 0x7f68d414f1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68c400ea50 tx=0x7f68c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 shutdown_connections 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f68c0060550 0x7f68c0062a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68d4153dd0 0x7f68d4158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68d40ca070 0x7f68d4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 --2- 172.21.15.3:0/3399363353 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f68d406d900 0x7f68d414f1d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 >> 172.21.15.3:0/3399363353 conn(0x7f68d40c83d0 msgr2=0x7f68d40c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 shutdown_connections 2023-10-08T16:07:24.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.850+0000 7f68db464700 1 -- 172.21.15.3:0/3399363353 wait complete. 2023-10-08T16:07:24.866 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:07:24.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:07:24.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.982+0000 7f6b5f59e700 1 Processor -- start 2023-10-08T16:07:24.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.982+0000 7f6b5f59e700 1 -- start start 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.982+0000 7f6b5f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b600c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.982+0000 7f6b5f59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b600c9880 con 0x7f6b600add10 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.982+0000 7f6b5f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b60156950 con 0x7f6b600c06e0 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.982+0000 7f6b5f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60156c30 con 0x7f6b600ae0e0 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5e59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6b600add10 0x7f6b601560c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33200/0 (socket says 172.21.15.3:33200) 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5e59c700 1 -- 172.21.15.3:0/833137120 learned_addr learned my addr 172.21.15.3:0/833137120 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:24.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b600c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22437510 0 0) 0x7f6b600c9880 con 0x7f6b600add10 2023-10-08T16:07:24.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b4c003570 con 0x7f6b600add10 2023-10-08T16:07:24.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983503316 0 0) 0x7f6b60156950 con 0x7f6b600c06e0 2023-10-08T16:07:24.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b600c9880 con 0x7f6b600c06e0 2023-10-08T16:07:24.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616190022 0 0) 0x7f6b4c003570 con 0x7f6b600add10 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 msgr2=0x7f6b600c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b600c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 >> v1:172.21.15.27:6789/0 conn(0x7f6b600c06e0 legacy=0x7f6b600c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60156f10 con 0x7f6b600add10 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f6b50001470 con 0x7f6b600add10 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b600c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 >> v1:172.21.15.3:6789/0 conn(0x7f6b600add10 legacy=0x7f6b601560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b4c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4c004d50 0x7f6b4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60156c30 con 0x7f6b4c004160 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c00bba0 con 0x7f6b4c004d50 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c00bd60 con 0x7f6b600ae0e0 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5e59c700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b4c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5ed9d700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4c004d50 0x7f6b4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 -- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 msgr2=0x7f6b4c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600ae0e0 0x7f6b4c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 -- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4c004d50 msgr2=0x7f6b4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4c004d50 0x7f6b4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 -- 172.21.15.3:0/833137120 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48009420 con 0x7f6b4c004160 2023-10-08T16:07:24.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b57fff700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b4c004810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009db0 tx=0x7f6b480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7e121d95ba18b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48009740 con 0x7f6b4c004160 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4800e920 con 0x7f6b4c004160 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5dd9b700 1 -- 172.21.15.3:0/833137120 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800ece0 con 0x7f6b4c004160 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5f59e700 1 -- 172.21.15.3:0/833137120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 msgr2=0x7f6b4c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/833137120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b4c004810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009db0 tx=0x7f6b480091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5ed9d700 1 -- 172.21.15.3:0/833137120 reap_dead start 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5f59e700 1 -- 172.21.15.3:0/833137120 shutdown_connections 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5f59e700 1 -- 172.21.15.3:0/833137120 >> 172.21.15.3:0/833137120 conn(0x7f6b600cc410 msgr2=0x7f6b600c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5f59e700 1 -- 172.21.15.3:0/833137120 shutdown_connections 2023-10-08T16:07:24.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.986+0000 7f6b5f59e700 1 -- 172.21.15.3:0/833137120 wait complete. 2023-10-08T16:07:24.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 Processor -- start 2023-10-08T16:07:24.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 -- start start 2023-10-08T16:07:24.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b60143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600c52e0 0x7f6b601559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b60155f10 0x7f6b600c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60156380 con 0x7f6b4c004160 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600a4dd0 con 0x7f6b60155f10 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60165bf0 con 0x7f6b600c52e0 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b60143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b60143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40676/0 (socket says 172.21.15.3:40676) 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 -- 172.21.15.3:0/3031747736 learned_addr learned my addr 172.21.15.3:0/3031747736 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b57fff700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600c52e0 0x7f6b601559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5ed9d700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b60155f10 0x7f6b600c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 -- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600c52e0 msgr2=0x7f6b601559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600c52e0 0x7f6b601559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 -- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b60155f10 msgr2=0x7f6b600c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b60155f10 0x7f6b600c29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5e59c700 1 -- 172.21.15.3:0/3031747736 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600a44c0 con 0x7f6b4c004160 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.990+0000 7f6b5ed9d700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b60155f10 0x7f6b600c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b5e59c700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b60143d40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b500073c0 tx=0x7f6b50001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50018030 con 0x7f6b4c004160 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5000f8d0 con 0x7f6b4c004160 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b600c5b80 con 0x7f6b4c004160 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000fc90 con 0x7f6b4c004160 2023-10-08T16:07:24.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b600a4a60 con 0x7f6b4c004160 2023-10-08T16:07:25.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6004be40 con 0x7f6b4c004160 2023-10-08T16:07:25.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6b5001b070 con 0x7f6b4c004160 2023-10-08T16:07:25.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b567fc700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6b40060550 0x7f6b40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b57fff700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6b40060550 0x7f6b40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.994+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6b50019070 con 0x7f6b4c004160 2023-10-08T16:07:25.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:24.998+0000 7f6b57fff700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6b40060550 0x7f6b40062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b480091e0 tx=0x7f6b48019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:25.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.002+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6b5004ccb0 con 0x7f6b4c004160 2023-10-08T16:07:25.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.170+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6b600c9140 con 0x7f6b4c004160 2023-10-08T16:07:25.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.746+0000 7f6b567fc700 1 -- 172.21.15.3:0/3031747736 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6b500502d0 con 0x7f6b4c004160 2023-10-08T16:07:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6b40060550 msgr2=0x7f6b40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6b40060550 0x7f6b40062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b480091e0 tx=0x7f6b48019000 comp rx=0 tx=0).stop 2023-10-08T16:07:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 msgr2=0x7f6b60143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b60143d40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b500073c0 tx=0x7f6b50001e10 comp rx=0 tx=0).stop 2023-10-08T16:07:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 shutdown_connections 2023-10-08T16:07:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6b40060550 0x7f6b40062a00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b60155f10 0x7f6b600c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6b600c52e0 0x7f6b601559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 --2- 172.21.15.3:0/3031747736 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b4c004160 0x7f6b60143d40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 >> 172.21.15.3:0/3031747736 conn(0x7f6b600cc410 msgr2=0x7f6b6006b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 shutdown_connections 2023-10-08T16:07:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.754+0000 7f6b5f59e700 1 -- 172.21.15.3:0/3031747736 wait complete. 2023-10-08T16:07:25.761 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T16:07:25.773 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:07:25.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.886+0000 7fdd06875700 1 Processor -- start 2023-10-08T16:07:25.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.886+0000 7fdd06875700 1 -- start start 2023-10-08T16:07:25.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06875700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdd000c2c00 0x7fdd00155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06875700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000cb0c0 con 0x7fdd000cc4f0 2023-10-08T16:07:25.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06875700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000cb3a0 con 0x7fdd000cc120 2023-10-08T16:07:25.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06875700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000cb680 con 0x7fdd000c2c00 2023-10-08T16:07:25.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd05072700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdd000cc4f0 0x7fdd00155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33212/0 (socket says 172.21.15.3:33212) 2023-10-08T16:07:25.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd05072700 1 -- 172.21.15.3:0/4106531197 learned_addr learned my addr 172.21.15.3:0/4106531197 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:25.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 --2- 172.21.15.3:0/4106531197 >> v2:172.21.15.27:3300/0 conn(0x7fdd000c2c00 0x7fdd00155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441770673 0 0) 0x7fdd000cb0c0 con 0x7fdd000cc4f0 2023-10-08T16:07:25.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcec003570 con 0x7fdd000cc4f0 2023-10-08T16:07:25.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848250469 0 0) 0x7fdd000cb3a0 con 0x7fdd000cc120 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd000cb0c0 con 0x7fdd000cc120 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258121480 0 0) 0x7fdcec003570 con 0x7fdd000cc4f0 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 >> v2:172.21.15.27:3300/0 conn(0x7fdd000c2c00 msgr2=0x7fdd00155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 --2- 172.21.15.3:0/4106531197 >> v2:172.21.15.27:3300/0 conn(0x7fdd000c2c00 0x7fdd00155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 >> v1:172.21.15.27:6789/0 conn(0x7fdd000cc120 legacy=0x7fdd000ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000cb960 con 0x7fdd000cc4f0 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fdcf0001470 con 0x7fdd000cc4f0 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 >> v1:172.21.15.3:6789/0 conn(0x7fdd000cc4f0 legacy=0x7fdd00155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec003bf0 0x7fdcec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdcec004810 0x7fdcec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcec0051c0 0x7fdcec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000cb680 con 0x7fdcec0051c0 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec00c0b0 con 0x7fdcec003bf0 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec00c270 con 0x7fdcec004810 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcec0051c0 0x7fdcec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd05873700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec003bf0 0x7fdcec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd05072700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdcec004810 0x7fdcec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 -- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdcec004810 msgr2=0x7fdcec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdcec004810 0x7fdcec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 -- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec003bf0 msgr2=0x7fdcec003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec003bf0 0x7fdcec003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.890+0000 7fdd06074700 1 -- 172.21.15.3:0/4106531197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec003570 con 0x7fdcec0051c0 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06074700 1 -- 172.21.15.3:0/4106531197 reap_dead start 2023-10-08T16:07:25.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06074700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcec0051c0 0x7fdcec00ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800e210 tx=0x7fdcf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb8c3818f7739cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800eac0 con 0x7fdcec0051c0 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf800f040 con 0x7fdcec0051c0 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd04871700 1 -- 172.21.15.3:0/4106531197 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800ee70 con 0x7fdcec0051c0 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 -- 172.21.15.3:0/4106531197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcec0051c0 msgr2=0x7fdcec00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcec0051c0 0x7fdcec00ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800e210 tx=0x7fdcf800b040 comp rx=0 tx=0).stop 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 -- 172.21.15.3:0/4106531197 shutdown_connections 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 --2- 172.21.15.3:0/4106531197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcec0051c0 0x7fdcec00ba60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 -- 172.21.15.3:0/4106531197 >> 172.21.15.3:0/4106531197 conn(0x7fdd0006bf50 msgr2=0x7fdd000cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 -- 172.21.15.3:0/4106531197 shutdown_connections 2023-10-08T16:07:25.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 -- 172.21.15.3:0/4106531197 wait complete. 2023-10-08T16:07:25.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 Processor -- start 2023-10-08T16:07:25.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.894+0000 7fdd06875700 1 -- start start 2023-10-08T16:07:25.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec0051c0 0x7fdd000c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 0x7fdd0006d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdd00158410 0x7fdd00158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd00158dd0 con 0x7fdd000b0a30 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000b1b20 con 0x7fdcec0051c0 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000b0f10 con 0x7fdd00158410 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 0x7fdd0006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05873700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec0051c0 0x7fdd000c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 0x7fdd0006d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40696/0 (socket says 172.21.15.3:40696) 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 -- 172.21.15.3:0/2460751261 learned_addr learned my addr 172.21.15.3:0/2460751261 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06074700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdd00158410 0x7fdd00158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 -- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdd00158410 msgr2=0x7fdd00158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdd00158410 0x7fdd00158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 -- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec0051c0 msgr2=0x7fdd000c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec0051c0 0x7fdd000c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 -- 172.21.15.3:0/2460751261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000b11f0 con 0x7fdd000b0a30 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd05072700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 0x7fdd0006d950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00073c0 tx=0x7fdcf0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0018030 con 0x7fdd000b0a30 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf000f6c0 con 0x7fdd000b0a30 2023-10-08T16:07:25.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000b14d0 con 0x7fdd000b0a30 2023-10-08T16:07:25.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000fa60 con 0x7fdd000b0a30 2023-10-08T16:07:25.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.898+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd00159bd0 con 0x7fdd000b0a30 2023-10-08T16:07:25.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.902+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd000b1cd0 con 0x7fdd000b0a30 2023-10-08T16:07:25.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.902+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdcf001b070 con 0x7fdd000b0a30 2023-10-08T16:07:25.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.902+0000 7fdcf5ffb700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdce4060550 0x7fdce4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:25.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.902+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fdcf0019070 con 0x7fdd000b0a30 2023-10-08T16:07:25.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.902+0000 7fdd05873700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdce4060550 0x7fdce4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:25.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.902+0000 7fdd05873700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdce4060550 0x7fdce4062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc007e40 tx=0x7fdcfc007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:25.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:25.910+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd000b1cd0 con 0x7fdd000b0a30 2023-10-08T16:07:26.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.074+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdd000b1950 con 0x7fdd000b0a30 2023-10-08T16:07:26.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.762+0000 7fdcf5ffb700 1 -- 172.21.15.3:0/2460751261 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdcf004cb80 con 0x7fdd000b0a30 2023-10-08T16:07:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdce4060550 msgr2=0x7fdce4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdce4060550 0x7fdce4062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc007e40 tx=0x7fdcfc007d30 comp rx=0 tx=0).stop 2023-10-08T16:07:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 msgr2=0x7fdd0006d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 0x7fdd0006d950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00073c0 tx=0x7fdcf0001df0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 shutdown_connections 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdce4060550 0x7fdce4062a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdd00158410 0x7fdd00158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd000b0a30 0x7fdd0006d950 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 --2- 172.21.15.3:0/2460751261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcec0051c0 0x7fdd000c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 >> 172.21.15.3:0/2460751261 conn(0x7fdd0006bf50 msgr2=0x7fdd001495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 shutdown_connections 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.782+0000 7fdd06875700 1 -- 172.21.15.3:0/2460751261 wait complete. 2023-10-08T16:07:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T16:07:26.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:07:26.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.906+0000 7fc3d188a700 1 Processor -- start 2023-10-08T16:07:26.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.906+0000 7fc3d188a700 1 -- start start 2023-10-08T16:07:26.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d188a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3cc0af000 0x7fc3cc06da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:26.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d188a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc0af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:26.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d188a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc06d5f0 con 0x7fc3cc155d80 2023-10-08T16:07:26.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d188a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc06c700 con 0x7fc3cc0af000 2023-10-08T16:07:26.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d188a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc06c9e0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d0888700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3cc0af000 0x7fc3cc06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:26.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d1089700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:26.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3cbfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc3cc155d80 0x7fc3cc0b0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:48924/0 (socket says 172.21.15.3:48924) 2023-10-08T16:07:26.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3cbfff700 1 -- 172.21.15.3:0/580051562 learned_addr learned my addr 172.21.15.3:0/580051562 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3cb7fe700 1 -- 172.21.15.3:0/580051562 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007171630 0 0) 0x7fc3cc06d5f0 con 0x7fc3cc155d80 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d1089700 1 -- 172.21.15.3:0/580051562 >> v2:172.21.15.27:3300/0 conn(0x7fc3cc0af000 msgr2=0x7fc3cc06da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d1089700 1 --2- 172.21.15.3:0/580051562 >> v2:172.21.15.27:3300/0 conn(0x7fc3cc0af000 0x7fc3cc06da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d1089700 1 -- 172.21.15.3:0/580051562 >> v1:172.21.15.27:6789/0 conn(0x7fc3cc155d80 legacy=0x7fc3cc0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d1089700 1 -- 172.21.15.3:0/580051562 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc06ccc0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3d1089700 1 --2- 172.21.15.3:0/580051562 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc0af870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009e60 tx=0x7fc3c4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc00a62ced3c822a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:26.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3cb7fe700 1 -- 172.21.15.3:0/580051562 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400e070 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3cb7fe700 1 -- 172.21.15.3:0/580051562 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400bb60 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.910+0000 7fc3cb7fe700 1 -- 172.21.15.3:0/580051562 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4012430 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 -- 172.21.15.3:0/580051562 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 msgr2=0x7fc3cc0af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 --2- 172.21.15.3:0/580051562 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc0af870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009e60 tx=0x7fc3c4009780 comp rx=0 tx=0).stop 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 -- 172.21.15.3:0/580051562 shutdown_connections 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 --2- 172.21.15.3:0/580051562 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc0af870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 --2- 172.21.15.3:0/580051562 >> v2:172.21.15.27:3300/0 conn(0x7fc3cc0af000 0x7fc3cc06da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 -- 172.21.15.3:0/580051562 >> 172.21.15.3:0/580051562 conn(0x7fc3cc067b30 msgr2=0x7fc3cc0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 -- 172.21.15.3:0/580051562 shutdown_connections 2023-10-08T16:07:26.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 -- 172.21.15.3:0/580051562 wait complete. 2023-10-08T16:07:26.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 Processor -- start 2023-10-08T16:07:26.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.914+0000 7fc3d188a700 1 -- start start 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 0x7fc3cc143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3cc155d80 0x7fc3cc14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc149830 con 0x7fc3cc0af000 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc148c20 con 0x7fc3cc155d80 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc148f00 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d0888700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 0x7fc3cc143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d0888700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 0x7fc3cc143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40700/0 (socket says 172.21.15.3:40700) 2023-10-08T16:07:26.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d0888700 1 -- 172.21.15.3:0/4044853428 learned_addr learned my addr 172.21.15.3:0/4044853428 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:26.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d1089700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3cc155d80 0x7fc3cc14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 -- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3cc155d80 msgr2=0x7fc3cc14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3cc155d80 0x7fc3cc14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 -- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 msgr2=0x7fc3cc143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 0x7fc3cc143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 -- 172.21.15.3:0/4044853428 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009a20 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d0888700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 0x7fc3cc143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3cbfff700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc148210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c4f0 tx=0x7fc3b8007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:26.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800cea0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005b30 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80070d0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc1491e0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.918+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc149cc0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.922+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc04be40 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.922+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc3b80074c0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.922+0000 7fc3c8ff9700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc3b00605d0 0x7fc3b0062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:26.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.922+0000 7fc3d0888700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc3b00605d0 0x7fc3b0062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:26.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.922+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fc3b807bbb0 con 0x7fc3cc0af3d0 2023-10-08T16:07:26.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.922+0000 7fc3d0888700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc3b00605d0 0x7fc3b0062a80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fd0 tx=0x7fc3c00091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:26.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:26.930+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3b804c1e0 con 0x7fc3cc0af3d0 2023-10-08T16:07:27.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.130+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc3cc06cfa0 con 0x7fc3cc0af3d0 2023-10-08T16:07:27.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.782+0000 7fc3c8ff9700 1 -- 172.21.15.3:0/4044853428 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc3b80170c0 con 0x7fc3cc0af3d0 2023-10-08T16:07:27.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc3b00605d0 msgr2=0x7fc3b0062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc3b00605d0 0x7fc3b0062a80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fd0 tx=0x7fc3c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 msgr2=0x7fc3cc148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc148210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c4f0 tx=0x7fc3b8007f50 comp rx=0 tx=0).stop 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 shutdown_connections 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc3b00605d0 0x7fc3b0062a80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3cc155d80 0x7fc3cc14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc3cc0af3d0 0x7fc3cc148210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 --2- 172.21.15.3:0/4044853428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0af000 0x7fc3cc143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 >> 172.21.15.3:0/4044853428 conn(0x7fc3cc067b30 msgr2=0x7fc3cc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 shutdown_connections 2023-10-08T16:07:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.794+0000 7fc3d188a700 1 -- 172.21.15.3:0/4044853428 wait complete. 2023-10-08T16:07:27.801 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T16:07:27.812 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:27.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.910+0000 7f1b42711700 1 Processor -- start 2023-10-08T16:07:27.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.910+0000 7f1b42711700 1 -- start start 2023-10-08T16:07:27.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1b3c068880 0x7f1b3c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:27.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c06e340 con 0x7f1b3c0684b0 2023-10-08T16:07:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c159540 con 0x7f1b3c1590e0 2023-10-08T16:07:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c06d730 con 0x7f1b3c068880 2023-10-08T16:07:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1b3c068880 0x7f1b3c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1b3c068880 0x7f1b3c158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40702/0 (socket says 172.21.15.3:40702) 2023-10-08T16:07:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 -- 172.21.15.3:0/2919355347 learned_addr learned my addr 172.21.15.3:0/2919355347 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b4170f700 1 --1- 172.21.15.3:0/2919355347 >> v1:172.21.15.3:6789/0 conn(0x7f1b3c0684b0 0x7f1b3c06ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33226/0 (socket says 172.21.15.3:33226) 2023-10-08T16:07:27.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 -- 172.21.15.3:0/2919355347 >> v1:172.21.15.27:6789/0 conn(0x7f1b3c1590e0 legacy=0x7f1b3c0c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 -- 172.21.15.3:0/2919355347 >> v1:172.21.15.3:6789/0 conn(0x7f1b3c0684b0 legacy=0x7f1b3c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 -- 172.21.15.3:0/2919355347 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c06da10 con 0x7f1b3c068880 2023-10-08T16:07:27.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b40f0e700 1 --2- 172.21.15.3:0/2919355347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c068880 0x7f1b3c158ba0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0099b0 tx=0x7f1b2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa43023f81c29a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b33fff700 1 -- 172.21.15.3:0/2919355347 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00b860 con 0x7f1b3c068880 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b33fff700 1 -- 172.21.15.3:0/2919355347 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00b9c0 con 0x7f1b3c068880 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b33fff700 1 -- 172.21.15.3:0/2919355347 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00bd60 con 0x7f1b3c068880 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- 172.21.15.3:0/2919355347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c068880 msgr2=0x7f1b3c158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 --2- 172.21.15.3:0/2919355347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c068880 0x7f1b3c158ba0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0099b0 tx=0x7f1b2c009250 comp rx=0 tx=0).stop 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- 172.21.15.3:0/2919355347 shutdown_connections 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 --2- 172.21.15.3:0/2919355347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c068880 0x7f1b3c158ba0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- 172.21.15.3:0/2919355347 >> 172.21.15.3:0/2919355347 conn(0x7f1b3c0c8c90 msgr2=0x7f1b3c0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- 172.21.15.3:0/2919355347 shutdown_connections 2023-10-08T16:07:27.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.914+0000 7f1b42711700 1 -- 172.21.15.3:0/2919355347 wait complete. 2023-10-08T16:07:27.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 Processor -- start 2023-10-08T16:07:27.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 -- start start 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 0x7f1b3c0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1b3c068880 0x7f1b3c16cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c1590e0 0x7f1b3c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c16d4c0 con 0x7f1b3c1590e0 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c16d770 con 0x7f1b3c0684b0 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b42711700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c16da50 con 0x7f1b3c068880 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b4170f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 0x7f1b3c0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b41f10700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c1590e0 0x7f1b3c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b40f0e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1b3c068880 0x7f1b3c16cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b4170f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 0x7f1b3c0a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:48844/0 (socket says 172.21.15.3:48844) 2023-10-08T16:07:27.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b4170f700 1 -- 172.21.15.3:0/1131477897 learned_addr learned my addr 172.21.15.3:0/1131477897 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b41f10700 1 -- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1b3c068880 msgr2=0x7f1b3c16cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.918+0000 7f1b41f10700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1b3c068880 0x7f1b3c16cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b41f10700 1 -- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 msgr2=0x7f1b3c0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b41f10700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 0x7f1b3c0a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b41f10700 1 -- 172.21.15.3:0/1131477897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0094f0 con 0x7f1b3c1590e0 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b4170f700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 0x7f1b3c0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b40f0e700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1b3c068880 0x7f1b3c16cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:27.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b41f10700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c1590e0 0x7f1b3c14ce10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c790 tx=0x7f1b340015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:27.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34012630 con 0x7f1b3c1590e0 2023-10-08T16:07:27.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b340127b0 con 0x7f1b3c1590e0 2023-10-08T16:07:27.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c16dd30 con 0x7f1b3c1590e0 2023-10-08T16:07:27.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34012b70 con 0x7f1b3c1590e0 2023-10-08T16:07:27.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c169980 con 0x7f1b3c1590e0 2023-10-08T16:07:27.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.922+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c0cb870 con 0x7f1b3c1590e0 2023-10-08T16:07:27.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.926+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b34003030 con 0x7f1b3c1590e0 2023-10-08T16:07:27.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.926+0000 7f1b317fa700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b20060550 0x7f1b20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:27.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.926+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b3407c500 con 0x7f1b3c1590e0 2023-10-08T16:07:27.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.926+0000 7f1b4170f700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b20060550 0x7f1b20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:27.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.926+0000 7f1b4170f700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b20060550 0x7f1b20062a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001690 tx=0x7f1b38007f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:27.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:27.934+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b3c0cb870 con 0x7f1b3c1590e0 2023-10-08T16:07:28.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.098+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b3c0cb870 con 0x7f1b3c1590e0 2023-10-08T16:07:28.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.098+0000 7f1b317fa700 1 -- 172.21.15.3:0/1131477897 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f1b3c0cb870 con 0x7f1b3c1590e0 2023-10-08T16:07:28.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:28.103 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":31,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:27.136120+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:25.214157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:26.118148+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:28.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b20060550 msgr2=0x7f1b20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b20060550 0x7f1b20062a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001690 tx=0x7f1b38007f70 comp rx=0 tx=0).stop 2023-10-08T16:07:28.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c1590e0 msgr2=0x7f1b3c14ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c1590e0 0x7f1b3c14ce10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c790 tx=0x7f1b340015f0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 shutdown_connections 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1b20060550 0x7f1b20062a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b3c1590e0 0x7f1b3c14ce10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1b3c068880 0x7f1b3c16cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 --2- 172.21.15.3:0/1131477897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b3c0684b0 0x7f1b3c0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 >> 172.21.15.3:0/1131477897 conn(0x7f1b3c0c8c90 msgr2=0x7f1b3c0c1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 shutdown_connections 2023-10-08T16:07:28.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.102+0000 7f1b42711700 1 -- 172.21.15.3:0/1131477897 wait complete. 2023-10-08T16:07:28.118 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:28.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 Processor -- start 2023-10-08T16:07:28.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 -- start start 2023-10-08T16:07:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30240adc30 0x7f302406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240ca810 0x7f30240ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240ae540 con 0x7f302406ab00 2023-10-08T16:07:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302406cae0 con 0x7f30240adc30 2023-10-08T16:07:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302b1de700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302406cdc0 con 0x7f30240ca810 2023-10-08T16:07:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30240adc30 0x7f302406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30240adc30 0x7f302406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40722/0 (socket says 172.21.15.3:40722) 2023-10-08T16:07:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 -- 172.21.15.3:0/793623617 learned_addr learned my addr 172.21.15.3:0/793623617 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f302977b700 1 --2- 172.21.15.3:0/793623617 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240ca810 0x7f30240ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 -- 172.21.15.3:0/793623617 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240ca810 msgr2=0x7f30240ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 --2- 172.21.15.3:0/793623617 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240ca810 0x7f30240ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f30237fe700 1 -- 172.21.15.3:0/793623617 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572376861 0 0) 0x7f30240ae540 con 0x7f302406ab00 2023-10-08T16:07:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 -- 172.21.15.3:0/793623617 >> v1:172.21.15.27:6789/0 conn(0x7f302406ab00 legacy=0x7f30240ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 -- 172.21.15.3:0/793623617 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302406d0a0 con 0x7f30240adc30 2023-10-08T16:07:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.222+0000 7f3028f7a700 1 --2- 172.21.15.3:0/793623617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30240adc30 0x7f302406db80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f30140099b0 tx=0x7f3014009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c45b6f2f8ce626 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f30237fe700 1 -- 172.21.15.3:0/793623617 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014009ea0 con 0x7f30240adc30 2023-10-08T16:07:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f30237fe700 1 -- 172.21.15.3:0/793623617 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301400b860 con 0x7f30240adc30 2023-10-08T16:07:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f30237fe700 1 -- 172.21.15.3:0/793623617 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301400bc00 con 0x7f30240adc30 2023-10-08T16:07:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 -- 172.21.15.3:0/793623617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30240adc30 msgr2=0x7f302406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 --2- 172.21.15.3:0/793623617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30240adc30 0x7f302406db80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f30140099b0 tx=0x7f3014009250 comp rx=0 tx=0).stop 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 -- 172.21.15.3:0/793623617 shutdown_connections 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 --2- 172.21.15.3:0/793623617 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240ca810 0x7f30240ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 --2- 172.21.15.3:0/793623617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30240adc30 0x7f302406db80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 -- 172.21.15.3:0/793623617 >> 172.21.15.3:0/793623617 conn(0x7f30240cc5d0 msgr2=0x7f30240c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 -- 172.21.15.3:0/793623617 shutdown_connections 2023-10-08T16:07:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.226+0000 7f302b1de700 1 -- 172.21.15.3:0/793623617 wait complete. 2023-10-08T16:07:28.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 Processor -- start 2023-10-08T16:07:28.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 -- start start 2023-10-08T16:07:28.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240adc30 0x7f30240c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30240ca810 0x7f302415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 0x7f302416d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302415e270 con 0x7f302415fa10 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024160180 con 0x7f30240ca810 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302b1de700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3024160460 con 0x7f30240adc30 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 0x7f302416d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 0x7f302416d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40738/0 (socket says 172.21.15.3:40738) 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 -- 172.21.15.3:0/1150268251 learned_addr learned my addr 172.21.15.3:0/1150268251 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f3028f7a700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240adc30 0x7f30240c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f3023fff700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30240ca810 0x7f302415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 -- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240adc30 msgr2=0x7f30240c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240adc30 0x7f30240c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 -- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30240ca810 msgr2=0x7f302415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30240ca810 0x7f302415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 -- 172.21.15.3:0/1150268251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140094f0 con 0x7f302415fa10 2023-10-08T16:07:28.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f302977b700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 0x7f302416d7c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f301c00ea20 tx=0x7f301c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00c7f0 con 0x7f302415fa10 2023-10-08T16:07:28.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.230+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00c970 con 0x7f302415fa10 2023-10-08T16:07:28.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302415df00 con 0x7f302415fa10 2023-10-08T16:07:28.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00cd30 con 0x7f302415fa10 2023-10-08T16:07:28.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302415fe90 con 0x7f302415fa10 2023-10-08T16:07:28.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302415e420 con 0x7f302415fa10 2023-10-08T16:07:28.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f301c013680 con 0x7f302415fa10 2023-10-08T16:07:28.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f3020ff9700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3004060550 0x7f3004062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f301c07cac0 con 0x7f302415fa10 2023-10-08T16:07:28.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.234+0000 7f3028f7a700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3004060550 0x7f3004062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.238+0000 7f3028f7a700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3004060550 0x7f3004062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30140099b0 tx=0x7f3014017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.242+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f302415e420 con 0x7f302415fa10 2023-10-08T16:07:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.406+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f302404be40 con 0x7f302415fa10 2023-10-08T16:07:28.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.410+0000 7f3020ff9700 1 -- 172.21.15.3:0/1150268251 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f301c04d0b0 con 0x7f302415fa10 2023-10-08T16:07:28.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:28.415 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":31,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:27.136120+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:25.214157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:26.118148+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3004060550 msgr2=0x7f3004062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3004060550 0x7f3004062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30140099b0 tx=0x7f3014017000 comp rx=0 tx=0).stop 2023-10-08T16:07:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 msgr2=0x7f302416d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 0x7f302416d7c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f301c00ea20 tx=0x7f301c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 shutdown_connections 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3004060550 0x7f3004062a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f302415fa10 0x7f302416d7c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30240ca810 0x7f302415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 --2- 172.21.15.3:0/1150268251 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f30240adc30 0x7f30240c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 >> 172.21.15.3:0/1150268251 conn(0x7f30240cc5d0 msgr2=0x7f30240c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 shutdown_connections 2023-10-08T16:07:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.414+0000 7f302b1de700 1 -- 172.21.15.3:0/1150268251 wait complete. 2023-10-08T16:07:28.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:07:28.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.542+0000 7f9ffe8f3700 1 Processor -- start 2023-10-08T16:07:28.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.542+0000 7f9ffe8f3700 1 -- start start 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9ff815c720 0x7f9ff80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9ff80b14e0 0x7f9ff80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff806f2d0 con 0x7f9ff815c350 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff806d7d0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff806e6c0 con 0x7f9ff815c720 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe0f2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9ff80b14e0 0x7f9ff80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffd8f1700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9ff815c350 0x7f9ff806d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33238/0 (socket says 172.21.15.3:33238) 2023-10-08T16:07:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffd8f1700 1 -- 172.21.15.3:0/3709580472 learned_addr learned my addr 172.21.15.3:0/3709580472 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffd0f0700 1 --2- 172.21.15.3:0/3709580472 >> v2:172.21.15.27:3300/0 conn(0x7f9ff815c720 0x7f9ff80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe0f2700 1 -- 172.21.15.3:0/3709580472 >> v2:172.21.15.27:3300/0 conn(0x7f9ff815c720 msgr2=0x7f9ff80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe0f2700 1 --2- 172.21.15.3:0/3709580472 >> v2:172.21.15.27:3300/0 conn(0x7f9ff815c720 0x7f9ff80b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe0f2700 1 -- 172.21.15.3:0/3709580472 >> v1:172.21.15.3:6789/0 conn(0x7f9ff815c350 legacy=0x7f9ff806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffc8ef700 1 -- 172.21.15.3:0/3709580472 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862256510 0 0) 0x7f9ff806f2d0 con 0x7f9ff815c350 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe0f2700 1 -- 172.21.15.3:0/3709580472 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff806e9a0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe0f2700 1 --2- 172.21.15.3:0/3709580472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80b2fd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80b13b0 tx=0x7f9ff0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b171c6dc03a8d2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffc8ef700 1 -- 172.21.15.3:0/3709580472 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000e070 con 0x7f9ff80b14e0 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffc8ef700 1 -- 172.21.15.3:0/3709580472 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff000bb60 con 0x7f9ff80b14e0 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffc8ef700 1 -- 172.21.15.3:0/3709580472 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0012430 con 0x7f9ff80b14e0 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/3709580472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 msgr2=0x7f9ff80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/3709580472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80b2fd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80b13b0 tx=0x7f9ff0009780 comp rx=0 tx=0).stop 2023-10-08T16:07:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/3709580472 shutdown_connections 2023-10-08T16:07:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/3709580472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80b2fd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/3709580472 >> v2:172.21.15.27:3300/0 conn(0x7f9ff815c720 0x7f9ff80b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/3709580472 >> 172.21.15.3:0/3709580472 conn(0x7f9ff8096eb0 msgr2=0x7f9ff80b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:28.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/3709580472 shutdown_connections 2023-10-08T16:07:28.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.546+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/3709580472 wait complete. 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 Processor -- start 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 -- start start 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9ff815c350 0x7f9ff8168d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff815c720 0x7f9ff81692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80c38c0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8069de0 con 0x7f9ff815c720 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff816a520 con 0x7f9ff815c350 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40748/0 (socket says 172.21.15.3:40748) 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 -- 172.21.15.3:0/997991877 learned_addr learned my addr 172.21.15.3:0/997991877 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe0f2700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff815c720 0x7f9ff81692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd0f0700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9ff815c350 0x7f9ff8168d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 -- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9ff815c350 msgr2=0x7f9ff8168d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9ff815c350 0x7f9ff8168d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 -- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff815c720 msgr2=0x7f9ff81692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff815c720 0x7f9ff81692b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 -- 172.21.15.3:0/997991877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff0009a20 con 0x7f9ff80b14e0 2023-10-08T16:07:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe0f2700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff815c720 0x7f9ff81692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd0f0700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9ff815c350 0x7f9ff8168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffd8f1700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80698a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c5e0 tx=0x7f9ff4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4005b30 con 0x7f9ff80b14e0 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4005c90 con 0x7f9ff80b14e0 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff80c4170 con 0x7f9ff80b14e0 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40072e0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.550+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff81698e0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.554+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff804be40 con 0x7f9ff80b14e0 2023-10-08T16:07:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.554+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ff401b3b0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.554+0000 7f9fedffb700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9fdc060550 0x7f9fdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.554+0000 7f9ffd0f0700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9fdc060550 0x7f9fdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.554+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ff407bcb0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.554+0000 7f9ffd0f0700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9fdc060550 0x7f9fdc062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8006f00 tx=0x7f9fe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.562+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ff4049be0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.754+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ff809b750 con 0x7f9ff80b14e0 2023-10-08T16:07:28.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.778+0000 7f9fedffb700 1 -- 172.21.15.3:0/997991877 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ff404c2b0 con 0x7f9ff80b14e0 2023-10-08T16:07:28.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9fdc060550 msgr2=0x7f9fdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9fdc060550 0x7f9fdc062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8006f00 tx=0x7f9fe8008040 comp rx=0 tx=0).stop 2023-10-08T16:07:28.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 msgr2=0x7f9ff80698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80698a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c5e0 tx=0x7f9ff4001070 comp rx=0 tx=0).stop 2023-10-08T16:07:28.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 shutdown_connections 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9fdc060550 0x7f9fdc062a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff815c720 0x7f9ff81692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9ff815c350 0x7f9ff8168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 --2- 172.21.15.3:0/997991877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ff80b14e0 0x7f9ff80698a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 >> 172.21.15.3:0/997991877 conn(0x7f9ff8096eb0 msgr2=0x7f9ff815a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 shutdown_connections 2023-10-08T16:07:28.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.782+0000 7f9ffe8f3700 1 -- 172.21.15.3:0/997991877 wait complete. 2023-10-08T16:07:28.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:07:28.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.910+0000 7f81664d4700 1 Processor -- start 2023-10-08T16:07:28.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.910+0000 7f81664d4700 1 -- start start 2023-10-08T16:07:28.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81664d4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8160155910 0x7f816006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81664d4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f816015a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81664d4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8160159d80 con 0x7f81600c7560 2023-10-08T16:07:28.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81664d4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81600c7e90 con 0x7f8160155910 2023-10-08T16:07:28.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81664d4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c8170 con 0x7f8160155ce0 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8165cd3700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f81600c7560 0x7f81600cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33246/0 (socket says 172.21.15.3:33246) 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8165cd3700 1 -- 172.21.15.3:0/1506895080 learned_addr learned my addr 172.21.15.3:0/1506895080 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81654d2700 1 --2- 172.21.15.3:0/1506895080 >> v2:172.21.15.3:3300/0 conn(0x7f8160155910 0x7f816006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380980920 0 0) 0x7f8160159d80 con 0x7f81600c7560 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f814c003570 con 0x7f81600c7560 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f816015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023059543 0 0) 0x7f814c003570 con 0x7f81600c7560 2023-10-08T16:07:28.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 msgr2=0x7f816015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f816015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 >> v2:172.21.15.3:3300/0 conn(0x7f8160155910 msgr2=0x7f816006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 --2- 172.21.15.3:0/1506895080 >> v2:172.21.15.3:3300/0 conn(0x7f8160155910 0x7f816006dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160159730 con 0x7f81600c7560 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f815c001470 con 0x7f81600c7560 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f816015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81654d2700 1 --2- 172.21.15.3:0/1506895080 >> v2:172.21.15.3:3300/0 conn(0x7f8160155910 0x7f816006dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 >> v1:172.21.15.3:6789/0 conn(0x7f81600c7560 legacy=0x7f81600cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f814c003ae0 0x7f814c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f814c004810 0x7f814c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f814c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c7e90 con 0x7f814c004810 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c8170 con 0x7f814c003ae0 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c00bc10 con 0x7f8160155ce0 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f814c004810 0x7f814c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8165cd3700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f814c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f81654d2700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f814c003ae0 0x7f814c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 -- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 msgr2=0x7f814c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:28.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f814c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 -- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f814c003ae0 msgr2=0x7f814c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:28.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f814c003ae0 0x7f814c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8164cd1700 1 -- 172.21.15.3:0/1506895080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c003570 con 0x7f814c004810 2023-10-08T16:07:28.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.914+0000 7f8165cd3700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8160155ce0 0x7f814c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:28.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f8164cd1700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f814c004810 0x7f814c004c80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8160156150 tx=0x7f8150008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956b39f30fa87e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000c070 con 0x7f814c004810 2023-10-08T16:07:28.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815000e5e0 con 0x7f814c004810 2023-10-08T16:07:28.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f8157fff700 1 -- 172.21.15.3:0/1506895080 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000e770 con 0x7f814c004810 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 -- 172.21.15.3:0/1506895080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f814c004810 msgr2=0x7f814c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 --2- 172.21.15.3:0/1506895080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f814c004810 0x7f814c004c80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8160156150 tx=0x7f8150008040 comp rx=0 tx=0).stop 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f8165cd3700 1 -- 172.21.15.3:0/1506895080 reap_dead start 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 -- 172.21.15.3:0/1506895080 shutdown_connections 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 -- 172.21.15.3:0/1506895080 >> 172.21.15.3:0/1506895080 conn(0x7f81600c83b0 msgr2=0x7f81600c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 -- 172.21.15.3:0/1506895080 shutdown_connections 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 -- 172.21.15.3:0/1506895080 wait complete. 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 Processor -- start 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.918+0000 7f81664d4700 1 -- start start 2023-10-08T16:07:28.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f814c004810 0x7f8160157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8160158490 0x7f81600c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 0x7f816014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c41b0 con 0x7f81600c54a0 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c58f0 con 0x7f8160158490 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c35a0 con 0x7f814c004810 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 0x7f816014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 0x7f816014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40770/0 (socket says 172.21.15.3:40770) 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 -- 172.21.15.3:0/318414103 learned_addr learned my addr 172.21.15.3:0/318414103 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8164cd1700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8160158490 0x7f81600c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81654d2700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f814c004810 0x7f8160157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 -- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f814c004810 msgr2=0x7f8160157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f814c004810 0x7f8160157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 -- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8160158490 msgr2=0x7f81600c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8160158490 0x7f81600c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 -- 172.21.15.3:0/318414103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600c3880 con 0x7f81600c54a0 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f8165cd3700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 0x7f816014e010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f815c001b70 tx=0x7f81600c90f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0114f0 con 0x7f81600c54a0 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c011670 con 0x7f81600c54a0 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81600c3b60 con 0x7f81600c54a0 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c011a30 con 0x7f81600c54a0 2023-10-08T16:07:28.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816014e550 con 0x7f81600c54a0 2023-10-08T16:07:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.922+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81600c4320 con 0x7f81600c54a0 2023-10-08T16:07:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.926+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f815c0133e0 con 0x7f81600c54a0 2023-10-08T16:07:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.926+0000 7f81557fa700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8144060550 0x7f8144062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.926+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f815c07bd60 con 0x7f81600c54a0 2023-10-08T16:07:28.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.926+0000 7f81654d2700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8144060550 0x7f8144062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:28.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.926+0000 7f81654d2700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8144060550 0x7f8144062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f81580128a0 tx=0x7f81580098b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:28.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:28.930+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f815c04c350 con 0x7f81600c54a0 2023-10-08T16:07:29.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.122+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f816004be40 con 0x7f81600c54a0 2023-10-08T16:07:29.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.782+0000 7f81557fa700 1 -- 172.21.15.3:0/318414103 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f815c04f970 con 0x7f81600c54a0 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8144060550 msgr2=0x7f8144062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8144060550 0x7f8144062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f81580128a0 tx=0x7f81580098b0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 msgr2=0x7f816014e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 0x7f816014e010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f815c001b70 tx=0x7f81600c90f0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 shutdown_connections 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8144060550 0x7f8144062a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81600c54a0 0x7f816014e010 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8160158490 0x7f81600c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 --2- 172.21.15.3:0/318414103 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f814c004810 0x7f8160157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 >> 172.21.15.3:0/318414103 conn(0x7f81600c83b0 msgr2=0x7f81600c2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:29.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 shutdown_connections 2023-10-08T16:07:29.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.786+0000 7f81664d4700 1 -- 172.21.15.3:0/318414103 wait complete. 2023-10-08T16:07:29.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:29.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 Processor -- start 2023-10-08T16:07:29.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 -- start start 2023-10-08T16:07:29.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:29.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3890068280 0x7f3890068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:29.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3890068bc0 con 0x7f3890156e40 2023-10-08T16:07:29.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38900c70b0 con 0x7f3890068280 2023-10-08T16:07:29.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900c7390 con 0x7f3890068fd0 2023-10-08T16:07:29.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388e59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3890156e40 0x7f38900c8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:57646/0 (socket says 172.21.15.3:57646) 2023-10-08T16:07:29.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388e59c700 1 -- 172.21.15.3:0/1777780521 learned_addr learned my addr 172.21.15.3:0/1777780521 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:29.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f3885d9b700 1 --2- 172.21.15.3:0/1777780521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388ed9d700 1 --2- 172.21.15.3:0/1777780521 >> v2:172.21.15.27:3300/0 conn(0x7f3890068280 0x7f3890068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388dd9b700 1 -- 172.21.15.3:0/1777780521 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078135614 0 0) 0x7f3890068bc0 con 0x7f3890156e40 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388dd9b700 1 -- 172.21.15.3:0/1777780521 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f387c003570 con 0x7f3890156e40 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f3885d9b700 1 -- 172.21.15.3:0/1777780521 >> v2:172.21.15.27:3300/0 conn(0x7f3890068280 msgr2=0x7f3890068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f3885d9b700 1 --2- 172.21.15.3:0/1777780521 >> v2:172.21.15.27:3300/0 conn(0x7f3890068280 0x7f3890068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f3885d9b700 1 -- 172.21.15.3:0/1777780521 >> v1:172.21.15.27:6789/0 conn(0x7f3890156e40 legacy=0x7f38900c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f3885d9b700 1 -- 172.21.15.3:0/1777780521 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900c7670 con 0x7f3890068fd0 2023-10-08T16:07:29.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388ed9d700 1 --2- 172.21.15.3:0/1777780521 >> v2:172.21.15.27:3300/0 conn(0x7f3890068280 0x7f3890068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:29.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f3885d9b700 1 --2- 172.21.15.3:0/1777780521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900c6860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38780098e0 tx=0x7f38780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece737474c2314a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.922+0000 7f388dd9b700 1 -- 172.21.15.3:0/1777780521 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878011630 con 0x7f3890068fd0 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388dd9b700 1 -- 172.21.15.3:0/1777780521 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3878011790 con 0x7f3890068fd0 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388dd9b700 1 -- 172.21.15.3:0/1777780521 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878011b10 con 0x7f3890068fd0 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 -- 172.21.15.3:0/1777780521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 msgr2=0x7f38900c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 --2- 172.21.15.3:0/1777780521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900c6860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38780098e0 tx=0x7f38780091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 -- 172.21.15.3:0/1777780521 shutdown_connections 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 --2- 172.21.15.3:0/1777780521 >> v2:172.21.15.27:3300/0 conn(0x7f3890068280 0x7f3890068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 --2- 172.21.15.3:0/1777780521 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900c6860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 -- 172.21.15.3:0/1777780521 >> 172.21.15.3:0/1777780521 conn(0x7f38900c8c90 msgr2=0x7f38900c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 -- 172.21.15.3:0/1777780521 shutdown_connections 2023-10-08T16:07:29.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 -- 172.21.15.3:0/1777780521 wait complete. 2023-10-08T16:07:29.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 Processor -- start 2023-10-08T16:07:29.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.926+0000 7f388f59e700 1 -- start start 2023-10-08T16:07:29.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 0x7f3890148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:29.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:29.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3890156e40 0x7f3890159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38900a9240 con 0x7f3890068280 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38900a9520 con 0x7f3890156e40 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900a9800 con 0x7f3890068fd0 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 0x7f3890148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 0x7f3890148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54678/0 (socket says 172.21.15.3:54678) 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 -- 172.21.15.3:0/3878797448 learned_addr learned my addr 172.21.15.3:0/3878797448 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f3885d9b700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:29.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388ed9d700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3890156e40 0x7f3890159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:29.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 -- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 msgr2=0x7f38900a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:29.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 -- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3890156e40 msgr2=0x7f3890159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3890156e40 0x7f3890159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 -- 172.21.15.3:0/3878797448 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888009a20 con 0x7f3890068280 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f3885d9b700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388e59c700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 0x7f3890148f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38800011e0 tx=0x7f3880007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880005b30 con 0x7f3890068280 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880005c90 con 0x7f3890068280 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3878009420 con 0x7f3890068280 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880007320 con 0x7f3890068280 2023-10-08T16:07:29.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.930+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38900a9dc0 con 0x7f3890068280 2023-10-08T16:07:29.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.934+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389015a450 con 0x7f3890068280 2023-10-08T16:07:29.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.934+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3880007690 con 0x7f3890068280 2023-10-08T16:07:29.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.934+0000 7f3886ffd700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3870060550 0x7f3870062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:29.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.934+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f388007bbc0 con 0x7f3890068280 2023-10-08T16:07:29.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.934+0000 7f3885d9b700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3870060550 0x7f3870062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:29.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.934+0000 7f3885d9b700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3870060550 0x7f3870062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38780091e0 tx=0x7f3878017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:29.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:29.942+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f389015a450 con 0x7f3890068280 2023-10-08T16:07:30.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f389015a450 con 0x7f3890068280 2023-10-08T16:07:30.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f3886ffd700 1 -- 172.21.15.3:0/3878797448 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f389015a450 con 0x7f3890068280 2023-10-08T16:07:30.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:30.138 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:07:30.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3870060550 msgr2=0x7f3870062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3870060550 0x7f3870062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38780091e0 tx=0x7f3878017000 comp rx=0 tx=0).stop 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 msgr2=0x7f3890148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 0x7f3890148f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38800011e0 tx=0x7f3880007df0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 shutdown_connections 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3870060550 0x7f3870062a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3890156e40 0x7f3890159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3890068fd0 0x7f38900a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 --2- 172.21.15.3:0/3878797448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3890068280 0x7f3890148f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 >> 172.21.15.3:0/3878797448 conn(0x7f38900c8c90 msgr2=0x7f3890155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 shutdown_connections 2023-10-08T16:07:30.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.134+0000 7f388f59e700 1 -- 172.21.15.3:0/3878797448 wait complete. 2023-10-08T16:07:30.142 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:07:30.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:30.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 Processor -- start 2023-10-08T16:07:30.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 -- start start 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440c95c0 0x7fdc440c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdc440ac630 0x7fdc440cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc440ad520 con 0x7fdc44156980 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc440ac250 con 0x7fdc440ac630 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc48e0b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440aef80 con 0x7fdc440c95c0 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc437fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440c95c0 0x7fdc440c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc3affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdc440ac630 0x7fdc440cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc43fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdc44156980 0x7fdc44156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:57648/0 (socket says 172.21.15.3:57648) 2023-10-08T16:07:30.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc43fff700 1 -- 172.21.15.3:0/3343881464 learned_addr learned my addr 172.21.15.3:0/3343881464 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:30.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc3affd700 1 -- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440c95c0 msgr2=0x7fdc440c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:30.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc3affd700 1 --2- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440c95c0 0x7fdc440c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc3affd700 1 -- 172.21.15.3:0/3343881464 >> v1:172.21.15.27:6789/0 conn(0x7fdc44156980 legacy=0x7fdc44156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc3affd700 1 -- 172.21.15.3:0/3343881464 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc440af260 con 0x7fdc440ac630 2023-10-08T16:07:30.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.254+0000 7fdc3affd700 1 --2- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440ac630 0x7fdc440cbb20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009910 tx=0x7fdc2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569fa09d3956657b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.258+0000 7fdc42ffd700 1 -- 172.21.15.3:0/3343881464 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00b640 con 0x7fdc440ac630 2023-10-08T16:07:30.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.258+0000 7fdc42ffd700 1 -- 172.21.15.3:0/3343881464 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c00b7a0 con 0x7fdc440ac630 2023-10-08T16:07:30.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.258+0000 7fdc42ffd700 1 -- 172.21.15.3:0/3343881464 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00bb60 con 0x7fdc440ac630 2023-10-08T16:07:30.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440ac630 msgr2=0x7fdc440cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440ac630 0x7fdc440cbb20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009910 tx=0x7fdc2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- 172.21.15.3:0/3343881464 shutdown_connections 2023-10-08T16:07:30.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440ac630 0x7fdc440cbb20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/3343881464 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440c95c0 0x7fdc440c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- 172.21.15.3:0/3343881464 >> 172.21.15.3:0/3343881464 conn(0x7fdc4406b6b0 msgr2=0x7fdc4406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:30.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- 172.21.15.3:0/3343881464 shutdown_connections 2023-10-08T16:07:30.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- 172.21.15.3:0/3343881464 wait complete. 2023-10-08T16:07:30.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 Processor -- start 2023-10-08T16:07:30.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- start start 2023-10-08T16:07:30.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440ac630 0x7fdc4406cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440c95c0 0x7fdc4406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 0x7fdc440a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440c6840 con 0x7fdc44156980 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440ab100 con 0x7fdc440c95c0 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc48e0b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440c6510 con 0x7fdc440ac630 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc43fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 0x7fdc440a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc3affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440c95c0 0x7fdc4406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc43fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 0x7fdc440a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54684/0 (socket says 172.21.15.3:54684) 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc43fff700 1 -- 172.21.15.3:0/4124146858 learned_addr learned my addr 172.21.15.3:0/4124146858 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:30.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.262+0000 7fdc437fe700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440ac630 0x7fdc4406cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc43fff700 1 -- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440ac630 msgr2=0x7fdc4406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc43fff700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440ac630 0x7fdc4406cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc43fff700 1 -- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440c95c0 msgr2=0x7fdc4406d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc43fff700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440c95c0 0x7fdc4406d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc43fff700 1 -- 172.21.15.3:0/4124146858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009420 con 0x7fdc44156980 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc43fff700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 0x7fdc440a9af0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00cbf0 tx=0x7fdc3c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c00a870 con 0x7fdc44156980 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c00a9d0 con 0x7fdc44156980 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c00ad50 con 0x7fdc44156980 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc440aa860 con 0x7fdc44156980 2023-10-08T16:07:30.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc440aae20 con 0x7fdc44156980 2023-10-08T16:07:30.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc440c69b0 con 0x7fdc44156980 2023-10-08T16:07:30.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.266+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdc3c007300 con 0x7fdc44156980 2023-10-08T16:07:30.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.270+0000 7fdc3bfff700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdc24060550 0x7fdc24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.270+0000 7fdc437fe700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdc24060550 0x7fdc24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.270+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc3c07cb40 con 0x7fdc44156980 2023-10-08T16:07:30.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.270+0000 7fdc437fe700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdc24060550 0x7fdc24062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009db0 tx=0x7fdc340091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.278+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdc440c69b0 con 0x7fdc44156980 2023-10-08T16:07:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.442+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc440c6980 con 0x7fdc44156980 2023-10-08T16:07:30.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.442+0000 7fdc3bfff700 1 -- 172.21.15.3:0/4124146858 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fdc3c04d0a0 con 0x7fdc44156980 2023-10-08T16:07:30.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:30.447 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":32,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:28.751208+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:25.214157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:26.118148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdc24060550 msgr2=0x7fdc24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdc24060550 0x7fdc24062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009db0 tx=0x7fdc340091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 msgr2=0x7fdc440a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 0x7fdc440a9af0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00cbf0 tx=0x7fdc3c0019c0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 shutdown_connections 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fdc24060550 0x7fdc24062a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc44156980 0x7fdc440a9af0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc440c95c0 0x7fdc4406d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 --2- 172.21.15.3:0/4124146858 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fdc440ac630 0x7fdc4406cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 >> 172.21.15.3:0/4124146858 conn(0x7fdc4406b6b0 msgr2=0x7fdc44156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 shutdown_connections 2023-10-08T16:07:30.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.446+0000 7fdc48e0b700 1 -- 172.21.15.3:0/4124146858 wait complete. 2023-10-08T16:07:30.462 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:07:30.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:07:30.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.566+0000 7f6d2ad7c700 1 Processor -- start 2023-10-08T16:07:30.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.566+0000 7f6d2ad7c700 1 -- start start 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.566+0000 7f6d2ad7c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d24068990 0x7f6d241604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.566+0000 7f6d2ad7c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d240c7fb0 con 0x7f6d2413eed0 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d240c8290 con 0x7f6d24159d40 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d240c8570 con 0x7f6d24068990 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d29d7a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6d2413eed0 0x7f6d240c7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36578/0 (socket says 172.21.15.3:36578) 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d29d7a700 1 -- 172.21.15.3:0/1688441405 learned_addr learned my addr 172.21.15.3:0/1688441405 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2a57b700 1 --2- 172.21.15.3:0/1688441405 >> v2:172.21.15.27:3300/0 conn(0x7f6d24068990 0x7f6d241604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d28d78700 1 -- 172.21.15.3:0/1688441405 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525682448 0 0) 0x7f6d240c7fb0 con 0x7f6d2413eed0 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d28d78700 1 -- 172.21.15.3:0/1688441405 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d10003570 con 0x7f6d2413eed0 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2a57b700 1 -- 172.21.15.3:0/1688441405 >> v1:172.21.15.27:6789/0 conn(0x7f6d24159d40 legacy=0x7f6d24068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2a57b700 1 -- 172.21.15.3:0/1688441405 >> v1:172.21.15.3:6789/0 conn(0x7f6d2413eed0 legacy=0x7f6d240c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2a57b700 1 -- 172.21.15.3:0/1688441405 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240c8850 con 0x7f6d24068990 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2a57b700 1 --2- 172.21.15.3:0/1688441405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24068990 0x7f6d241604f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009e60 tx=0x7f6d1c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e956920cbfdae28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d28d78700 1 -- 172.21.15.3:0/1688441405 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00e070 con 0x7f6d24068990 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d28d78700 1 -- 172.21.15.3:0/1688441405 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00bb60 con 0x7f6d24068990 2023-10-08T16:07:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d28d78700 1 -- 172.21.15.3:0/1688441405 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c012430 con 0x7f6d24068990 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/1688441405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24068990 msgr2=0x7f6d241604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/1688441405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24068990 0x7f6d241604f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009e60 tx=0x7f6d1c009780 comp rx=0 tx=0).stop 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/1688441405 shutdown_connections 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/1688441405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24068990 0x7f6d241604f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/1688441405 >> 172.21.15.3:0/1688441405 conn(0x7f6d240c8c90 msgr2=0x7f6d240c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/1688441405 shutdown_connections 2023-10-08T16:07:30.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.570+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/1688441405 wait complete. 2023-10-08T16:07:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 Processor -- start 2023-10-08T16:07:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 -- start start 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d24068990 0x7f6d2413de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 0x7f6d240b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24159d40 0x7f6d240af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c3ff0 con 0x7f6d2413eed0 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c6150 con 0x7f6d24159d40 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2ad7c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c3470 con 0x7f6d24068990 2023-10-08T16:07:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d29579700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 0x7f6d240b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d2a57b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24159d40 0x7f6d240af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d29d7a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d24068990 0x7f6d2413de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d29579700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 0x7f6d240b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54694/0 (socket says 172.21.15.3:54694) 2023-10-08T16:07:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.574+0000 7f6d29579700 1 -- 172.21.15.3:0/3217746029 learned_addr learned my addr 172.21.15.3:0/3217746029 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29579700 1 -- 172.21.15.3:0/3217746029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d24068990 msgr2=0x7f6d2413de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29579700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d24068990 0x7f6d2413de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29579700 1 -- 172.21.15.3:0/3217746029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24159d40 msgr2=0x7f6d240af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29579700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24159d40 0x7f6d240af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29579700 1 -- 172.21.15.3:0/3217746029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c009a20 con 0x7f6d2413eed0 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29579700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 0x7f6d240b0bb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400c4e0 tx=0x7f6d1400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14011590 con 0x7f6d2413eed0 2023-10-08T16:07:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d14011710 con 0x7f6d2413eed0 2023-10-08T16:07:30.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d240c3750 con 0x7f6d2413eed0 2023-10-08T16:07:30.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14011ad0 con 0x7f6d2413eed0 2023-10-08T16:07:30.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d240c3d10 con 0x7f6d2413eed0 2023-10-08T16:07:30.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2404be40 con 0x7f6d2413eed0 2023-10-08T16:07:30.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6d1401b3b0 con 0x7f6d2413eed0 2023-10-08T16:07:30.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d19ffb700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d08060550 0x7f6d08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d1407bc50 con 0x7f6d2413eed0 2023-10-08T16:07:30.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.578+0000 7f6d29d7a700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d08060550 0x7f6d08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.582+0000 7f6d29d7a700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d08060550 0x7f6d08062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007fd0 tx=0x7f6d20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.586+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d1404c1a0 con 0x7f6d2413eed0 2023-10-08T16:07:30.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.742+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d240c65c0 con 0x7f6d08060550 2023-10-08T16:07:30.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.758+0000 7f6d19ffb700 1 -- 172.21.15.3:0/3217746029 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267306 (secure 0 0 0) 0x7f6d240c65c0 con 0x7f6d08060550 2023-10-08T16:07:30.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:30.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d08060550 msgr2=0x7f6d08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d08060550 0x7f6d08062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007fd0 tx=0x7f6d20009040 comp rx=0 tx=0).stop 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 msgr2=0x7f6d240b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 0x7f6d240b0bb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400c4e0 tx=0x7f6d1400c7f0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 shutdown_connections 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d08060550 0x7f6d08062a00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d24159d40 0x7f6d240af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d2413eed0 0x7f6d240b0bb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 --2- 172.21.15.3:0/3217746029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6d24068990 0x7f6d2413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 >> 172.21.15.3:0/3217746029 conn(0x7f6d240c8c90 msgr2=0x7f6d240b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:30.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 shutdown_connections 2023-10-08T16:07:30.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.766+0000 7f6d2ad7c700 1 -- 172.21.15.3:0/3217746029 wait complete. 2023-10-08T16:07:30.771 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:07:30.783 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-08T16:07:29.834396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382088,"kb_used_data":3784,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592632,"statfs":{"total":773094113280,"available":770654855168,"internally_reserved":0,"allocated":3874816,"data_stored":2188464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.088958"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783841+0000","last_change":"2023-10-08T16:07:27.783841+0000","last_active":"2023-10-08T16:07:27.783841+0000","last_peered":"2023-10-08T16:07:27.783841+0000","last_clean":"2023-10-08T16:07:27.783841+0000","last_became_active":"2023-10-08T16:07:27.783311+0000","last_became_peered":"2023-10-08T16:07:27.783311+0000","last_unstale":"2023-10-08T16:07:27.783841+0000","last_undegraded":"2023-10-08T16:07:27.783841+0000","last_fullsized":"2023-10-08T16:07:27.783841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:13.785905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.795396+0000","last_change":"2023-10-08T16:07:27.795396+0000","last_active":"2023-10-08T16:07:27.795396+0000","last_peered":"2023-10-08T16:07:27.795396+0000","last_clean":"2023-10-08T16:07:27.795396+0000","last_became_active":"2023-10-08T16:07:27.795157+0000","last_became_peered":"2023-10-08T16:07:27.795157+0000","last_unstale":"2023-10-08T16:07:27.795396+0000","last_undegraded":"2023-10-08T16:07:27.795396+0000","last_fullsized":"2023-10-08T16:07:27.795396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:52.207450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793313+0000","last_change":"2023-10-08T16:07:27.793313+0000","last_active":"2023-10-08T16:07:27.793313+0000","last_peered":"2023-10-08T16:07:27.793313+0000","last_clean":"2023-10-08T16:07:27.793313+0000","last_became_active":"2023-10-08T16:07:27.793020+0000","last_became_peered":"2023-10-08T16:07:27.793020+0000","last_unstale":"2023-10-08T16:07:27.793313+0000","last_undegraded":"2023-10-08T16:07:27.793313+0000","last_fullsized":"2023-10-08T16:07:27.793313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:41.522969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776881+0000","last_change":"2023-10-08T16:07:27.776881+0000","last_active":"2023-10-08T16:07:27.776881+0000","last_peered":"2023-10-08T16:07:27.776881+0000","last_clean":"2023-10-08T16:07:27.776881+0000","last_became_active":"2023-10-08T16:07:27.776353+0000","last_became_peered":"2023-10-08T16:07:27.776353+0000","last_unstale":"2023-10-08T16:07:27.776881+0000","last_undegraded":"2023-10-08T16:07:27.776881+0000","last_fullsized":"2023-10-08T16:07:27.776881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:26.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.781263+0000","last_change":"2023-10-08T16:07:27.781263+0000","last_active":"2023-10-08T16:07:27.781263+0000","last_peered":"2023-10-08T16:07:27.781263+0000","last_clean":"2023-10-08T16:07:27.781263+0000","last_became_active":"2023-10-08T16:07:27.780929+0000","last_became_peered":"2023-10-08T16:07:27.780929+0000","last_unstale":"2023-10-08T16:07:27.781263+0000","last_undegraded":"2023-10-08T16:07:27.781263+0000","last_fullsized":"2023-10-08T16:07:27.781263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:56.759657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.787560+0000","last_change":"2023-10-08T16:07:27.787560+0000","last_active":"2023-10-08T16:07:27.787560+0000","last_peered":"2023-10-08T16:07:27.787560+0000","last_clean":"2023-10-08T16:07:27.787560+0000","last_became_active":"2023-10-08T16:07:27.787273+0000","last_became_peered":"2023-10-08T16:07:27.787273+0000","last_unstale":"2023-10-08T16:07:27.787560+0000","last_undegraded":"2023-10-08T16:07:27.787560+0000","last_fullsized":"2023-10-08T16:07:27.787560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:10.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.777412+0000","last_change":"2023-10-08T16:07:27.777412+0000","last_active":"2023-10-08T16:07:27.777412+0000","last_peered":"2023-10-08T16:07:27.777412+0000","last_clean":"2023-10-08T16:07:27.777412+0000","last_became_active":"2023-10-08T16:07:27.776457+0000","last_became_peered":"2023-10-08T16:07:27.776457+0000","last_unstale":"2023-10-08T16:07:27.777412+0000","last_undegraded":"2023-10-08T16:07:27.777412+0000","last_fullsized":"2023-10-08T16:07:27.777412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:39.814779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780076+0000","last_change":"2023-10-08T16:07:27.780076+0000","last_active":"2023-10-08T16:07:27.780076+0000","last_peered":"2023-10-08T16:07:27.780076+0000","last_clean":"2023-10-08T16:07:27.780076+0000","last_became_active":"2023-10-08T16:07:27.779430+0000","last_became_peered":"2023-10-08T16:07:27.779430+0000","last_unstale":"2023-10-08T16:07:27.780076+0000","last_undegraded":"2023-10-08T16:07:27.780076+0000","last_fullsized":"2023-10-08T16:07:27.780076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:52.325218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.771504+0000","last_change":"2023-10-08T16:07:27.771504+0000","last_active":"2023-10-08T16:07:27.771504+0000","last_peered":"2023-10-08T16:07:27.771504+0000","last_clean":"2023-10-08T16:07:27.771504+0000","last_became_active":"2023-10-08T16:07:27.771126+0000","last_became_peered":"2023-10-08T16:07:27.771126+0000","last_unstale":"2023-10-08T16:07:27.771504+0000","last_undegraded":"2023-10-08T16:07:27.771504+0000","last_fullsized":"2023-10-08T16:07:27.771504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:31.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782211+0000","last_change":"2023-10-08T16:07:27.782211+0000","last_active":"2023-10-08T16:07:27.782211+0000","last_peered":"2023-10-08T16:07:27.782211+0000","last_clean":"2023-10-08T16:07:27.782211+0000","last_became_active":"2023-10-08T16:07:27.781905+0000","last_became_peered":"2023-10-08T16:07:27.781905+0000","last_unstale":"2023-10-08T16:07:27.782211+0000","last_undegraded":"2023-10-08T16:07:27.782211+0000","last_fullsized":"2023-10-08T16:07:27.782211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:17.978845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.792674+0000","last_change":"2023-10-08T16:07:27.792674+0000","last_active":"2023-10-08T16:07:27.792674+0000","last_peered":"2023-10-08T16:07:27.792674+0000","last_clean":"2023-10-08T16:07:27.792674+0000","last_became_active":"2023-10-08T16:07:27.792407+0000","last_became_peered":"2023-10-08T16:07:27.792407+0000","last_unstale":"2023-10-08T16:07:27.792674+0000","last_undegraded":"2023-10-08T16:07:27.792674+0000","last_fullsized":"2023-10-08T16:07:27.792674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:41.522969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.786175+0000","last_change":"2023-10-08T16:07:27.786175+0000","last_active":"2023-10-08T16:07:27.786175+0000","last_peered":"2023-10-08T16:07:27.786175+0000","last_clean":"2023-10-08T16:07:27.786175+0000","last_became_active":"2023-10-08T16:07:27.784486+0000","last_became_peered":"2023-10-08T16:07:27.784486+0000","last_unstale":"2023-10-08T16:07:27.786175+0000","last_undegraded":"2023-10-08T16:07:27.786175+0000","last_fullsized":"2023-10-08T16:07:27.786175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:52.207450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.773152+0000","last_change":"2023-10-08T16:07:27.773152+0000","last_active":"2023-10-08T16:07:27.773152+0000","last_peered":"2023-10-08T16:07:27.773152+0000","last_clean":"2023-10-08T16:07:27.773152+0000","last_became_active":"2023-10-08T16:07:27.772724+0000","last_became_peered":"2023-10-08T16:07:27.772724+0000","last_unstale":"2023-10-08T16:07:27.773152+0000","last_undegraded":"2023-10-08T16:07:27.773152+0000","last_fullsized":"2023-10-08T16:07:27.773152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:00.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.784884+0000","last_change":"2023-10-08T16:07:27.784884+0000","last_active":"2023-10-08T16:07:27.784884+0000","last_peered":"2023-10-08T16:07:27.784884+0000","last_clean":"2023-10-08T16:07:27.784884+0000","last_became_active":"2023-10-08T16:07:27.783087+0000","last_became_peered":"2023-10-08T16:07:27.783087+0000","last_unstale":"2023-10-08T16:07:27.784884+0000","last_undegraded":"2023-10-08T16:07:27.784884+0000","last_fullsized":"2023-10-08T16:07:27.784884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:36.494143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780811+0000","last_change":"2023-10-08T16:07:27.780811+0000","last_active":"2023-10-08T16:07:27.780811+0000","last_peered":"2023-10-08T16:07:27.780811+0000","last_clean":"2023-10-08T16:07:27.780811+0000","last_became_active":"2023-10-08T16:07:27.780408+0000","last_became_peered":"2023-10-08T16:07:27.780408+0000","last_unstale":"2023-10-08T16:07:27.780811+0000","last_undegraded":"2023-10-08T16:07:27.780811+0000","last_fullsized":"2023-10-08T16:07:27.780811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:17.978845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.778851+0000","last_change":"2023-10-08T16:07:27.778851+0000","last_active":"2023-10-08T16:07:27.778851+0000","last_peered":"2023-10-08T16:07:27.778851+0000","last_clean":"2023-10-08T16:07:27.778851+0000","last_became_active":"2023-10-08T16:07:27.778555+0000","last_became_peered":"2023-10-08T16:07:27.778555+0000","last_unstale":"2023-10-08T16:07:27.778851+0000","last_undegraded":"2023-10-08T16:07:27.778851+0000","last_fullsized":"2023-10-08T16:07:27.778851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:05.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.774971+0000","last_change":"2023-10-08T16:07:27.774971+0000","last_active":"2023-10-08T16:07:27.774971+0000","last_peered":"2023-10-08T16:07:27.774971+0000","last_clean":"2023-10-08T16:07:27.774971+0000","last_became_active":"2023-10-08T16:07:27.774628+0000","last_became_peered":"2023-10-08T16:07:27.774628+0000","last_unstale":"2023-10-08T16:07:27.774971+0000","last_undegraded":"2023-10-08T16:07:27.774971+0000","last_fullsized":"2023-10-08T16:07:27.774971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:31.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794854+0000","last_change":"2023-10-08T16:07:27.794854+0000","last_active":"2023-10-08T16:07:27.794854+0000","last_peered":"2023-10-08T16:07:27.794854+0000","last_clean":"2023-10-08T16:07:27.794854+0000","last_became_active":"2023-10-08T16:07:27.794540+0000","last_became_peered":"2023-10-08T16:07:27.794540+0000","last_unstale":"2023-10-08T16:07:27.794854+0000","last_undegraded":"2023-10-08T16:07:27.794854+0000","last_fullsized":"2023-10-08T16:07:27.794854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:46.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794142+0000","last_change":"2023-10-08T16:07:27.794142+0000","last_active":"2023-10-08T16:07:27.794142+0000","last_peered":"2023-10-08T16:07:27.794142+0000","last_clean":"2023-10-08T16:07:27.794142+0000","last_became_active":"2023-10-08T16:07:27.793817+0000","last_became_peered":"2023-10-08T16:07:27.793817+0000","last_unstale":"2023-10-08T16:07:27.794142+0000","last_undegraded":"2023-10-08T16:07:27.794142+0000","last_fullsized":"2023-10-08T16:07:27.794142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:22.221819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782612+0000","last_change":"2023-10-08T16:07:27.782612+0000","last_active":"2023-10-08T16:07:27.782612+0000","last_peered":"2023-10-08T16:07:27.782612+0000","last_clean":"2023-10-08T16:07:27.782612+0000","last_became_active":"2023-10-08T16:07:27.782255+0000","last_became_peered":"2023-10-08T16:07:27.782255+0000","last_unstale":"2023-10-08T16:07:27.782612+0000","last_undegraded":"2023-10-08T16:07:27.782612+0000","last_fullsized":"2023-10-08T16:07:27.782612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:02.675645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775150+0000","last_change":"2023-10-08T16:07:27.775150+0000","last_active":"2023-10-08T16:07:27.775150+0000","last_peered":"2023-10-08T16:07:27.775150+0000","last_clean":"2023-10-08T16:07:27.775150+0000","last_became_active":"2023-10-08T16:07:27.774846+0000","last_became_peered":"2023-10-08T16:07:27.774846+0000","last_unstale":"2023-10-08T16:07:27.775150+0000","last_undegraded":"2023-10-08T16:07:27.775150+0000","last_fullsized":"2023-10-08T16:07:27.775150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:26.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782275+0000","last_change":"2023-10-08T16:07:27.782275+0000","last_active":"2023-10-08T16:07:27.782275+0000","last_peered":"2023-10-08T16:07:27.782275+0000","last_clean":"2023-10-08T16:07:27.782275+0000","last_became_active":"2023-10-08T16:07:27.781943+0000","last_became_peered":"2023-10-08T16:07:27.781943+0000","last_unstale":"2023-10-08T16:07:27.782275+0000","last_undegraded":"2023-10-08T16:07:27.782275+0000","last_fullsized":"2023-10-08T16:07:27.782275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:43.108054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776312+0000","last_change":"2023-10-08T16:07:27.776312+0000","last_active":"2023-10-08T16:07:27.776312+0000","last_peered":"2023-10-08T16:07:27.776312+0000","last_clean":"2023-10-08T16:07:27.776312+0000","last_became_active":"2023-10-08T16:07:27.776032+0000","last_became_peered":"2023-10-08T16:07:27.776032+0000","last_unstale":"2023-10-08T16:07:27.776312+0000","last_undegraded":"2023-10-08T16:07:27.776312+0000","last_fullsized":"2023-10-08T16:07:27.776312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:32.550591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780600+0000","last_change":"2023-10-08T16:07:27.780600+0000","last_active":"2023-10-08T16:07:27.780600+0000","last_peered":"2023-10-08T16:07:27.780600+0000","last_clean":"2023-10-08T16:07:27.780600+0000","last_became_active":"2023-10-08T16:07:27.780307+0000","last_became_peered":"2023-10-08T16:07:27.780307+0000","last_unstale":"2023-10-08T16:07:27.780600+0000","last_undegraded":"2023-10-08T16:07:27.780600+0000","last_fullsized":"2023-10-08T16:07:27.780600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:11.282106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780290+0000","last_change":"2023-10-08T16:07:27.780290+0000","last_active":"2023-10-08T16:07:27.780290+0000","last_peered":"2023-10-08T16:07:27.780290+0000","last_clean":"2023-10-08T16:07:27.780290+0000","last_became_active":"2023-10-08T16:07:27.779680+0000","last_became_peered":"2023-10-08T16:07:27.779680+0000","last_unstale":"2023-10-08T16:07:27.780290+0000","last_undegraded":"2023-10-08T16:07:27.780290+0000","last_fullsized":"2023-10-08T16:07:27.780290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:01.101357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783153+0000","last_change":"2023-10-08T16:07:27.783153+0000","last_active":"2023-10-08T16:07:27.783153+0000","last_peered":"2023-10-08T16:07:27.783153+0000","last_clean":"2023-10-08T16:07:27.783153+0000","last_became_active":"2023-10-08T16:07:27.782782+0000","last_became_peered":"2023-10-08T16:07:27.782782+0000","last_unstale":"2023-10-08T16:07:27.783153+0000","last_undegraded":"2023-10-08T16:07:27.783153+0000","last_fullsized":"2023-10-08T16:07:27.783153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:38:22.189471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780370+0000","last_change":"2023-10-08T16:07:27.780370+0000","last_active":"2023-10-08T16:07:27.780370+0000","last_peered":"2023-10-08T16:07:27.780370+0000","last_clean":"2023-10-08T16:07:27.780370+0000","last_became_active":"2023-10-08T16:07:27.780068+0000","last_became_peered":"2023-10-08T16:07:27.780068+0000","last_unstale":"2023-10-08T16:07:27.780370+0000","last_undegraded":"2023-10-08T16:07:27.780370+0000","last_fullsized":"2023-10-08T16:07:27.780370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:31.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.795856+0000","last_change":"2023-10-08T16:07:27.795856+0000","last_active":"2023-10-08T16:07:27.795856+0000","last_peered":"2023-10-08T16:07:27.795856+0000","last_clean":"2023-10-08T16:07:27.795856+0000","last_became_active":"2023-10-08T16:07:27.795603+0000","last_became_peered":"2023-10-08T16:07:27.795603+0000","last_unstale":"2023-10-08T16:07:27.795856+0000","last_undegraded":"2023-10-08T16:07:27.795856+0000","last_fullsized":"2023-10-08T16:07:27.795856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:37.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783175+0000","last_change":"2023-10-08T16:07:27.783175+0000","last_active":"2023-10-08T16:07:27.783175+0000","last_peered":"2023-10-08T16:07:27.783175+0000","last_clean":"2023-10-08T16:07:27.783175+0000","last_became_active":"2023-10-08T16:07:27.782713+0000","last_became_peered":"2023-10-08T16:07:27.782713+0000","last_unstale":"2023-10-08T16:07:27.783175+0000","last_undegraded":"2023-10-08T16:07:27.783175+0000","last_fullsized":"2023-10-08T16:07:27.783175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:39.814779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775695+0000","last_change":"2023-10-08T16:07:27.775695+0000","last_active":"2023-10-08T16:07:27.775695+0000","last_peered":"2023-10-08T16:07:27.775695+0000","last_clean":"2023-10-08T16:07:27.775695+0000","last_became_active":"2023-10-08T16:07:27.775022+0000","last_became_peered":"2023-10-08T16:07:27.775022+0000","last_unstale":"2023-10-08T16:07:27.775695+0000","last_undegraded":"2023-10-08T16:07:27.775695+0000","last_fullsized":"2023-10-08T16:07:27.775695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:32.470669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.771465+0000","last_change":"2023-10-08T16:07:27.771465+0000","last_active":"2023-10-08T16:07:27.771465+0000","last_peered":"2023-10-08T16:07:27.771465+0000","last_clean":"2023-10-08T16:07:27.771465+0000","last_became_active":"2023-10-08T16:07:27.771194+0000","last_became_peered":"2023-10-08T16:07:27.771194+0000","last_unstale":"2023-10-08T16:07:27.771465+0000","last_undegraded":"2023-10-08T16:07:27.771465+0000","last_fullsized":"2023-10-08T16:07:27.771465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:22.821051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775675+0000","last_change":"2023-10-08T16:07:27.775675+0000","last_active":"2023-10-08T16:07:27.775675+0000","last_peered":"2023-10-08T16:07:27.775675+0000","last_clean":"2023-10-08T16:07:27.775675+0000","last_became_active":"2023-10-08T16:07:27.775334+0000","last_became_peered":"2023-10-08T16:07:27.775334+0000","last_unstale":"2023-10-08T16:07:27.775675+0000","last_undegraded":"2023-10-08T16:07:27.775675+0000","last_fullsized":"2023-10-08T16:07:27.775675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:37.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776979+0000","last_change":"2023-10-08T16:07:27.776979+0000","last_active":"2023-10-08T16:07:27.776979+0000","last_peered":"2023-10-08T16:07:27.776979+0000","last_clean":"2023-10-08T16:07:27.776979+0000","last_became_active":"2023-10-08T16:07:27.776659+0000","last_became_peered":"2023-10-08T16:07:27.776659+0000","last_unstale":"2023-10-08T16:07:27.776979+0000","last_undegraded":"2023-10-08T16:07:27.776979+0000","last_fullsized":"2023-10-08T16:07:27.776979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:59.140322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796370+0000","last_change":"2023-10-08T16:07:26.781384+0000","last_active":"2023-10-08T16:07:27.796370+0000","last_peered":"2023-10-08T16:07:27.796370+0000","last_clean":"2023-10-08T16:07:27.796370+0000","last_became_active":"2023-10-08T16:07:26.781118+0000","last_became_peered":"2023-10-08T16:07:26.781118+0000","last_unstale":"2023-10-08T16:07:27.796370+0000","last_undegraded":"2023-10-08T16:07:27.796370+0000","last_fullsized":"2023-10-08T16:07:27.796370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:55.748824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.769611+0000","last_change":"2023-10-08T16:07:27.769611+0000","last_active":"2023-10-08T16:07:27.769611+0000","last_peered":"2023-10-08T16:07:27.769611+0000","last_clean":"2023-10-08T16:07:27.769611+0000","last_became_active":"2023-10-08T16:07:27.769226+0000","last_became_peered":"2023-10-08T16:07:27.769226+0000","last_unstale":"2023-10-08T16:07:27.769611+0000","last_undegraded":"2023-10-08T16:07:27.769611+0000","last_fullsized":"2023-10-08T16:07:27.769611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:43.108054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.758901+0000","last_change":"2023-10-08T16:07:26.783289+0000","last_active":"2023-10-08T16:07:27.758901+0000","last_peered":"2023-10-08T16:07:27.758901+0000","last_clean":"2023-10-08T16:07:27.758901+0000","last_became_active":"2023-10-08T16:07:26.782974+0000","last_became_peered":"2023-10-08T16:07:26.782974+0000","last_unstale":"2023-10-08T16:07:27.758901+0000","last_undegraded":"2023-10-08T16:07:27.758901+0000","last_fullsized":"2023-10-08T16:07:27.758901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:55.748824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.787693+0000","last_change":"2023-10-08T16:07:27.787693+0000","last_active":"2023-10-08T16:07:27.787693+0000","last_peered":"2023-10-08T16:07:27.787693+0000","last_clean":"2023-10-08T16:07:27.787693+0000","last_became_active":"2023-10-08T16:07:27.787398+0000","last_became_peered":"2023-10-08T16:07:27.787398+0000","last_unstale":"2023-10-08T16:07:27.787693+0000","last_undegraded":"2023-10-08T16:07:27.787693+0000","last_fullsized":"2023-10-08T16:07:27.787693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:22.821051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.798823+0000","last_change":"2023-10-08T16:07:26.781510+0000","last_active":"2023-10-08T16:07:27.798823+0000","last_peered":"2023-10-08T16:07:27.798823+0000","last_clean":"2023-10-08T16:07:27.798823+0000","last_became_active":"2023-10-08T16:07:26.781198+0000","last_became_peered":"2023-10-08T16:07:26.781198+0000","last_unstale":"2023-10-08T16:07:27.798823+0000","last_undegraded":"2023-10-08T16:07:27.798823+0000","last_fullsized":"2023-10-08T16:07:27.798823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:21.810217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780601+0000","last_change":"2023-10-08T16:07:27.780601+0000","last_active":"2023-10-08T16:07:27.780601+0000","last_peered":"2023-10-08T16:07:27.780601+0000","last_clean":"2023-10-08T16:07:27.780601+0000","last_became_active":"2023-10-08T16:07:27.779952+0000","last_became_peered":"2023-10-08T16:07:27.779952+0000","last_unstale":"2023-10-08T16:07:27.780601+0000","last_undegraded":"2023-10-08T16:07:27.780601+0000","last_fullsized":"2023-10-08T16:07:27.780601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:43.108054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796360+0000","last_change":"2023-10-08T16:07:26.782310+0000","last_active":"2023-10-08T16:07:27.796360+0000","last_peered":"2023-10-08T16:07:27.796360+0000","last_clean":"2023-10-08T16:07:27.796360+0000","last_became_active":"2023-10-08T16:07:26.781969+0000","last_became_peered":"2023-10-08T16:07:26.781969+0000","last_unstale":"2023-10-08T16:07:27.796360+0000","last_undegraded":"2023-10-08T16:07:27.796360+0000","last_fullsized":"2023-10-08T16:07:27.796360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:29.511105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775912+0000","last_change":"2023-10-08T16:07:27.775912+0000","last_active":"2023-10-08T16:07:27.775912+0000","last_peered":"2023-10-08T16:07:27.775912+0000","last_clean":"2023-10-08T16:07:27.775912+0000","last_became_active":"2023-10-08T16:07:27.775350+0000","last_became_peered":"2023-10-08T16:07:27.775350+0000","last_unstale":"2023-10-08T16:07:27.775912+0000","last_undegraded":"2023-10-08T16:07:27.775912+0000","last_fullsized":"2023-10-08T16:07:27.775912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.247360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.762261+0000","last_change":"2023-10-08T16:07:26.784235+0000","last_active":"2023-10-08T16:07:27.762261+0000","last_peered":"2023-10-08T16:07:27.762261+0000","last_clean":"2023-10-08T16:07:27.762261+0000","last_became_active":"2023-10-08T16:07:26.783929+0000","last_became_peered":"2023-10-08T16:07:26.783929+0000","last_unstale":"2023-10-08T16:07:27.762261+0000","last_undegraded":"2023-10-08T16:07:27.762261+0000","last_fullsized":"2023-10-08T16:07:27.762261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:55.748824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.795869+0000","last_change":"2023-10-08T16:07:27.795869+0000","last_active":"2023-10-08T16:07:27.795869+0000","last_peered":"2023-10-08T16:07:27.795869+0000","last_clean":"2023-10-08T16:07:27.795869+0000","last_became_active":"2023-10-08T16:07:27.795613+0000","last_became_peered":"2023-10-08T16:07:27.795613+0000","last_unstale":"2023-10-08T16:07:27.795869+0000","last_undegraded":"2023-10-08T16:07:27.795869+0000","last_fullsized":"2023-10-08T16:07:27.795869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:05.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.761030+0000","last_change":"2023-10-08T16:07:26.782025+0000","last_active":"2023-10-08T16:07:27.761030+0000","last_peered":"2023-10-08T16:07:27.761030+0000","last_clean":"2023-10-08T16:07:27.761030+0000","last_became_active":"2023-10-08T16:07:26.781738+0000","last_became_peered":"2023-10-08T16:07:26.781738+0000","last_unstale":"2023-10-08T16:07:27.761030+0000","last_undegraded":"2023-10-08T16:07:27.761030+0000","last_fullsized":"2023-10-08T16:07:27.761030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.766528+0000","last_change":"2023-10-08T16:07:27.766528+0000","last_active":"2023-10-08T16:07:27.766528+0000","last_peered":"2023-10-08T16:07:27.766528+0000","last_clean":"2023-10-08T16:07:27.766528+0000","last_became_active":"2023-10-08T16:07:27.766219+0000","last_became_peered":"2023-10-08T16:07:27.766219+0000","last_unstale":"2023-10-08T16:07:27.766528+0000","last_undegraded":"2023-10-08T16:07:27.766528+0000","last_fullsized":"2023-10-08T16:07:27.766528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.247360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788340+0000","last_change":"2023-10-08T16:07:26.782564+0000","last_active":"2023-10-08T16:07:26.788340+0000","last_peered":"2023-10-08T16:07:26.788340+0000","last_clean":"2023-10-08T16:07:26.788340+0000","last_became_active":"2023-10-08T16:07:26.782178+0000","last_became_peered":"2023-10-08T16:07:26.782178+0000","last_unstale":"2023-10-08T16:07:26.788340+0000","last_undegraded":"2023-10-08T16:07:26.788340+0000","last_fullsized":"2023-10-08T16:07:26.788340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:03.297389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783420+0000","last_change":"2023-10-08T16:07:27.783420+0000","last_active":"2023-10-08T16:07:27.783420+0000","last_peered":"2023-10-08T16:07:27.783420+0000","last_clean":"2023-10-08T16:07:27.783420+0000","last_became_active":"2023-10-08T16:07:27.783032+0000","last_became_peered":"2023-10-08T16:07:27.783032+0000","last_unstale":"2023-10-08T16:07:27.783420+0000","last_undegraded":"2023-10-08T16:07:27.783420+0000","last_fullsized":"2023-10-08T16:07:27.783420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:39.814779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790812+0000","last_change":"2023-10-08T16:07:26.783486+0000","last_active":"2023-10-08T16:07:26.790812+0000","last_peered":"2023-10-08T16:07:26.790812+0000","last_clean":"2023-10-08T16:07:26.790812+0000","last_became_active":"2023-10-08T16:07:26.783127+0000","last_became_peered":"2023-10-08T16:07:26.783127+0000","last_unstale":"2023-10-08T16:07:26.790812+0000","last_undegraded":"2023-10-08T16:07:26.790812+0000","last_fullsized":"2023-10-08T16:07:26.790812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:40.687394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.784347+0000","last_change":"2023-10-08T16:07:27.784347+0000","last_active":"2023-10-08T16:07:27.784347+0000","last_peered":"2023-10-08T16:07:27.784347+0000","last_clean":"2023-10-08T16:07:27.784347+0000","last_became_active":"2023-10-08T16:07:27.784077+0000","last_became_peered":"2023-10-08T16:07:27.784077+0000","last_unstale":"2023-10-08T16:07:27.784347+0000","last_undegraded":"2023-10-08T16:07:27.784347+0000","last_fullsized":"2023-10-08T16:07:27.784347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:36.494143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788488+0000","last_change":"2023-10-08T16:07:26.785547+0000","last_active":"2023-10-08T16:07:26.788488+0000","last_peered":"2023-10-08T16:07:26.788488+0000","last_clean":"2023-10-08T16:07:26.788488+0000","last_became_active":"2023-10-08T16:07:26.785266+0000","last_became_peered":"2023-10-08T16:07:26.785266+0000","last_unstale":"2023-10-08T16:07:26.788488+0000","last_undegraded":"2023-10-08T16:07:26.788488+0000","last_fullsized":"2023-10-08T16:07:26.788488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:58.129488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794758+0000","last_change":"2023-10-08T16:07:27.794758+0000","last_active":"2023-10-08T16:07:27.794758+0000","last_peered":"2023-10-08T16:07:27.794758+0000","last_clean":"2023-10-08T16:07:27.794758+0000","last_became_active":"2023-10-08T16:07:27.794393+0000","last_became_peered":"2023-10-08T16:07:27.794393+0000","last_unstale":"2023-10-08T16:07:27.794758+0000","last_undegraded":"2023-10-08T16:07:27.794758+0000","last_fullsized":"2023-10-08T16:07:27.794758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:25.883839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790112+0000","last_change":"2023-10-08T16:07:26.784619+0000","last_active":"2023-10-08T16:07:26.790112+0000","last_peered":"2023-10-08T16:07:26.790112+0000","last_clean":"2023-10-08T16:07:26.790112+0000","last_became_active":"2023-10-08T16:07:26.783649+0000","last_became_peered":"2023-10-08T16:07:26.783649+0000","last_unstale":"2023-10-08T16:07:26.790112+0000","last_undegraded":"2023-10-08T16:07:26.790112+0000","last_fullsized":"2023-10-08T16:07:26.790112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:29.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.781638+0000","last_change":"2023-10-08T16:07:27.781638+0000","last_active":"2023-10-08T16:07:27.781638+0000","last_peered":"2023-10-08T16:07:27.781638+0000","last_clean":"2023-10-08T16:07:27.781638+0000","last_became_active":"2023-10-08T16:07:27.781247+0000","last_became_peered":"2023-10-08T16:07:27.781247+0000","last_unstale":"2023-10-08T16:07:27.781638+0000","last_undegraded":"2023-10-08T16:07:27.781638+0000","last_fullsized":"2023-10-08T16:07:27.781638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:50.645501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796322+0000","last_change":"2023-10-08T16:07:26.788429+0000","last_active":"2023-10-08T16:07:27.796322+0000","last_peered":"2023-10-08T16:07:27.796322+0000","last_clean":"2023-10-08T16:07:27.796322+0000","last_became_active":"2023-10-08T16:07:26.788058+0000","last_became_peered":"2023-10-08T16:07:26.788058+0000","last_unstale":"2023-10-08T16:07:27.796322+0000","last_undegraded":"2023-10-08T16:07:27.796322+0000","last_fullsized":"2023-10-08T16:07:27.796322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:53.101512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.798901+0000","last_change":"2023-10-08T16:07:27.798901+0000","last_active":"2023-10-08T16:07:27.798901+0000","last_peered":"2023-10-08T16:07:27.798901+0000","last_clean":"2023-10-08T16:07:27.798901+0000","last_became_active":"2023-10-08T16:07:27.798643+0000","last_became_peered":"2023-10-08T16:07:27.798643+0000","last_unstale":"2023-10-08T16:07:27.798901+0000","last_undegraded":"2023-10-08T16:07:27.798901+0000","last_fullsized":"2023-10-08T16:07:27.798901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:01.101357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.801059+0000","last_change":"2023-10-08T16:07:26.785984+0000","last_active":"2023-10-08T16:07:27.801059+0000","last_peered":"2023-10-08T16:07:27.801059+0000","last_clean":"2023-10-08T16:07:27.801059+0000","last_became_active":"2023-10-08T16:07:26.785682+0000","last_became_peered":"2023-10-08T16:07:26.785682+0000","last_unstale":"2023-10-08T16:07:27.801059+0000","last_undegraded":"2023-10-08T16:07:27.801059+0000","last_fullsized":"2023-10-08T16:07:27.801059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:12.775072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783751+0000","last_change":"2023-10-08T16:07:27.783751+0000","last_active":"2023-10-08T16:07:27.783751+0000","last_peered":"2023-10-08T16:07:27.783751+0000","last_clean":"2023-10-08T16:07:27.783751+0000","last_became_active":"2023-10-08T16:07:27.782955+0000","last_became_peered":"2023-10-08T16:07:27.782955+0000","last_unstale":"2023-10-08T16:07:27.783751+0000","last_undegraded":"2023-10-08T16:07:27.783751+0000","last_fullsized":"2023-10-08T16:07:27.783751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.247360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.797020+0000","last_change":"2023-10-08T16:07:26.783468+0000","last_active":"2023-10-08T16:07:27.797020+0000","last_peered":"2023-10-08T16:07:27.797020+0000","last_clean":"2023-10-08T16:07:27.797020+0000","last_became_active":"2023-10-08T16:07:26.783004+0000","last_became_peered":"2023-10-08T16:07:26.783004+0000","last_unstale":"2023-10-08T16:07:27.797020+0000","last_undegraded":"2023-10-08T16:07:27.797020+0000","last_fullsized":"2023-10-08T16:07:27.797020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:11.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794357+0000","last_change":"2023-10-08T16:07:27.794357+0000","last_active":"2023-10-08T16:07:27.794357+0000","last_peered":"2023-10-08T16:07:27.794357+0000","last_clean":"2023-10-08T16:07:27.794357+0000","last_became_active":"2023-10-08T16:07:27.793947+0000","last_became_peered":"2023-10-08T16:07:27.793947+0000","last_unstale":"2023-10-08T16:07:27.794357+0000","last_undegraded":"2023-10-08T16:07:27.794357+0000","last_fullsized":"2023-10-08T16:07:27.794357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:37.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788056+0000","last_change":"2023-10-08T16:07:26.783374+0000","last_active":"2023-10-08T16:07:26.788056+0000","last_peered":"2023-10-08T16:07:26.788056+0000","last_clean":"2023-10-08T16:07:26.788056+0000","last_became_active":"2023-10-08T16:07:26.783076+0000","last_became_peered":"2023-10-08T16:07:26.783076+0000","last_unstale":"2023-10-08T16:07:26.788056+0000","last_undegraded":"2023-10-08T16:07:26.788056+0000","last_fullsized":"2023-10-08T16:07:26.788056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:29.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780301+0000","last_change":"2023-10-08T16:07:27.780301+0000","last_active":"2023-10-08T16:07:27.780301+0000","last_peered":"2023-10-08T16:07:27.780301+0000","last_clean":"2023-10-08T16:07:27.780301+0000","last_became_active":"2023-10-08T16:07:27.779810+0000","last_became_peered":"2023-10-08T16:07:27.779810+0000","last_unstale":"2023-10-08T16:07:27.780301+0000","last_undegraded":"2023-10-08T16:07:27.780301+0000","last_fullsized":"2023-10-08T16:07:27.780301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:11.282106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788428+0000","last_change":"2023-10-08T16:07:26.785192+0000","last_active":"2023-10-08T16:07:26.788428+0000","last_peered":"2023-10-08T16:07:26.788428+0000","last_clean":"2023-10-08T16:07:26.788428+0000","last_became_active":"2023-10-08T16:07:26.784844+0000","last_became_peered":"2023-10-08T16:07:26.784844+0000","last_unstale":"2023-10-08T16:07:26.788428+0000","last_undegraded":"2023-10-08T16:07:26.788428+0000","last_fullsized":"2023-10-08T16:07:26.788428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:31.539758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.769953+0000","last_change":"2023-10-08T16:07:27.769953+0000","last_active":"2023-10-08T16:07:27.769953+0000","last_peered":"2023-10-08T16:07:27.769953+0000","last_clean":"2023-10-08T16:07:27.769953+0000","last_became_active":"2023-10-08T16:07:27.769572+0000","last_became_peered":"2023-10-08T16:07:27.769572+0000","last_unstale":"2023-10-08T16:07:27.769953+0000","last_undegraded":"2023-10-08T16:07:27.769953+0000","last_fullsized":"2023-10-08T16:07:27.769953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:32.550591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.801313+0000","last_change":"2023-10-08T16:07:26.782207+0000","last_active":"2023-10-08T16:07:27.801313+0000","last_peered":"2023-10-08T16:07:27.801313+0000","last_clean":"2023-10-08T16:07:27.801313+0000","last_became_active":"2023-10-08T16:07:26.781887+0000","last_became_peered":"2023-10-08T16:07:26.781887+0000","last_unstale":"2023-10-08T16:07:27.801313+0000","last_undegraded":"2023-10-08T16:07:27.801313+0000","last_fullsized":"2023-10-08T16:07:27.801313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:42.097220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.784087+0000","last_change":"2023-10-08T16:07:27.784087+0000","last_active":"2023-10-08T16:07:27.784087+0000","last_peered":"2023-10-08T16:07:27.784087+0000","last_clean":"2023-10-08T16:07:27.784087+0000","last_became_active":"2023-10-08T16:07:27.783786+0000","last_became_peered":"2023-10-08T16:07:27.783786+0000","last_unstale":"2023-10-08T16:07:27.784087+0000","last_undegraded":"2023-10-08T16:07:27.784087+0000","last_fullsized":"2023-10-08T16:07:27.784087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:59.140322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.774145+0000","last_change":"2023-10-08T16:07:26.786084+0000","last_active":"2023-10-08T16:07:27.774145+0000","last_peered":"2023-10-08T16:07:27.774145+0000","last_clean":"2023-10-08T16:07:27.774145+0000","last_became_active":"2023-10-08T16:07:26.785764+0000","last_became_peered":"2023-10-08T16:07:26.785764+0000","last_unstale":"2023-10-08T16:07:27.774145+0000","last_undegraded":"2023-10-08T16:07:27.774145+0000","last_fullsized":"2023-10-08T16:07:27.774145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:16.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783476+0000","last_change":"2023-10-08T16:07:27.783476+0000","last_active":"2023-10-08T16:07:27.783476+0000","last_peered":"2023-10-08T16:07:27.783476+0000","last_clean":"2023-10-08T16:07:27.783476+0000","last_became_active":"2023-10-08T16:07:27.783151+0000","last_became_peered":"2023-10-08T16:07:27.783151+0000","last_unstale":"2023-10-08T16:07:27.783476+0000","last_undegraded":"2023-10-08T16:07:27.783476+0000","last_fullsized":"2023-10-08T16:07:27.783476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:52.325218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793377+0000","last_change":"2023-10-08T16:07:26.783748+0000","last_active":"2023-10-08T16:07:27.793377+0000","last_peered":"2023-10-08T16:07:27.793377+0000","last_clean":"2023-10-08T16:07:27.793377+0000","last_became_active":"2023-10-08T16:07:26.783405+0000","last_became_peered":"2023-10-08T16:07:26.783405+0000","last_unstale":"2023-10-08T16:07:27.793377+0000","last_undegraded":"2023-10-08T16:07:27.793377+0000","last_fullsized":"2023-10-08T16:07:27.793377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.705628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776669+0000","last_change":"2023-10-08T16:07:27.776669+0000","last_active":"2023-10-08T16:07:27.776669+0000","last_peered":"2023-10-08T16:07:27.776669+0000","last_clean":"2023-10-08T16:07:27.776669+0000","last_became_active":"2023-10-08T16:07:27.775975+0000","last_became_peered":"2023-10-08T16:07:27.775975+0000","last_unstale":"2023-10-08T16:07:27.776669+0000","last_undegraded":"2023-10-08T16:07:27.776669+0000","last_fullsized":"2023-10-08T16:07:27.776669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:32.470669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.760526+0000","last_change":"2023-10-08T16:07:26.784363+0000","last_active":"2023-10-08T16:07:27.760526+0000","last_peered":"2023-10-08T16:07:27.760526+0000","last_clean":"2023-10-08T16:07:27.760526+0000","last_became_active":"2023-10-08T16:07:26.784067+0000","last_became_peered":"2023-10-08T16:07:26.784067+0000","last_unstale":"2023-10-08T16:07:27.760526+0000","last_undegraded":"2023-10-08T16:07:27.760526+0000","last_fullsized":"2023-10-08T16:07:27.760526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:02.005376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.778500+0000","last_change":"2023-10-08T16:07:27.778500+0000","last_active":"2023-10-08T16:07:27.778500+0000","last_peered":"2023-10-08T16:07:27.778500+0000","last_clean":"2023-10-08T16:07:27.778500+0000","last_became_active":"2023-10-08T16:07:27.777822+0000","last_became_peered":"2023-10-08T16:07:27.777822+0000","last_unstale":"2023-10-08T16:07:27.778500+0000","last_undegraded":"2023-10-08T16:07:27.778500+0000","last_fullsized":"2023-10-08T16:07:27.778500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:26.627479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790878+0000","last_change":"2023-10-08T16:07:26.784213+0000","last_active":"2023-10-08T16:07:26.790878+0000","last_peered":"2023-10-08T16:07:26.790878+0000","last_clean":"2023-10-08T16:07:26.790878+0000","last_became_active":"2023-10-08T16:07:26.783886+0000","last_became_peered":"2023-10-08T16:07:26.783886+0000","last_unstale":"2023-10-08T16:07:26.790878+0000","last_undegraded":"2023-10-08T16:07:26.790878+0000","last_fullsized":"2023-10-08T16:07:26.790878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.778754+0000","last_change":"2023-10-08T16:07:27.778754+0000","last_active":"2023-10-08T16:07:27.778754+0000","last_peered":"2023-10-08T16:07:27.778754+0000","last_clean":"2023-10-08T16:07:27.778754+0000","last_became_active":"2023-10-08T16:07:27.778410+0000","last_became_peered":"2023-10-08T16:07:27.778410+0000","last_unstale":"2023-10-08T16:07:27.778754+0000","last_undegraded":"2023-10-08T16:07:27.778754+0000","last_fullsized":"2023-10-08T16:07:27.778754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:30.439656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796356+0000","last_change":"2023-10-08T16:07:26.778573+0000","last_active":"2023-10-08T16:07:27.796356+0000","last_peered":"2023-10-08T16:07:27.796356+0000","last_clean":"2023-10-08T16:07:27.796356+0000","last_became_active":"2023-10-08T16:07:26.775401+0000","last_became_peered":"2023-10-08T16:07:26.775401+0000","last_unstale":"2023-10-08T16:07:27.796356+0000","last_undegraded":"2023-10-08T16:07:27.796356+0000","last_fullsized":"2023-10-08T16:07:27.796356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793747+0000","last_change":"2023-10-08T16:07:27.793747+0000","last_active":"2023-10-08T16:07:27.793747+0000","last_peered":"2023-10-08T16:07:27.793747+0000","last_clean":"2023-10-08T16:07:27.793747+0000","last_became_active":"2023-10-08T16:07:27.793437+0000","last_became_peered":"2023-10-08T16:07:27.793437+0000","last_unstale":"2023-10-08T16:07:27.793747+0000","last_undegraded":"2023-10-08T16:07:27.793747+0000","last_fullsized":"2023-10-08T16:07:27.793747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:17.776964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.785794+0000","last_change":"2023-10-08T16:07:26.781584+0000","last_active":"2023-10-08T16:07:26.785794+0000","last_peered":"2023-10-08T16:07:26.785794+0000","last_clean":"2023-10-08T16:07:26.785794+0000","last_became_active":"2023-10-08T16:07:26.781232+0000","last_became_peered":"2023-10-08T16:07:26.781232+0000","last_unstale":"2023-10-08T16:07:26.785794+0000","last_undegraded":"2023-10-08T16:07:26.785794+0000","last_fullsized":"2023-10-08T16:07:26.785794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793891+0000","last_change":"2023-10-08T16:07:27.793891+0000","last_active":"2023-10-08T16:07:27.793891+0000","last_peered":"2023-10-08T16:07:27.793891+0000","last_clean":"2023-10-08T16:07:27.793891+0000","last_became_active":"2023-10-08T16:07:27.793576+0000","last_became_peered":"2023-10-08T16:07:27.793576+0000","last_unstale":"2023-10-08T16:07:27.793891+0000","last_undegraded":"2023-10-08T16:07:27.793891+0000","last_fullsized":"2023-10-08T16:07:27.793891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:12.363931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.787373+0000","last_change":"2023-10-08T16:07:26.779366+0000","last_active":"2023-10-08T16:07:26.787373+0000","last_peered":"2023-10-08T16:07:26.787373+0000","last_clean":"2023-10-08T16:07:26.787373+0000","last_became_active":"2023-10-08T16:07:26.779059+0000","last_became_peered":"2023-10-08T16:07:26.779059+0000","last_unstale":"2023-10-08T16:07:26.787373+0000","last_undegraded":"2023-10-08T16:07:26.787373+0000","last_fullsized":"2023-10-08T16:07:26.787373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:25.616646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.777641+0000","last_change":"2023-10-08T16:07:27.777641+0000","last_active":"2023-10-08T16:07:27.777641+0000","last_peered":"2023-10-08T16:07:27.777641+0000","last_clean":"2023-10-08T16:07:27.777641+0000","last_became_active":"2023-10-08T16:07:27.777293+0000","last_became_peered":"2023-10-08T16:07:27.777293+0000","last_unstale":"2023-10-08T16:07:27.777641+0000","last_undegraded":"2023-10-08T16:07:27.777641+0000","last_fullsized":"2023-10-08T16:07:27.777641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:01.101357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.791581+0000","last_change":"2023-10-08T16:07:26.788426+0000","last_active":"2023-10-08T16:07:26.791581+0000","last_peered":"2023-10-08T16:07:26.791581+0000","last_clean":"2023-10-08T16:07:26.791581+0000","last_became_active":"2023-10-08T16:07:26.788063+0000","last_became_peered":"2023-10-08T16:07:26.788063+0000","last_unstale":"2023-10-08T16:07:26.791581+0000","last_undegraded":"2023-10-08T16:07:26.791581+0000","last_fullsized":"2023-10-08T16:07:26.791581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:03.297389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783166+0000","last_change":"2023-10-08T16:07:27.783166+0000","last_active":"2023-10-08T16:07:27.783166+0000","last_peered":"2023-10-08T16:07:27.783166+0000","last_clean":"2023-10-08T16:07:27.783166+0000","last_became_active":"2023-10-08T16:07:27.782862+0000","last_became_peered":"2023-10-08T16:07:27.782862+0000","last_unstale":"2023-10-08T16:07:27.783166+0000","last_undegraded":"2023-10-08T16:07:27.783166+0000","last_fullsized":"2023-10-08T16:07:27.783166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:58.289218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796447+0000","last_change":"2023-10-08T16:07:26.783986+0000","last_active":"2023-10-08T16:07:27.796447+0000","last_peered":"2023-10-08T16:07:27.796447+0000","last_clean":"2023-10-08T16:07:27.796447+0000","last_became_active":"2023-10-08T16:07:26.783652+0000","last_became_peered":"2023-10-08T16:07:26.783652+0000","last_unstale":"2023-10-08T16:07:27.796447+0000","last_undegraded":"2023-10-08T16:07:27.796447+0000","last_fullsized":"2023-10-08T16:07:27.796447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:59.751866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793551+0000","last_change":"2023-10-08T16:07:27.793551+0000","last_active":"2023-10-08T16:07:27.793551+0000","last_peered":"2023-10-08T16:07:27.793551+0000","last_clean":"2023-10-08T16:07:27.793551+0000","last_became_active":"2023-10-08T16:07:27.793148+0000","last_became_peered":"2023-10-08T16:07:27.793148+0000","last_unstale":"2023-10-08T16:07:27.793551+0000","last_undegraded":"2023-10-08T16:07:27.793551+0000","last_fullsized":"2023-10-08T16:07:27.793551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:50.645501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.779607+0000","last_change":"2023-10-08T16:07:26.777873+0000","last_active":"2023-10-08T16:07:26.779607+0000","last_peered":"2023-10-08T16:07:26.779607+0000","last_clean":"2023-10-08T16:07:26.779607+0000","last_became_active":"2023-10-08T16:07:26.777573+0000","last_became_peered":"2023-10-08T16:07:26.777573+0000","last_unstale":"2023-10-08T16:07:26.779607+0000","last_undegraded":"2023-10-08T16:07:26.779607+0000","last_fullsized":"2023-10-08T16:07:26.779607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775457+0000","last_change":"2023-10-08T16:07:27.775457+0000","last_active":"2023-10-08T16:07:27.775457+0000","last_peered":"2023-10-08T16:07:27.775457+0000","last_clean":"2023-10-08T16:07:27.775457+0000","last_became_active":"2023-10-08T16:07:27.775143+0000","last_became_peered":"2023-10-08T16:07:27.775143+0000","last_unstale":"2023-10-08T16:07:27.775457+0000","last_undegraded":"2023-10-08T16:07:27.775457+0000","last_fullsized":"2023-10-08T16:07:27.775457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:04.308223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788168+0000","last_change":"2023-10-08T16:07:26.784454+0000","last_active":"2023-10-08T16:07:26.788168+0000","last_peered":"2023-10-08T16:07:26.788168+0000","last_clean":"2023-10-08T16:07:26.788168+0000","last_became_active":"2023-10-08T16:07:26.783983+0000","last_became_peered":"2023-10-08T16:07:26.783983+0000","last_unstale":"2023-10-08T16:07:26.788168+0000","last_undegraded":"2023-10-08T16:07:26.788168+0000","last_fullsized":"2023-10-08T16:07:26.788168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.788549+0000","last_change":"2023-10-08T16:07:27.788549+0000","last_active":"2023-10-08T16:07:27.788549+0000","last_peered":"2023-10-08T16:07:27.788549+0000","last_clean":"2023-10-08T16:07:27.788549+0000","last_became_active":"2023-10-08T16:07:27.788228+0000","last_became_peered":"2023-10-08T16:07:27.788228+0000","last_unstale":"2023-10-08T16:07:27.788549+0000","last_undegraded":"2023-10-08T16:07:27.788549+0000","last_fullsized":"2023-10-08T16:07:27.788549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:59.140322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.784734+0000","last_change":"2023-10-08T16:07:26.783372+0000","last_active":"2023-10-08T16:07:26.784734+0000","last_peered":"2023-10-08T16:07:26.784734+0000","last_clean":"2023-10-08T16:07:26.784734+0000","last_became_active":"2023-10-08T16:07:26.783063+0000","last_became_peered":"2023-10-08T16:07:26.783063+0000","last_unstale":"2023-10-08T16:07:26.784734+0000","last_undegraded":"2023-10-08T16:07:26.784734+0000","last_fullsized":"2023-10-08T16:07:26.784734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:59.751866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.767255+0000","last_change":"2023-10-08T16:07:27.767255+0000","last_active":"2023-10-08T16:07:27.767255+0000","last_peered":"2023-10-08T16:07:27.767255+0000","last_clean":"2023-10-08T16:07:27.767255+0000","last_became_active":"2023-10-08T16:07:27.766666+0000","last_became_peered":"2023-10-08T16:07:27.766666+0000","last_unstale":"2023-10-08T16:07:27.767255+0000","last_undegraded":"2023-10-08T16:07:27.767255+0000","last_fullsized":"2023-10-08T16:07:27.767255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:52.149646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788038+0000","last_change":"2023-10-08T16:07:26.783251+0000","last_active":"2023-10-08T16:07:26.788038+0000","last_peered":"2023-10-08T16:07:26.788038+0000","last_clean":"2023-10-08T16:07:26.788038+0000","last_became_active":"2023-10-08T16:07:26.781983+0000","last_became_peered":"2023-10-08T16:07:26.781983+0000","last_unstale":"2023-10-08T16:07:26.788038+0000","last_undegraded":"2023-10-08T16:07:26.788038+0000","last_fullsized":"2023-10-08T16:07:26.788038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796280+0000","last_change":"2023-10-08T16:07:27.796280+0000","last_active":"2023-10-08T16:07:27.796280+0000","last_peered":"2023-10-08T16:07:27.796280+0000","last_clean":"2023-10-08T16:07:27.796280+0000","last_became_active":"2023-10-08T16:07:27.796014+0000","last_became_peered":"2023-10-08T16:07:27.796014+0000","last_unstale":"2023-10-08T16:07:27.796280+0000","last_undegraded":"2023-10-08T16:07:27.796280+0000","last_fullsized":"2023-10-08T16:07:27.796280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:13.253535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.787392+0000","last_change":"2023-10-08T16:07:26.780512+0000","last_active":"2023-10-08T16:07:26.787392+0000","last_peered":"2023-10-08T16:07:26.787392+0000","last_clean":"2023-10-08T16:07:26.787392+0000","last_became_active":"2023-10-08T16:07:26.780204+0000","last_became_peered":"2023-10-08T16:07:26.780204+0000","last_unstale":"2023-10-08T16:07:26.787392+0000","last_undegraded":"2023-10-08T16:07:26.787392+0000","last_fullsized":"2023-10-08T16:07:26.787392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:59.751866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782232+0000","last_change":"2023-10-08T16:07:27.782232+0000","last_active":"2023-10-08T16:07:27.782232+0000","last_peered":"2023-10-08T16:07:27.782232+0000","last_clean":"2023-10-08T16:07:27.782232+0000","last_became_active":"2023-10-08T16:07:27.781862+0000","last_became_peered":"2023-10-08T16:07:27.781862+0000","last_unstale":"2023-10-08T16:07:27.782232+0000","last_undegraded":"2023-10-08T16:07:27.782232+0000","last_fullsized":"2023-10-08T16:07:27.782232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:32.470669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790235+0000","last_change":"2023-10-08T16:07:26.788086+0000","last_active":"2023-10-08T16:07:26.790235+0000","last_peered":"2023-10-08T16:07:26.790235+0000","last_clean":"2023-10-08T16:07:26.790235+0000","last_became_active":"2023-10-08T16:07:26.787694+0000","last_became_peered":"2023-10-08T16:07:26.787694+0000","last_unstale":"2023-10-08T16:07:26.790235+0000","last_undegraded":"2023-10-08T16:07:26.790235+0000","last_fullsized":"2023-10-08T16:07:26.790235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:51.138812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.779830+0000","last_change":"2023-10-08T16:07:27.779830+0000","last_active":"2023-10-08T16:07:27.779830+0000","last_peered":"2023-10-08T16:07:27.779830+0000","last_clean":"2023-10-08T16:07:27.779830+0000","last_became_active":"2023-10-08T16:07:27.779514+0000","last_became_peered":"2023-10-08T16:07:27.779514+0000","last_unstale":"2023-10-08T16:07:27.779830+0000","last_undegraded":"2023-10-08T16:07:27.779830+0000","last_fullsized":"2023-10-08T16:07:27.779830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:17.978845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.787729+0000","last_change":"2023-10-08T16:07:26.785249+0000","last_active":"2023-10-08T16:07:26.787729+0000","last_peered":"2023-10-08T16:07:26.787729+0000","last_clean":"2023-10-08T16:07:26.787729+0000","last_became_active":"2023-10-08T16:07:26.784993+0000","last_became_peered":"2023-10-08T16:07:26.784993+0000","last_unstale":"2023-10-08T16:07:26.787729+0000","last_undegraded":"2023-10-08T16:07:26.787729+0000","last_fullsized":"2023-10-08T16:07:26.787729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.778614+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:07:26.778614+0000","last_peered":"2023-10-08T16:07:26.778614+0000","last_clean":"2023-10-08T16:07:26.778614+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:07:26.778614+0000","last_undegraded":"2023-10-08T16:07:26.778614+0000","last_fullsized":"2023-10-08T16:07:26.778614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298196,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073644,"statfs":{"total":96636764160,"available":96331411456,"internally_reserved":0,"allocated":929792,"data_stored":716334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.119},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.1919999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.3160000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.999}]},{"osd":3,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.161},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.232}]},{"osd":4,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.71199999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.0740000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.282},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.89200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298196,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073644,"statfs":{"total":96636764160,"available":96331411456,"internally_reserved":0,"allocated":929792,"data_stored":716334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:07:30.790 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:07:30.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 Processor -- start 2023-10-08T16:07:30.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 -- start start 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9b8158b90 0x7ff9b8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b806a400 0x7ff9b806a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b80ca2d0 con 0x7ff9b80cad20 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b81594a0 con 0x7ff9b8158b90 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80ca890 con 0x7ff9b806a400 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b6d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff9b80cad20 0x7ff9b8067060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36580/0 (socket says 172.21.15.3:36580) 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b6d9d700 1 -- 172.21.15.3:0/4192575488 learned_addr learned my addr 172.21.15.3:0/4192575488 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b5d9b700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b806a400 0x7ff9b806a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b659c700 1 --2- 172.21.15.3:0/4192575488 >> v2:172.21.15.27:3300/0 conn(0x7ff9b8158b90 0x7ff9b8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b559a700 1 -- 172.21.15.3:0/4192575488 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264055199 0 0) 0x7ff9b80ca2d0 con 0x7ff9b80cad20 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b559a700 1 -- 172.21.15.3:0/4192575488 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a4003570 con 0x7ff9b80cad20 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b659c700 1 -- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b806a400 msgr2=0x7ff9b806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b659c700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b806a400 0x7ff9b806a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b659c700 1 -- 172.21.15.3:0/4192575488 >> v1:172.21.15.3:6789/0 conn(0x7ff9b80cad20 legacy=0x7ff9b8067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b659c700 1 -- 172.21.15.3:0/4192575488 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8159890 con 0x7ff9b8158b90 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b5d9b700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b806a400 0x7ff9b806a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b659c700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b8158b90 0x7ff9b8158f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d361c6cf2302ce26 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.894+0000 7ff9b559a700 1 -- 172.21.15.3:0/4192575488 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800e070 con 0x7ff9b8158b90 2023-10-08T16:07:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b559a700 1 -- 172.21.15.3:0/4192575488 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800bab0 con 0x7ff9b8158b90 2023-10-08T16:07:30.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b559a700 1 -- 172.21.15.3:0/4192575488 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800be50 con 0x7ff9b8158b90 2023-10-08T16:07:30.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 -- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b8158b90 msgr2=0x7ff9b8158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b8158b90 0x7ff9b8158f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8009780 comp rx=0 tx=0).stop 2023-10-08T16:07:30.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 -- 172.21.15.3:0/4192575488 shutdown_connections 2023-10-08T16:07:30.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b806a400 0x7ff9b806a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 --2- 172.21.15.3:0/4192575488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b8158b90 0x7ff9b8158f60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 -- 172.21.15.3:0/4192575488 >> 172.21.15.3:0/4192575488 conn(0x7ff9b80cfd30 msgr2=0x7ff9b80d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:30.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 -- 172.21.15.3:0/4192575488 shutdown_connections 2023-10-08T16:07:30.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.898+0000 7ff9b759e700 1 -- 172.21.15.3:0/4192575488 wait complete. 2023-10-08T16:07:30.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 Processor -- start 2023-10-08T16:07:30.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 -- start start 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b806a400 0x7ff9b80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b80cad20 0x7ff9b80b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 0x7ff9b814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c5650 con 0x7ff9b8158b90 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c49d0 con 0x7ff9b806a400 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c4cb0 con 0x7ff9b80cad20 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 0x7ff9b814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 0x7ff9b814a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54706/0 (socket says 172.21.15.3:54706) 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 -- 172.21.15.3:0/2408616222 learned_addr learned my addr 172.21.15.3:0/2408616222 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:30.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b5d9b700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b80cad20 0x7ff9b80b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b659c700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b806a400 0x7ff9b80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 -- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b80cad20 msgr2=0x7ff9b80b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b80cad20 0x7ff9b80b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 -- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b806a400 msgr2=0x7ff9b80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b806a400 0x7ff9b80c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 -- 172.21.15.3:0/2408616222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009420 con 0x7ff9b8158b90 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b659c700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b806a400 0x7ff9b80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:30.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b6d9d700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 0x7ff9b814a010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00010e0 tx=0x7ff9b0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0005c00 con 0x7ff9b8158b90 2023-10-08T16:07:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0005d60 con 0x7ff9b8158b90 2023-10-08T16:07:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00072e0 con 0x7ff9b8158b90 2023-10-08T16:07:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a8009a20 con 0x7ff9b8158b90 2023-10-08T16:07:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.902+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b80c5270 con 0x7ff9b8158b90 2023-10-08T16:07:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.906+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80c4720 con 0x7ff9b8158b90 2023-10-08T16:07:30.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.906+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff9b001b3b0 con 0x7ff9b8158b90 2023-10-08T16:07:30.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.906+0000 7ff9ae7fc700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff998060550 0x7ff998062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:30.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.906+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9b007bbe0 con 0x7ff9b8158b90 2023-10-08T16:07:30.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.906+0000 7ff9b659c700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff998060550 0x7ff998062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:30.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.906+0000 7ff9b659c700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff998060550 0x7ff998062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:30.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:30.918+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff9b004c280 con 0x7ff9b8158b90 2023-10-08T16:07:31.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.078+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9b804be40 con 0x7ff998060550 2023-10-08T16:07:31.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.094+0000 7ff9ae7fc700 1 -- 172.21.15.3:0/2408616222 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267306 (secure 0 0 0) 0x7ff9b804be40 con 0x7ff998060550 2023-10-08T16:07:31.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:31.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff998060550 msgr2=0x7ff998062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff998060550 0x7ff998062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8019000 comp rx=0 tx=0).stop 2023-10-08T16:07:31.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 msgr2=0x7ff9b814a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 0x7ff9b814a010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00010e0 tx=0x7ff9b0007dd0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 shutdown_connections 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff998060550 0x7ff998062a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b8158b90 0x7ff9b814a010 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff9b80cad20 0x7ff9b80b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 --2- 172.21.15.3:0/2408616222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9b806a400 0x7ff9b80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 >> 172.21.15.3:0/2408616222 conn(0x7ff9b80cfd30 msgr2=0x7ff9b8158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 shutdown_connections 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.098+0000 7ff9b759e700 1 -- 172.21.15.3:0/2408616222 wait complete. 2023-10-08T16:07:31.104 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:07:31.117 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-08T16:07:29.834396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382088,"kb_used_data":3784,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592632,"statfs":{"total":773094113280,"available":770654855168,"internally_reserved":0,"allocated":3874816,"data_stored":2188464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.088958"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783841+0000","last_change":"2023-10-08T16:07:27.783841+0000","last_active":"2023-10-08T16:07:27.783841+0000","last_peered":"2023-10-08T16:07:27.783841+0000","last_clean":"2023-10-08T16:07:27.783841+0000","last_became_active":"2023-10-08T16:07:27.783311+0000","last_became_peered":"2023-10-08T16:07:27.783311+0000","last_unstale":"2023-10-08T16:07:27.783841+0000","last_undegraded":"2023-10-08T16:07:27.783841+0000","last_fullsized":"2023-10-08T16:07:27.783841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:13.785905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.795396+0000","last_change":"2023-10-08T16:07:27.795396+0000","last_active":"2023-10-08T16:07:27.795396+0000","last_peered":"2023-10-08T16:07:27.795396+0000","last_clean":"2023-10-08T16:07:27.795396+0000","last_became_active":"2023-10-08T16:07:27.795157+0000","last_became_peered":"2023-10-08T16:07:27.795157+0000","last_unstale":"2023-10-08T16:07:27.795396+0000","last_undegraded":"2023-10-08T16:07:27.795396+0000","last_fullsized":"2023-10-08T16:07:27.795396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:52.207450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793313+0000","last_change":"2023-10-08T16:07:27.793313+0000","last_active":"2023-10-08T16:07:27.793313+0000","last_peered":"2023-10-08T16:07:27.793313+0000","last_clean":"2023-10-08T16:07:27.793313+0000","last_became_active":"2023-10-08T16:07:27.793020+0000","last_became_peered":"2023-10-08T16:07:27.793020+0000","last_unstale":"2023-10-08T16:07:27.793313+0000","last_undegraded":"2023-10-08T16:07:27.793313+0000","last_fullsized":"2023-10-08T16:07:27.793313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:41.522969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776881+0000","last_change":"2023-10-08T16:07:27.776881+0000","last_active":"2023-10-08T16:07:27.776881+0000","last_peered":"2023-10-08T16:07:27.776881+0000","last_clean":"2023-10-08T16:07:27.776881+0000","last_became_active":"2023-10-08T16:07:27.776353+0000","last_became_peered":"2023-10-08T16:07:27.776353+0000","last_unstale":"2023-10-08T16:07:27.776881+0000","last_undegraded":"2023-10-08T16:07:27.776881+0000","last_fullsized":"2023-10-08T16:07:27.776881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:26.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.781263+0000","last_change":"2023-10-08T16:07:27.781263+0000","last_active":"2023-10-08T16:07:27.781263+0000","last_peered":"2023-10-08T16:07:27.781263+0000","last_clean":"2023-10-08T16:07:27.781263+0000","last_became_active":"2023-10-08T16:07:27.780929+0000","last_became_peered":"2023-10-08T16:07:27.780929+0000","last_unstale":"2023-10-08T16:07:27.781263+0000","last_undegraded":"2023-10-08T16:07:27.781263+0000","last_fullsized":"2023-10-08T16:07:27.781263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:56.759657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.787560+0000","last_change":"2023-10-08T16:07:27.787560+0000","last_active":"2023-10-08T16:07:27.787560+0000","last_peered":"2023-10-08T16:07:27.787560+0000","last_clean":"2023-10-08T16:07:27.787560+0000","last_became_active":"2023-10-08T16:07:27.787273+0000","last_became_peered":"2023-10-08T16:07:27.787273+0000","last_unstale":"2023-10-08T16:07:27.787560+0000","last_undegraded":"2023-10-08T16:07:27.787560+0000","last_fullsized":"2023-10-08T16:07:27.787560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:10.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.777412+0000","last_change":"2023-10-08T16:07:27.777412+0000","last_active":"2023-10-08T16:07:27.777412+0000","last_peered":"2023-10-08T16:07:27.777412+0000","last_clean":"2023-10-08T16:07:27.777412+0000","last_became_active":"2023-10-08T16:07:27.776457+0000","last_became_peered":"2023-10-08T16:07:27.776457+0000","last_unstale":"2023-10-08T16:07:27.777412+0000","last_undegraded":"2023-10-08T16:07:27.777412+0000","last_fullsized":"2023-10-08T16:07:27.777412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:39.814779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780076+0000","last_change":"2023-10-08T16:07:27.780076+0000","last_active":"2023-10-08T16:07:27.780076+0000","last_peered":"2023-10-08T16:07:27.780076+0000","last_clean":"2023-10-08T16:07:27.780076+0000","last_became_active":"2023-10-08T16:07:27.779430+0000","last_became_peered":"2023-10-08T16:07:27.779430+0000","last_unstale":"2023-10-08T16:07:27.780076+0000","last_undegraded":"2023-10-08T16:07:27.780076+0000","last_fullsized":"2023-10-08T16:07:27.780076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:52.325218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.771504+0000","last_change":"2023-10-08T16:07:27.771504+0000","last_active":"2023-10-08T16:07:27.771504+0000","last_peered":"2023-10-08T16:07:27.771504+0000","last_clean":"2023-10-08T16:07:27.771504+0000","last_became_active":"2023-10-08T16:07:27.771126+0000","last_became_peered":"2023-10-08T16:07:27.771126+0000","last_unstale":"2023-10-08T16:07:27.771504+0000","last_undegraded":"2023-10-08T16:07:27.771504+0000","last_fullsized":"2023-10-08T16:07:27.771504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:31.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782211+0000","last_change":"2023-10-08T16:07:27.782211+0000","last_active":"2023-10-08T16:07:27.782211+0000","last_peered":"2023-10-08T16:07:27.782211+0000","last_clean":"2023-10-08T16:07:27.782211+0000","last_became_active":"2023-10-08T16:07:27.781905+0000","last_became_peered":"2023-10-08T16:07:27.781905+0000","last_unstale":"2023-10-08T16:07:27.782211+0000","last_undegraded":"2023-10-08T16:07:27.782211+0000","last_fullsized":"2023-10-08T16:07:27.782211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:17.978845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.792674+0000","last_change":"2023-10-08T16:07:27.792674+0000","last_active":"2023-10-08T16:07:27.792674+0000","last_peered":"2023-10-08T16:07:27.792674+0000","last_clean":"2023-10-08T16:07:27.792674+0000","last_became_active":"2023-10-08T16:07:27.792407+0000","last_became_peered":"2023-10-08T16:07:27.792407+0000","last_unstale":"2023-10-08T16:07:27.792674+0000","last_undegraded":"2023-10-08T16:07:27.792674+0000","last_fullsized":"2023-10-08T16:07:27.792674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:41.522969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.786175+0000","last_change":"2023-10-08T16:07:27.786175+0000","last_active":"2023-10-08T16:07:27.786175+0000","last_peered":"2023-10-08T16:07:27.786175+0000","last_clean":"2023-10-08T16:07:27.786175+0000","last_became_active":"2023-10-08T16:07:27.784486+0000","last_became_peered":"2023-10-08T16:07:27.784486+0000","last_unstale":"2023-10-08T16:07:27.786175+0000","last_undegraded":"2023-10-08T16:07:27.786175+0000","last_fullsized":"2023-10-08T16:07:27.786175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:52.207450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.773152+0000","last_change":"2023-10-08T16:07:27.773152+0000","last_active":"2023-10-08T16:07:27.773152+0000","last_peered":"2023-10-08T16:07:27.773152+0000","last_clean":"2023-10-08T16:07:27.773152+0000","last_became_active":"2023-10-08T16:07:27.772724+0000","last_became_peered":"2023-10-08T16:07:27.772724+0000","last_unstale":"2023-10-08T16:07:27.773152+0000","last_undegraded":"2023-10-08T16:07:27.773152+0000","last_fullsized":"2023-10-08T16:07:27.773152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:00.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.784884+0000","last_change":"2023-10-08T16:07:27.784884+0000","last_active":"2023-10-08T16:07:27.784884+0000","last_peered":"2023-10-08T16:07:27.784884+0000","last_clean":"2023-10-08T16:07:27.784884+0000","last_became_active":"2023-10-08T16:07:27.783087+0000","last_became_peered":"2023-10-08T16:07:27.783087+0000","last_unstale":"2023-10-08T16:07:27.784884+0000","last_undegraded":"2023-10-08T16:07:27.784884+0000","last_fullsized":"2023-10-08T16:07:27.784884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:36.494143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780811+0000","last_change":"2023-10-08T16:07:27.780811+0000","last_active":"2023-10-08T16:07:27.780811+0000","last_peered":"2023-10-08T16:07:27.780811+0000","last_clean":"2023-10-08T16:07:27.780811+0000","last_became_active":"2023-10-08T16:07:27.780408+0000","last_became_peered":"2023-10-08T16:07:27.780408+0000","last_unstale":"2023-10-08T16:07:27.780811+0000","last_undegraded":"2023-10-08T16:07:27.780811+0000","last_fullsized":"2023-10-08T16:07:27.780811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:17.978845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.778851+0000","last_change":"2023-10-08T16:07:27.778851+0000","last_active":"2023-10-08T16:07:27.778851+0000","last_peered":"2023-10-08T16:07:27.778851+0000","last_clean":"2023-10-08T16:07:27.778851+0000","last_became_active":"2023-10-08T16:07:27.778555+0000","last_became_peered":"2023-10-08T16:07:27.778555+0000","last_unstale":"2023-10-08T16:07:27.778851+0000","last_undegraded":"2023-10-08T16:07:27.778851+0000","last_fullsized":"2023-10-08T16:07:27.778851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:05.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.774971+0000","last_change":"2023-10-08T16:07:27.774971+0000","last_active":"2023-10-08T16:07:27.774971+0000","last_peered":"2023-10-08T16:07:27.774971+0000","last_clean":"2023-10-08T16:07:27.774971+0000","last_became_active":"2023-10-08T16:07:27.774628+0000","last_became_peered":"2023-10-08T16:07:27.774628+0000","last_unstale":"2023-10-08T16:07:27.774971+0000","last_undegraded":"2023-10-08T16:07:27.774971+0000","last_fullsized":"2023-10-08T16:07:27.774971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:31.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794854+0000","last_change":"2023-10-08T16:07:27.794854+0000","last_active":"2023-10-08T16:07:27.794854+0000","last_peered":"2023-10-08T16:07:27.794854+0000","last_clean":"2023-10-08T16:07:27.794854+0000","last_became_active":"2023-10-08T16:07:27.794540+0000","last_became_peered":"2023-10-08T16:07:27.794540+0000","last_unstale":"2023-10-08T16:07:27.794854+0000","last_undegraded":"2023-10-08T16:07:27.794854+0000","last_fullsized":"2023-10-08T16:07:27.794854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:46.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794142+0000","last_change":"2023-10-08T16:07:27.794142+0000","last_active":"2023-10-08T16:07:27.794142+0000","last_peered":"2023-10-08T16:07:27.794142+0000","last_clean":"2023-10-08T16:07:27.794142+0000","last_became_active":"2023-10-08T16:07:27.793817+0000","last_became_peered":"2023-10-08T16:07:27.793817+0000","last_unstale":"2023-10-08T16:07:27.794142+0000","last_undegraded":"2023-10-08T16:07:27.794142+0000","last_fullsized":"2023-10-08T16:07:27.794142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:22.221819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782612+0000","last_change":"2023-10-08T16:07:27.782612+0000","last_active":"2023-10-08T16:07:27.782612+0000","last_peered":"2023-10-08T16:07:27.782612+0000","last_clean":"2023-10-08T16:07:27.782612+0000","last_became_active":"2023-10-08T16:07:27.782255+0000","last_became_peered":"2023-10-08T16:07:27.782255+0000","last_unstale":"2023-10-08T16:07:27.782612+0000","last_undegraded":"2023-10-08T16:07:27.782612+0000","last_fullsized":"2023-10-08T16:07:27.782612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:02.675645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775150+0000","last_change":"2023-10-08T16:07:27.775150+0000","last_active":"2023-10-08T16:07:27.775150+0000","last_peered":"2023-10-08T16:07:27.775150+0000","last_clean":"2023-10-08T16:07:27.775150+0000","last_became_active":"2023-10-08T16:07:27.774846+0000","last_became_peered":"2023-10-08T16:07:27.774846+0000","last_unstale":"2023-10-08T16:07:27.775150+0000","last_undegraded":"2023-10-08T16:07:27.775150+0000","last_fullsized":"2023-10-08T16:07:27.775150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:26.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782275+0000","last_change":"2023-10-08T16:07:27.782275+0000","last_active":"2023-10-08T16:07:27.782275+0000","last_peered":"2023-10-08T16:07:27.782275+0000","last_clean":"2023-10-08T16:07:27.782275+0000","last_became_active":"2023-10-08T16:07:27.781943+0000","last_became_peered":"2023-10-08T16:07:27.781943+0000","last_unstale":"2023-10-08T16:07:27.782275+0000","last_undegraded":"2023-10-08T16:07:27.782275+0000","last_fullsized":"2023-10-08T16:07:27.782275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:43.108054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776312+0000","last_change":"2023-10-08T16:07:27.776312+0000","last_active":"2023-10-08T16:07:27.776312+0000","last_peered":"2023-10-08T16:07:27.776312+0000","last_clean":"2023-10-08T16:07:27.776312+0000","last_became_active":"2023-10-08T16:07:27.776032+0000","last_became_peered":"2023-10-08T16:07:27.776032+0000","last_unstale":"2023-10-08T16:07:27.776312+0000","last_undegraded":"2023-10-08T16:07:27.776312+0000","last_fullsized":"2023-10-08T16:07:27.776312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:32.550591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780600+0000","last_change":"2023-10-08T16:07:27.780600+0000","last_active":"2023-10-08T16:07:27.780600+0000","last_peered":"2023-10-08T16:07:27.780600+0000","last_clean":"2023-10-08T16:07:27.780600+0000","last_became_active":"2023-10-08T16:07:27.780307+0000","last_became_peered":"2023-10-08T16:07:27.780307+0000","last_unstale":"2023-10-08T16:07:27.780600+0000","last_undegraded":"2023-10-08T16:07:27.780600+0000","last_fullsized":"2023-10-08T16:07:27.780600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:11.282106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780290+0000","last_change":"2023-10-08T16:07:27.780290+0000","last_active":"2023-10-08T16:07:27.780290+0000","last_peered":"2023-10-08T16:07:27.780290+0000","last_clean":"2023-10-08T16:07:27.780290+0000","last_became_active":"2023-10-08T16:07:27.779680+0000","last_became_peered":"2023-10-08T16:07:27.779680+0000","last_unstale":"2023-10-08T16:07:27.780290+0000","last_undegraded":"2023-10-08T16:07:27.780290+0000","last_fullsized":"2023-10-08T16:07:27.780290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:01.101357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783153+0000","last_change":"2023-10-08T16:07:27.783153+0000","last_active":"2023-10-08T16:07:27.783153+0000","last_peered":"2023-10-08T16:07:27.783153+0000","last_clean":"2023-10-08T16:07:27.783153+0000","last_became_active":"2023-10-08T16:07:27.782782+0000","last_became_peered":"2023-10-08T16:07:27.782782+0000","last_unstale":"2023-10-08T16:07:27.783153+0000","last_undegraded":"2023-10-08T16:07:27.783153+0000","last_fullsized":"2023-10-08T16:07:27.783153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:38:22.189471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780370+0000","last_change":"2023-10-08T16:07:27.780370+0000","last_active":"2023-10-08T16:07:27.780370+0000","last_peered":"2023-10-08T16:07:27.780370+0000","last_clean":"2023-10-08T16:07:27.780370+0000","last_became_active":"2023-10-08T16:07:27.780068+0000","last_became_peered":"2023-10-08T16:07:27.780068+0000","last_unstale":"2023-10-08T16:07:27.780370+0000","last_undegraded":"2023-10-08T16:07:27.780370+0000","last_fullsized":"2023-10-08T16:07:27.780370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:31.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.795856+0000","last_change":"2023-10-08T16:07:27.795856+0000","last_active":"2023-10-08T16:07:27.795856+0000","last_peered":"2023-10-08T16:07:27.795856+0000","last_clean":"2023-10-08T16:07:27.795856+0000","last_became_active":"2023-10-08T16:07:27.795603+0000","last_became_peered":"2023-10-08T16:07:27.795603+0000","last_unstale":"2023-10-08T16:07:27.795856+0000","last_undegraded":"2023-10-08T16:07:27.795856+0000","last_fullsized":"2023-10-08T16:07:27.795856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:37.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783175+0000","last_change":"2023-10-08T16:07:27.783175+0000","last_active":"2023-10-08T16:07:27.783175+0000","last_peered":"2023-10-08T16:07:27.783175+0000","last_clean":"2023-10-08T16:07:27.783175+0000","last_became_active":"2023-10-08T16:07:27.782713+0000","last_became_peered":"2023-10-08T16:07:27.782713+0000","last_unstale":"2023-10-08T16:07:27.783175+0000","last_undegraded":"2023-10-08T16:07:27.783175+0000","last_fullsized":"2023-10-08T16:07:27.783175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:39.814779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775695+0000","last_change":"2023-10-08T16:07:27.775695+0000","last_active":"2023-10-08T16:07:27.775695+0000","last_peered":"2023-10-08T16:07:27.775695+0000","last_clean":"2023-10-08T16:07:27.775695+0000","last_became_active":"2023-10-08T16:07:27.775022+0000","last_became_peered":"2023-10-08T16:07:27.775022+0000","last_unstale":"2023-10-08T16:07:27.775695+0000","last_undegraded":"2023-10-08T16:07:27.775695+0000","last_fullsized":"2023-10-08T16:07:27.775695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:32.470669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.771465+0000","last_change":"2023-10-08T16:07:27.771465+0000","last_active":"2023-10-08T16:07:27.771465+0000","last_peered":"2023-10-08T16:07:27.771465+0000","last_clean":"2023-10-08T16:07:27.771465+0000","last_became_active":"2023-10-08T16:07:27.771194+0000","last_became_peered":"2023-10-08T16:07:27.771194+0000","last_unstale":"2023-10-08T16:07:27.771465+0000","last_undegraded":"2023-10-08T16:07:27.771465+0000","last_fullsized":"2023-10-08T16:07:27.771465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:22.821051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775675+0000","last_change":"2023-10-08T16:07:27.775675+0000","last_active":"2023-10-08T16:07:27.775675+0000","last_peered":"2023-10-08T16:07:27.775675+0000","last_clean":"2023-10-08T16:07:27.775675+0000","last_became_active":"2023-10-08T16:07:27.775334+0000","last_became_peered":"2023-10-08T16:07:27.775334+0000","last_unstale":"2023-10-08T16:07:27.775675+0000","last_undegraded":"2023-10-08T16:07:27.775675+0000","last_fullsized":"2023-10-08T16:07:27.775675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:37.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776979+0000","last_change":"2023-10-08T16:07:27.776979+0000","last_active":"2023-10-08T16:07:27.776979+0000","last_peered":"2023-10-08T16:07:27.776979+0000","last_clean":"2023-10-08T16:07:27.776979+0000","last_became_active":"2023-10-08T16:07:27.776659+0000","last_became_peered":"2023-10-08T16:07:27.776659+0000","last_unstale":"2023-10-08T16:07:27.776979+0000","last_undegraded":"2023-10-08T16:07:27.776979+0000","last_fullsized":"2023-10-08T16:07:27.776979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:59.140322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796370+0000","last_change":"2023-10-08T16:07:26.781384+0000","last_active":"2023-10-08T16:07:27.796370+0000","last_peered":"2023-10-08T16:07:27.796370+0000","last_clean":"2023-10-08T16:07:27.796370+0000","last_became_active":"2023-10-08T16:07:26.781118+0000","last_became_peered":"2023-10-08T16:07:26.781118+0000","last_unstale":"2023-10-08T16:07:27.796370+0000","last_undegraded":"2023-10-08T16:07:27.796370+0000","last_fullsized":"2023-10-08T16:07:27.796370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:55.748824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.769611+0000","last_change":"2023-10-08T16:07:27.769611+0000","last_active":"2023-10-08T16:07:27.769611+0000","last_peered":"2023-10-08T16:07:27.769611+0000","last_clean":"2023-10-08T16:07:27.769611+0000","last_became_active":"2023-10-08T16:07:27.769226+0000","last_became_peered":"2023-10-08T16:07:27.769226+0000","last_unstale":"2023-10-08T16:07:27.769611+0000","last_undegraded":"2023-10-08T16:07:27.769611+0000","last_fullsized":"2023-10-08T16:07:27.769611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:43.108054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.758901+0000","last_change":"2023-10-08T16:07:26.783289+0000","last_active":"2023-10-08T16:07:27.758901+0000","last_peered":"2023-10-08T16:07:27.758901+0000","last_clean":"2023-10-08T16:07:27.758901+0000","last_became_active":"2023-10-08T16:07:26.782974+0000","last_became_peered":"2023-10-08T16:07:26.782974+0000","last_unstale":"2023-10-08T16:07:27.758901+0000","last_undegraded":"2023-10-08T16:07:27.758901+0000","last_fullsized":"2023-10-08T16:07:27.758901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:55.748824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.787693+0000","last_change":"2023-10-08T16:07:27.787693+0000","last_active":"2023-10-08T16:07:27.787693+0000","last_peered":"2023-10-08T16:07:27.787693+0000","last_clean":"2023-10-08T16:07:27.787693+0000","last_became_active":"2023-10-08T16:07:27.787398+0000","last_became_peered":"2023-10-08T16:07:27.787398+0000","last_unstale":"2023-10-08T16:07:27.787693+0000","last_undegraded":"2023-10-08T16:07:27.787693+0000","last_fullsized":"2023-10-08T16:07:27.787693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:22.821051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.798823+0000","last_change":"2023-10-08T16:07:26.781510+0000","last_active":"2023-10-08T16:07:27.798823+0000","last_peered":"2023-10-08T16:07:27.798823+0000","last_clean":"2023-10-08T16:07:27.798823+0000","last_became_active":"2023-10-08T16:07:26.781198+0000","last_became_peered":"2023-10-08T16:07:26.781198+0000","last_unstale":"2023-10-08T16:07:27.798823+0000","last_undegraded":"2023-10-08T16:07:27.798823+0000","last_fullsized":"2023-10-08T16:07:27.798823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:21.810217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780601+0000","last_change":"2023-10-08T16:07:27.780601+0000","last_active":"2023-10-08T16:07:27.780601+0000","last_peered":"2023-10-08T16:07:27.780601+0000","last_clean":"2023-10-08T16:07:27.780601+0000","last_became_active":"2023-10-08T16:07:27.779952+0000","last_became_peered":"2023-10-08T16:07:27.779952+0000","last_unstale":"2023-10-08T16:07:27.780601+0000","last_undegraded":"2023-10-08T16:07:27.780601+0000","last_fullsized":"2023-10-08T16:07:27.780601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:43.108054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796360+0000","last_change":"2023-10-08T16:07:26.782310+0000","last_active":"2023-10-08T16:07:27.796360+0000","last_peered":"2023-10-08T16:07:27.796360+0000","last_clean":"2023-10-08T16:07:27.796360+0000","last_became_active":"2023-10-08T16:07:26.781969+0000","last_became_peered":"2023-10-08T16:07:26.781969+0000","last_unstale":"2023-10-08T16:07:27.796360+0000","last_undegraded":"2023-10-08T16:07:27.796360+0000","last_fullsized":"2023-10-08T16:07:27.796360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:29.511105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775912+0000","last_change":"2023-10-08T16:07:27.775912+0000","last_active":"2023-10-08T16:07:27.775912+0000","last_peered":"2023-10-08T16:07:27.775912+0000","last_clean":"2023-10-08T16:07:27.775912+0000","last_became_active":"2023-10-08T16:07:27.775350+0000","last_became_peered":"2023-10-08T16:07:27.775350+0000","last_unstale":"2023-10-08T16:07:27.775912+0000","last_undegraded":"2023-10-08T16:07:27.775912+0000","last_fullsized":"2023-10-08T16:07:27.775912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.247360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.762261+0000","last_change":"2023-10-08T16:07:26.784235+0000","last_active":"2023-10-08T16:07:27.762261+0000","last_peered":"2023-10-08T16:07:27.762261+0000","last_clean":"2023-10-08T16:07:27.762261+0000","last_became_active":"2023-10-08T16:07:26.783929+0000","last_became_peered":"2023-10-08T16:07:26.783929+0000","last_unstale":"2023-10-08T16:07:27.762261+0000","last_undegraded":"2023-10-08T16:07:27.762261+0000","last_fullsized":"2023-10-08T16:07:27.762261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:55.748824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.795869+0000","last_change":"2023-10-08T16:07:27.795869+0000","last_active":"2023-10-08T16:07:27.795869+0000","last_peered":"2023-10-08T16:07:27.795869+0000","last_clean":"2023-10-08T16:07:27.795869+0000","last_became_active":"2023-10-08T16:07:27.795613+0000","last_became_peered":"2023-10-08T16:07:27.795613+0000","last_unstale":"2023-10-08T16:07:27.795869+0000","last_undegraded":"2023-10-08T16:07:27.795869+0000","last_fullsized":"2023-10-08T16:07:27.795869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:05.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.761030+0000","last_change":"2023-10-08T16:07:26.782025+0000","last_active":"2023-10-08T16:07:27.761030+0000","last_peered":"2023-10-08T16:07:27.761030+0000","last_clean":"2023-10-08T16:07:27.761030+0000","last_became_active":"2023-10-08T16:07:26.781738+0000","last_became_peered":"2023-10-08T16:07:26.781738+0000","last_unstale":"2023-10-08T16:07:27.761030+0000","last_undegraded":"2023-10-08T16:07:27.761030+0000","last_fullsized":"2023-10-08T16:07:27.761030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.766528+0000","last_change":"2023-10-08T16:07:27.766528+0000","last_active":"2023-10-08T16:07:27.766528+0000","last_peered":"2023-10-08T16:07:27.766528+0000","last_clean":"2023-10-08T16:07:27.766528+0000","last_became_active":"2023-10-08T16:07:27.766219+0000","last_became_peered":"2023-10-08T16:07:27.766219+0000","last_unstale":"2023-10-08T16:07:27.766528+0000","last_undegraded":"2023-10-08T16:07:27.766528+0000","last_fullsized":"2023-10-08T16:07:27.766528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.247360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788340+0000","last_change":"2023-10-08T16:07:26.782564+0000","last_active":"2023-10-08T16:07:26.788340+0000","last_peered":"2023-10-08T16:07:26.788340+0000","last_clean":"2023-10-08T16:07:26.788340+0000","last_became_active":"2023-10-08T16:07:26.782178+0000","last_became_peered":"2023-10-08T16:07:26.782178+0000","last_unstale":"2023-10-08T16:07:26.788340+0000","last_undegraded":"2023-10-08T16:07:26.788340+0000","last_fullsized":"2023-10-08T16:07:26.788340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:03.297389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783420+0000","last_change":"2023-10-08T16:07:27.783420+0000","last_active":"2023-10-08T16:07:27.783420+0000","last_peered":"2023-10-08T16:07:27.783420+0000","last_clean":"2023-10-08T16:07:27.783420+0000","last_became_active":"2023-10-08T16:07:27.783032+0000","last_became_peered":"2023-10-08T16:07:27.783032+0000","last_unstale":"2023-10-08T16:07:27.783420+0000","last_undegraded":"2023-10-08T16:07:27.783420+0000","last_fullsized":"2023-10-08T16:07:27.783420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:39.814779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790812+0000","last_change":"2023-10-08T16:07:26.783486+0000","last_active":"2023-10-08T16:07:26.790812+0000","last_peered":"2023-10-08T16:07:26.790812+0000","last_clean":"2023-10-08T16:07:26.790812+0000","last_became_active":"2023-10-08T16:07:26.783127+0000","last_became_peered":"2023-10-08T16:07:26.783127+0000","last_unstale":"2023-10-08T16:07:26.790812+0000","last_undegraded":"2023-10-08T16:07:26.790812+0000","last_fullsized":"2023-10-08T16:07:26.790812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:40.687394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.784347+0000","last_change":"2023-10-08T16:07:27.784347+0000","last_active":"2023-10-08T16:07:27.784347+0000","last_peered":"2023-10-08T16:07:27.784347+0000","last_clean":"2023-10-08T16:07:27.784347+0000","last_became_active":"2023-10-08T16:07:27.784077+0000","last_became_peered":"2023-10-08T16:07:27.784077+0000","last_unstale":"2023-10-08T16:07:27.784347+0000","last_undegraded":"2023-10-08T16:07:27.784347+0000","last_fullsized":"2023-10-08T16:07:27.784347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:36.494143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788488+0000","last_change":"2023-10-08T16:07:26.785547+0000","last_active":"2023-10-08T16:07:26.788488+0000","last_peered":"2023-10-08T16:07:26.788488+0000","last_clean":"2023-10-08T16:07:26.788488+0000","last_became_active":"2023-10-08T16:07:26.785266+0000","last_became_peered":"2023-10-08T16:07:26.785266+0000","last_unstale":"2023-10-08T16:07:26.788488+0000","last_undegraded":"2023-10-08T16:07:26.788488+0000","last_fullsized":"2023-10-08T16:07:26.788488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:58.129488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794758+0000","last_change":"2023-10-08T16:07:27.794758+0000","last_active":"2023-10-08T16:07:27.794758+0000","last_peered":"2023-10-08T16:07:27.794758+0000","last_clean":"2023-10-08T16:07:27.794758+0000","last_became_active":"2023-10-08T16:07:27.794393+0000","last_became_peered":"2023-10-08T16:07:27.794393+0000","last_unstale":"2023-10-08T16:07:27.794758+0000","last_undegraded":"2023-10-08T16:07:27.794758+0000","last_fullsized":"2023-10-08T16:07:27.794758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:25.883839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790112+0000","last_change":"2023-10-08T16:07:26.784619+0000","last_active":"2023-10-08T16:07:26.790112+0000","last_peered":"2023-10-08T16:07:26.790112+0000","last_clean":"2023-10-08T16:07:26.790112+0000","last_became_active":"2023-10-08T16:07:26.783649+0000","last_became_peered":"2023-10-08T16:07:26.783649+0000","last_unstale":"2023-10-08T16:07:26.790112+0000","last_undegraded":"2023-10-08T16:07:26.790112+0000","last_fullsized":"2023-10-08T16:07:26.790112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:29.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.781638+0000","last_change":"2023-10-08T16:07:27.781638+0000","last_active":"2023-10-08T16:07:27.781638+0000","last_peered":"2023-10-08T16:07:27.781638+0000","last_clean":"2023-10-08T16:07:27.781638+0000","last_became_active":"2023-10-08T16:07:27.781247+0000","last_became_peered":"2023-10-08T16:07:27.781247+0000","last_unstale":"2023-10-08T16:07:27.781638+0000","last_undegraded":"2023-10-08T16:07:27.781638+0000","last_fullsized":"2023-10-08T16:07:27.781638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:50.645501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796322+0000","last_change":"2023-10-08T16:07:26.788429+0000","last_active":"2023-10-08T16:07:27.796322+0000","last_peered":"2023-10-08T16:07:27.796322+0000","last_clean":"2023-10-08T16:07:27.796322+0000","last_became_active":"2023-10-08T16:07:26.788058+0000","last_became_peered":"2023-10-08T16:07:26.788058+0000","last_unstale":"2023-10-08T16:07:27.796322+0000","last_undegraded":"2023-10-08T16:07:27.796322+0000","last_fullsized":"2023-10-08T16:07:27.796322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:53.101512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.798901+0000","last_change":"2023-10-08T16:07:27.798901+0000","last_active":"2023-10-08T16:07:27.798901+0000","last_peered":"2023-10-08T16:07:27.798901+0000","last_clean":"2023-10-08T16:07:27.798901+0000","last_became_active":"2023-10-08T16:07:27.798643+0000","last_became_peered":"2023-10-08T16:07:27.798643+0000","last_unstale":"2023-10-08T16:07:27.798901+0000","last_undegraded":"2023-10-08T16:07:27.798901+0000","last_fullsized":"2023-10-08T16:07:27.798901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:01.101357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.801059+0000","last_change":"2023-10-08T16:07:26.785984+0000","last_active":"2023-10-08T16:07:27.801059+0000","last_peered":"2023-10-08T16:07:27.801059+0000","last_clean":"2023-10-08T16:07:27.801059+0000","last_became_active":"2023-10-08T16:07:26.785682+0000","last_became_peered":"2023-10-08T16:07:26.785682+0000","last_unstale":"2023-10-08T16:07:27.801059+0000","last_undegraded":"2023-10-08T16:07:27.801059+0000","last_fullsized":"2023-10-08T16:07:27.801059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:12.775072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783751+0000","last_change":"2023-10-08T16:07:27.783751+0000","last_active":"2023-10-08T16:07:27.783751+0000","last_peered":"2023-10-08T16:07:27.783751+0000","last_clean":"2023-10-08T16:07:27.783751+0000","last_became_active":"2023-10-08T16:07:27.782955+0000","last_became_peered":"2023-10-08T16:07:27.782955+0000","last_unstale":"2023-10-08T16:07:27.783751+0000","last_undegraded":"2023-10-08T16:07:27.783751+0000","last_fullsized":"2023-10-08T16:07:27.783751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.247360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.797020+0000","last_change":"2023-10-08T16:07:26.783468+0000","last_active":"2023-10-08T16:07:27.797020+0000","last_peered":"2023-10-08T16:07:27.797020+0000","last_clean":"2023-10-08T16:07:27.797020+0000","last_became_active":"2023-10-08T16:07:26.783004+0000","last_became_peered":"2023-10-08T16:07:26.783004+0000","last_unstale":"2023-10-08T16:07:27.797020+0000","last_undegraded":"2023-10-08T16:07:27.797020+0000","last_fullsized":"2023-10-08T16:07:27.797020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:11.353098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.794357+0000","last_change":"2023-10-08T16:07:27.794357+0000","last_active":"2023-10-08T16:07:27.794357+0000","last_peered":"2023-10-08T16:07:27.794357+0000","last_clean":"2023-10-08T16:07:27.794357+0000","last_became_active":"2023-10-08T16:07:27.793947+0000","last_became_peered":"2023-10-08T16:07:27.793947+0000","last_unstale":"2023-10-08T16:07:27.794357+0000","last_undegraded":"2023-10-08T16:07:27.794357+0000","last_fullsized":"2023-10-08T16:07:27.794357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:37.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788056+0000","last_change":"2023-10-08T16:07:26.783374+0000","last_active":"2023-10-08T16:07:26.788056+0000","last_peered":"2023-10-08T16:07:26.788056+0000","last_clean":"2023-10-08T16:07:26.788056+0000","last_became_active":"2023-10-08T16:07:26.783076+0000","last_became_peered":"2023-10-08T16:07:26.783076+0000","last_unstale":"2023-10-08T16:07:26.788056+0000","last_undegraded":"2023-10-08T16:07:26.788056+0000","last_fullsized":"2023-10-08T16:07:26.788056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:29.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.780301+0000","last_change":"2023-10-08T16:07:27.780301+0000","last_active":"2023-10-08T16:07:27.780301+0000","last_peered":"2023-10-08T16:07:27.780301+0000","last_clean":"2023-10-08T16:07:27.780301+0000","last_became_active":"2023-10-08T16:07:27.779810+0000","last_became_peered":"2023-10-08T16:07:27.779810+0000","last_unstale":"2023-10-08T16:07:27.780301+0000","last_undegraded":"2023-10-08T16:07:27.780301+0000","last_fullsized":"2023-10-08T16:07:27.780301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:11.282106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788428+0000","last_change":"2023-10-08T16:07:26.785192+0000","last_active":"2023-10-08T16:07:26.788428+0000","last_peered":"2023-10-08T16:07:26.788428+0000","last_clean":"2023-10-08T16:07:26.788428+0000","last_became_active":"2023-10-08T16:07:26.784844+0000","last_became_peered":"2023-10-08T16:07:26.784844+0000","last_unstale":"2023-10-08T16:07:26.788428+0000","last_undegraded":"2023-10-08T16:07:26.788428+0000","last_fullsized":"2023-10-08T16:07:26.788428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:31.539758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.769953+0000","last_change":"2023-10-08T16:07:27.769953+0000","last_active":"2023-10-08T16:07:27.769953+0000","last_peered":"2023-10-08T16:07:27.769953+0000","last_clean":"2023-10-08T16:07:27.769953+0000","last_became_active":"2023-10-08T16:07:27.769572+0000","last_became_peered":"2023-10-08T16:07:27.769572+0000","last_unstale":"2023-10-08T16:07:27.769953+0000","last_undegraded":"2023-10-08T16:07:27.769953+0000","last_fullsized":"2023-10-08T16:07:27.769953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:32.550591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.801313+0000","last_change":"2023-10-08T16:07:26.782207+0000","last_active":"2023-10-08T16:07:27.801313+0000","last_peered":"2023-10-08T16:07:27.801313+0000","last_clean":"2023-10-08T16:07:27.801313+0000","last_became_active":"2023-10-08T16:07:26.781887+0000","last_became_peered":"2023-10-08T16:07:26.781887+0000","last_unstale":"2023-10-08T16:07:27.801313+0000","last_undegraded":"2023-10-08T16:07:27.801313+0000","last_fullsized":"2023-10-08T16:07:27.801313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:42.097220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.784087+0000","last_change":"2023-10-08T16:07:27.784087+0000","last_active":"2023-10-08T16:07:27.784087+0000","last_peered":"2023-10-08T16:07:27.784087+0000","last_clean":"2023-10-08T16:07:27.784087+0000","last_became_active":"2023-10-08T16:07:27.783786+0000","last_became_peered":"2023-10-08T16:07:27.783786+0000","last_unstale":"2023-10-08T16:07:27.784087+0000","last_undegraded":"2023-10-08T16:07:27.784087+0000","last_fullsized":"2023-10-08T16:07:27.784087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:59.140322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.774145+0000","last_change":"2023-10-08T16:07:26.786084+0000","last_active":"2023-10-08T16:07:27.774145+0000","last_peered":"2023-10-08T16:07:27.774145+0000","last_clean":"2023-10-08T16:07:27.774145+0000","last_became_active":"2023-10-08T16:07:26.785764+0000","last_became_peered":"2023-10-08T16:07:26.785764+0000","last_unstale":"2023-10-08T16:07:27.774145+0000","last_undegraded":"2023-10-08T16:07:27.774145+0000","last_fullsized":"2023-10-08T16:07:27.774145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:16.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783476+0000","last_change":"2023-10-08T16:07:27.783476+0000","last_active":"2023-10-08T16:07:27.783476+0000","last_peered":"2023-10-08T16:07:27.783476+0000","last_clean":"2023-10-08T16:07:27.783476+0000","last_became_active":"2023-10-08T16:07:27.783151+0000","last_became_peered":"2023-10-08T16:07:27.783151+0000","last_unstale":"2023-10-08T16:07:27.783476+0000","last_undegraded":"2023-10-08T16:07:27.783476+0000","last_fullsized":"2023-10-08T16:07:27.783476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:52.325218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793377+0000","last_change":"2023-10-08T16:07:26.783748+0000","last_active":"2023-10-08T16:07:27.793377+0000","last_peered":"2023-10-08T16:07:27.793377+0000","last_clean":"2023-10-08T16:07:27.793377+0000","last_became_active":"2023-10-08T16:07:26.783405+0000","last_became_peered":"2023-10-08T16:07:26.783405+0000","last_unstale":"2023-10-08T16:07:27.793377+0000","last_undegraded":"2023-10-08T16:07:27.793377+0000","last_fullsized":"2023-10-08T16:07:27.793377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:20.705628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.776669+0000","last_change":"2023-10-08T16:07:27.776669+0000","last_active":"2023-10-08T16:07:27.776669+0000","last_peered":"2023-10-08T16:07:27.776669+0000","last_clean":"2023-10-08T16:07:27.776669+0000","last_became_active":"2023-10-08T16:07:27.775975+0000","last_became_peered":"2023-10-08T16:07:27.775975+0000","last_unstale":"2023-10-08T16:07:27.776669+0000","last_undegraded":"2023-10-08T16:07:27.776669+0000","last_fullsized":"2023-10-08T16:07:27.776669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:32.470669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.760526+0000","last_change":"2023-10-08T16:07:26.784363+0000","last_active":"2023-10-08T16:07:27.760526+0000","last_peered":"2023-10-08T16:07:27.760526+0000","last_clean":"2023-10-08T16:07:27.760526+0000","last_became_active":"2023-10-08T16:07:26.784067+0000","last_became_peered":"2023-10-08T16:07:26.784067+0000","last_unstale":"2023-10-08T16:07:27.760526+0000","last_undegraded":"2023-10-08T16:07:27.760526+0000","last_fullsized":"2023-10-08T16:07:27.760526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:02.005376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.778500+0000","last_change":"2023-10-08T16:07:27.778500+0000","last_active":"2023-10-08T16:07:27.778500+0000","last_peered":"2023-10-08T16:07:27.778500+0000","last_clean":"2023-10-08T16:07:27.778500+0000","last_became_active":"2023-10-08T16:07:27.777822+0000","last_became_peered":"2023-10-08T16:07:27.777822+0000","last_unstale":"2023-10-08T16:07:27.778500+0000","last_undegraded":"2023-10-08T16:07:27.778500+0000","last_fullsized":"2023-10-08T16:07:27.778500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:26.627479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790878+0000","last_change":"2023-10-08T16:07:26.784213+0000","last_active":"2023-10-08T16:07:26.790878+0000","last_peered":"2023-10-08T16:07:26.790878+0000","last_clean":"2023-10-08T16:07:26.790878+0000","last_became_active":"2023-10-08T16:07:26.783886+0000","last_became_peered":"2023-10-08T16:07:26.783886+0000","last_unstale":"2023-10-08T16:07:26.790878+0000","last_undegraded":"2023-10-08T16:07:26.790878+0000","last_fullsized":"2023-10-08T16:07:26.790878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.778754+0000","last_change":"2023-10-08T16:07:27.778754+0000","last_active":"2023-10-08T16:07:27.778754+0000","last_peered":"2023-10-08T16:07:27.778754+0000","last_clean":"2023-10-08T16:07:27.778754+0000","last_became_active":"2023-10-08T16:07:27.778410+0000","last_became_peered":"2023-10-08T16:07:27.778410+0000","last_unstale":"2023-10-08T16:07:27.778754+0000","last_undegraded":"2023-10-08T16:07:27.778754+0000","last_fullsized":"2023-10-08T16:07:27.778754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:30.439656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796356+0000","last_change":"2023-10-08T16:07:26.778573+0000","last_active":"2023-10-08T16:07:27.796356+0000","last_peered":"2023-10-08T16:07:27.796356+0000","last_clean":"2023-10-08T16:07:27.796356+0000","last_became_active":"2023-10-08T16:07:26.775401+0000","last_became_peered":"2023-10-08T16:07:26.775401+0000","last_unstale":"2023-10-08T16:07:27.796356+0000","last_undegraded":"2023-10-08T16:07:27.796356+0000","last_fullsized":"2023-10-08T16:07:27.796356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793747+0000","last_change":"2023-10-08T16:07:27.793747+0000","last_active":"2023-10-08T16:07:27.793747+0000","last_peered":"2023-10-08T16:07:27.793747+0000","last_clean":"2023-10-08T16:07:27.793747+0000","last_became_active":"2023-10-08T16:07:27.793437+0000","last_became_peered":"2023-10-08T16:07:27.793437+0000","last_unstale":"2023-10-08T16:07:27.793747+0000","last_undegraded":"2023-10-08T16:07:27.793747+0000","last_fullsized":"2023-10-08T16:07:27.793747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:17.776964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.785794+0000","last_change":"2023-10-08T16:07:26.781584+0000","last_active":"2023-10-08T16:07:26.785794+0000","last_peered":"2023-10-08T16:07:26.785794+0000","last_clean":"2023-10-08T16:07:26.785794+0000","last_became_active":"2023-10-08T16:07:26.781232+0000","last_became_peered":"2023-10-08T16:07:26.781232+0000","last_unstale":"2023-10-08T16:07:26.785794+0000","last_undegraded":"2023-10-08T16:07:26.785794+0000","last_fullsized":"2023-10-08T16:07:26.785794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793891+0000","last_change":"2023-10-08T16:07:27.793891+0000","last_active":"2023-10-08T16:07:27.793891+0000","last_peered":"2023-10-08T16:07:27.793891+0000","last_clean":"2023-10-08T16:07:27.793891+0000","last_became_active":"2023-10-08T16:07:27.793576+0000","last_became_peered":"2023-10-08T16:07:27.793576+0000","last_unstale":"2023-10-08T16:07:27.793891+0000","last_undegraded":"2023-10-08T16:07:27.793891+0000","last_fullsized":"2023-10-08T16:07:27.793891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:12.363931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.787373+0000","last_change":"2023-10-08T16:07:26.779366+0000","last_active":"2023-10-08T16:07:26.787373+0000","last_peered":"2023-10-08T16:07:26.787373+0000","last_clean":"2023-10-08T16:07:26.787373+0000","last_became_active":"2023-10-08T16:07:26.779059+0000","last_became_peered":"2023-10-08T16:07:26.779059+0000","last_unstale":"2023-10-08T16:07:26.787373+0000","last_undegraded":"2023-10-08T16:07:26.787373+0000","last_fullsized":"2023-10-08T16:07:26.787373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:25.616646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.777641+0000","last_change":"2023-10-08T16:07:27.777641+0000","last_active":"2023-10-08T16:07:27.777641+0000","last_peered":"2023-10-08T16:07:27.777641+0000","last_clean":"2023-10-08T16:07:27.777641+0000","last_became_active":"2023-10-08T16:07:27.777293+0000","last_became_peered":"2023-10-08T16:07:27.777293+0000","last_unstale":"2023-10-08T16:07:27.777641+0000","last_undegraded":"2023-10-08T16:07:27.777641+0000","last_fullsized":"2023-10-08T16:07:27.777641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:01.101357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.791581+0000","last_change":"2023-10-08T16:07:26.788426+0000","last_active":"2023-10-08T16:07:26.791581+0000","last_peered":"2023-10-08T16:07:26.791581+0000","last_clean":"2023-10-08T16:07:26.791581+0000","last_became_active":"2023-10-08T16:07:26.788063+0000","last_became_peered":"2023-10-08T16:07:26.788063+0000","last_unstale":"2023-10-08T16:07:26.791581+0000","last_undegraded":"2023-10-08T16:07:26.791581+0000","last_fullsized":"2023-10-08T16:07:26.791581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:03.297389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.783166+0000","last_change":"2023-10-08T16:07:27.783166+0000","last_active":"2023-10-08T16:07:27.783166+0000","last_peered":"2023-10-08T16:07:27.783166+0000","last_clean":"2023-10-08T16:07:27.783166+0000","last_became_active":"2023-10-08T16:07:27.782862+0000","last_became_peered":"2023-10-08T16:07:27.782862+0000","last_unstale":"2023-10-08T16:07:27.783166+0000","last_undegraded":"2023-10-08T16:07:27.783166+0000","last_fullsized":"2023-10-08T16:07:27.783166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:58.289218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796447+0000","last_change":"2023-10-08T16:07:26.783986+0000","last_active":"2023-10-08T16:07:27.796447+0000","last_peered":"2023-10-08T16:07:27.796447+0000","last_clean":"2023-10-08T16:07:27.796447+0000","last_became_active":"2023-10-08T16:07:26.783652+0000","last_became_peered":"2023-10-08T16:07:26.783652+0000","last_unstale":"2023-10-08T16:07:27.796447+0000","last_undegraded":"2023-10-08T16:07:27.796447+0000","last_fullsized":"2023-10-08T16:07:27.796447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:59.751866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.793551+0000","last_change":"2023-10-08T16:07:27.793551+0000","last_active":"2023-10-08T16:07:27.793551+0000","last_peered":"2023-10-08T16:07:27.793551+0000","last_clean":"2023-10-08T16:07:27.793551+0000","last_became_active":"2023-10-08T16:07:27.793148+0000","last_became_peered":"2023-10-08T16:07:27.793148+0000","last_unstale":"2023-10-08T16:07:27.793551+0000","last_undegraded":"2023-10-08T16:07:27.793551+0000","last_fullsized":"2023-10-08T16:07:27.793551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:50.645501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.779607+0000","last_change":"2023-10-08T16:07:26.777873+0000","last_active":"2023-10-08T16:07:26.779607+0000","last_peered":"2023-10-08T16:07:26.779607+0000","last_clean":"2023-10-08T16:07:26.779607+0000","last_became_active":"2023-10-08T16:07:26.777573+0000","last_became_peered":"2023-10-08T16:07:26.777573+0000","last_unstale":"2023-10-08T16:07:26.779607+0000","last_undegraded":"2023-10-08T16:07:26.779607+0000","last_fullsized":"2023-10-08T16:07:26.779607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.775457+0000","last_change":"2023-10-08T16:07:27.775457+0000","last_active":"2023-10-08T16:07:27.775457+0000","last_peered":"2023-10-08T16:07:27.775457+0000","last_clean":"2023-10-08T16:07:27.775457+0000","last_became_active":"2023-10-08T16:07:27.775143+0000","last_became_peered":"2023-10-08T16:07:27.775143+0000","last_unstale":"2023-10-08T16:07:27.775457+0000","last_undegraded":"2023-10-08T16:07:27.775457+0000","last_fullsized":"2023-10-08T16:07:27.775457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:04.308223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788168+0000","last_change":"2023-10-08T16:07:26.784454+0000","last_active":"2023-10-08T16:07:26.788168+0000","last_peered":"2023-10-08T16:07:26.788168+0000","last_clean":"2023-10-08T16:07:26.788168+0000","last_became_active":"2023-10-08T16:07:26.783983+0000","last_became_peered":"2023-10-08T16:07:26.783983+0000","last_unstale":"2023-10-08T16:07:26.788168+0000","last_undegraded":"2023-10-08T16:07:26.788168+0000","last_fullsized":"2023-10-08T16:07:26.788168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:01.664811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.788549+0000","last_change":"2023-10-08T16:07:27.788549+0000","last_active":"2023-10-08T16:07:27.788549+0000","last_peered":"2023-10-08T16:07:27.788549+0000","last_clean":"2023-10-08T16:07:27.788549+0000","last_became_active":"2023-10-08T16:07:27.788228+0000","last_became_peered":"2023-10-08T16:07:27.788228+0000","last_unstale":"2023-10-08T16:07:27.788549+0000","last_undegraded":"2023-10-08T16:07:27.788549+0000","last_fullsized":"2023-10-08T16:07:27.788549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:59.140322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.784734+0000","last_change":"2023-10-08T16:07:26.783372+0000","last_active":"2023-10-08T16:07:26.784734+0000","last_peered":"2023-10-08T16:07:26.784734+0000","last_clean":"2023-10-08T16:07:26.784734+0000","last_became_active":"2023-10-08T16:07:26.783063+0000","last_became_peered":"2023-10-08T16:07:26.783063+0000","last_unstale":"2023-10-08T16:07:26.784734+0000","last_undegraded":"2023-10-08T16:07:26.784734+0000","last_fullsized":"2023-10-08T16:07:26.784734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:59.751866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.767255+0000","last_change":"2023-10-08T16:07:27.767255+0000","last_active":"2023-10-08T16:07:27.767255+0000","last_peered":"2023-10-08T16:07:27.767255+0000","last_clean":"2023-10-08T16:07:27.767255+0000","last_became_active":"2023-10-08T16:07:27.766666+0000","last_became_peered":"2023-10-08T16:07:27.766666+0000","last_unstale":"2023-10-08T16:07:27.767255+0000","last_undegraded":"2023-10-08T16:07:27.767255+0000","last_fullsized":"2023-10-08T16:07:27.767255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:52.149646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.788038+0000","last_change":"2023-10-08T16:07:26.783251+0000","last_active":"2023-10-08T16:07:26.788038+0000","last_peered":"2023-10-08T16:07:26.788038+0000","last_clean":"2023-10-08T16:07:26.788038+0000","last_became_active":"2023-10-08T16:07:26.781983+0000","last_became_peered":"2023-10-08T16:07:26.781983+0000","last_unstale":"2023-10-08T16:07:26.788038+0000","last_undegraded":"2023-10-08T16:07:26.788038+0000","last_fullsized":"2023-10-08T16:07:26.788038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.796280+0000","last_change":"2023-10-08T16:07:27.796280+0000","last_active":"2023-10-08T16:07:27.796280+0000","last_peered":"2023-10-08T16:07:27.796280+0000","last_clean":"2023-10-08T16:07:27.796280+0000","last_became_active":"2023-10-08T16:07:27.796014+0000","last_became_peered":"2023-10-08T16:07:27.796014+0000","last_unstale":"2023-10-08T16:07:27.796280+0000","last_undegraded":"2023-10-08T16:07:27.796280+0000","last_fullsized":"2023-10-08T16:07:27.796280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:13.253535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.787392+0000","last_change":"2023-10-08T16:07:26.780512+0000","last_active":"2023-10-08T16:07:26.787392+0000","last_peered":"2023-10-08T16:07:26.787392+0000","last_clean":"2023-10-08T16:07:26.787392+0000","last_became_active":"2023-10-08T16:07:26.780204+0000","last_became_peered":"2023-10-08T16:07:26.780204+0000","last_unstale":"2023-10-08T16:07:26.787392+0000","last_undegraded":"2023-10-08T16:07:26.787392+0000","last_fullsized":"2023-10-08T16:07:26.787392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:59.751866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.782232+0000","last_change":"2023-10-08T16:07:27.782232+0000","last_active":"2023-10-08T16:07:27.782232+0000","last_peered":"2023-10-08T16:07:27.782232+0000","last_clean":"2023-10-08T16:07:27.782232+0000","last_became_active":"2023-10-08T16:07:27.781862+0000","last_became_peered":"2023-10-08T16:07:27.781862+0000","last_unstale":"2023-10-08T16:07:27.782232+0000","last_undegraded":"2023-10-08T16:07:27.782232+0000","last_fullsized":"2023-10-08T16:07:27.782232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:32.470669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.790235+0000","last_change":"2023-10-08T16:07:26.788086+0000","last_active":"2023-10-08T16:07:26.790235+0000","last_peered":"2023-10-08T16:07:26.790235+0000","last_clean":"2023-10-08T16:07:26.790235+0000","last_became_active":"2023-10-08T16:07:26.787694+0000","last_became_peered":"2023-10-08T16:07:26.787694+0000","last_unstale":"2023-10-08T16:07:26.790235+0000","last_undegraded":"2023-10-08T16:07:26.790235+0000","last_fullsized":"2023-10-08T16:07:26.790235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:51.138812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:07:27.779830+0000","last_change":"2023-10-08T16:07:27.779830+0000","last_active":"2023-10-08T16:07:27.779830+0000","last_peered":"2023-10-08T16:07:27.779830+0000","last_clean":"2023-10-08T16:07:27.779830+0000","last_became_active":"2023-10-08T16:07:27.779514+0000","last_became_peered":"2023-10-08T16:07:27.779514+0000","last_unstale":"2023-10-08T16:07:27.779830+0000","last_undegraded":"2023-10-08T16:07:27.779830+0000","last_fullsized":"2023-10-08T16:07:27.779830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:26.745268+0000","last_clean_scrub_stamp":"2023-10-08T16:07:26.745268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:17.978845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.787729+0000","last_change":"2023-10-08T16:07:26.785249+0000","last_active":"2023-10-08T16:07:26.787729+0000","last_peered":"2023-10-08T16:07:26.787729+0000","last_clean":"2023-10-08T16:07:26.787729+0000","last_became_active":"2023-10-08T16:07:26.784993+0000","last_became_peered":"2023-10-08T16:07:26.784993+0000","last_unstale":"2023-10-08T16:07:26.787729+0000","last_undegraded":"2023-10-08T16:07:26.787729+0000","last_fullsized":"2023-10-08T16:07:26.787729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:25.734434+0000","last_clean_scrub_stamp":"2023-10-08T16:07:25.734434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:57.278384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:07:26.778614+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:07:26.778614+0000","last_peered":"2023-10-08T16:07:26.778614+0000","last_clean":"2023-10-08T16:07:26.778614+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:07:26.778614+0000","last_undegraded":"2023-10-08T16:07:26.778614+0000","last_fullsized":"2023-10-08T16:07:26.778614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298196,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073644,"statfs":{"total":96636764160,"available":96331411456,"internally_reserved":0,"allocated":929792,"data_stored":716334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.119},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.1919999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.3160000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.999}]},{"osd":3,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.161},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.232}]},{"osd":4,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.71199999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.0740000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.282},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.89200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":125966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298196,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073644,"statfs":{"total":96636764160,"available":96331411456,"internally_reserved":0,"allocated":929792,"data_stored":716334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:07:31.122 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:07:31.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:07:31.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.242+0000 7f18c0b21700 1 Processor -- start 2023-10-08T16:07:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.242+0000 7f18c0b21700 1 -- start start 2023-10-08T16:07:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18bc15c220 0x7f18bc1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc06d910 con 0x7f18bc06d4d0 2023-10-08T16:07:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc0c8e10 con 0x7f18bc15c220 2023-10-08T16:07:31.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc15a8d0 con 0x7f18bc0cd6c0 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18baffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18bc15c220 0x7f18bc1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bbfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f18bc06d4d0 0x7f18bc15c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:57668/0 (socket says 172.21.15.3:57668) 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bbfff700 1 -- 172.21.15.3:0/455354701 learned_addr learned my addr 172.21.15.3:0/455354701 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18ba7fc700 1 -- 172.21.15.3:0/455354701 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045373911 0 0) 0x7f18bc06d910 con 0x7f18bc06d4d0 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18ba7fc700 1 -- 172.21.15.3:0/455354701 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a8003570 con 0x7f18bc06d4d0 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bb7fe700 1 -- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 msgr2=0x7f18bc06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bb7fe700 1 --2- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc06cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bb7fe700 1 -- 172.21.15.3:0/455354701 >> v1:172.21.15.27:6789/0 conn(0x7f18bc06d4d0 legacy=0x7f18bc15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18ba7fc700 1 -- 172.21.15.3:0/455354701 <== mon.1 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268708363 0 0) 0x7f18a8003570 con 0x7f18bc06d4d0 2023-10-08T16:07:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bb7fe700 1 -- 172.21.15.3:0/455354701 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc159c90 con 0x7f18bc15c220 2023-10-08T16:07:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18baffd700 1 --2- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc06cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18bb7fe700 1 --2- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc15c220 0x7f18bc1593d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18a40098e0 tx=0x7f18a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac13ecc3f01474f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18ba7fc700 1 -- 172.21.15.3:0/455354701 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011630 con 0x7f18bc15c220 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18ba7fc700 1 -- 172.21.15.3:0/455354701 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4011790 con 0x7f18bc15c220 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18ba7fc700 1 -- 172.21.15.3:0/455354701 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011b30 con 0x7f18bc15c220 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc15c220 msgr2=0x7f18bc1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 --2- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc15c220 0x7f18bc1593d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18a40098e0 tx=0x7f18a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- 172.21.15.3:0/455354701 shutdown_connections 2023-10-08T16:07:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 --2- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc06cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 --2- 172.21.15.3:0/455354701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc15c220 0x7f18bc1593d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- 172.21.15.3:0/455354701 >> 172.21.15.3:0/455354701 conn(0x7f18bc06bf50 msgr2=0x7f18bc0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- 172.21.15.3:0/455354701 shutdown_connections 2023-10-08T16:07:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.246+0000 7f18c0b21700 1 -- 172.21.15.3:0/455354701 wait complete. 2023-10-08T16:07:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 Processor -- start 2023-10-08T16:07:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 -- start start 2023-10-08T16:07:31.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc06d4d0 0x7f18bc0af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 0x7f18bc147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0c9ea0 con 0x7f18bc15c220 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0ca0b0 con 0x7f18bc06d4d0 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18c0b21700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0ca390 con 0x7f18bc0cd6c0 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.250+0000 7f18bbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 0x7f18bc147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18baffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc06d4d0 0x7f18bc0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 0x7f18bc147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54722/0 (socket says 172.21.15.3:54722) 2023-10-08T16:07:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 -- 172.21.15.3:0/61194887 learned_addr learned my addr 172.21.15.3:0/61194887 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:31.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 -- 172.21.15.3:0/61194887 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 msgr2=0x7f18bc0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc0ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 -- 172.21.15.3:0/61194887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc06d4d0 msgr2=0x7f18bc0af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc06d4d0 0x7f18bc0af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 -- 172.21.15.3:0/61194887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009420 con 0x7f18bc15c220 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18bbfff700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 0x7f18bc147fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c930 tx=0x7f18b40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004dc0 con 0x7f18bc15c220 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4007150 con 0x7f18bc15c220 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a4009420 con 0x7f18bc15c220 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40074d0 con 0x7f18bc15c220 2023-10-08T16:07:31.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc0ca950 con 0x7f18bc15c220 2023-10-08T16:07:31.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.254+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc0c5cb0 con 0x7f18bc15c220 2023-10-08T16:07:31.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.258+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18b4007880 con 0x7f18bc15c220 2023-10-08T16:07:31.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.258+0000 7f18b37fe700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f189c060550 0x7f189c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.258+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18b407bff0 con 0x7f18bc15c220 2023-10-08T16:07:31.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.258+0000 7f18bb7fe700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f189c060550 0x7f189c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.258+0000 7f18bb7fe700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f189c060550 0x7f189c062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18a40091e0 tx=0x7f18a4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:31.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.266+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18bc0c5cb0 con 0x7f18bc15c220 2023-10-08T16:07:31.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.486+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f18bc0c5cb0 con 0x7f18bc15c220 2023-10-08T16:07:31.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.494+0000 7f18b37fe700 1 -- 172.21.15.3:0/61194887 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f18bc0c5cb0 con 0x7f18bc15c220 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f189c060550 msgr2=0x7f189c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f189c060550 0x7f189c062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18a40091e0 tx=0x7f18a4017000 comp rx=0 tx=0).stop 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 msgr2=0x7f18bc147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 0x7f18bc147fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c930 tx=0x7f18b40016f0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 shutdown_connections 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f189c060550 0x7f189c062a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18bc15c220 0x7f18bc147fa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f18bc0cd6c0 0x7f18bc0ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 --2- 172.21.15.3:0/61194887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc06d4d0 0x7f18bc0af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 >> 172.21.15.3:0/61194887 conn(0x7f18bc06bf50 msgr2=0x7f18bc0c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:31.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 shutdown_connections 2023-10-08T16:07:31.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.498+0000 7f18c0b21700 1 -- 172.21.15.3:0/61194887 wait complete. 2023-10-08T16:07:31.504 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-10-08T16:07:31.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:31.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 Processor -- start 2023-10-08T16:07:31.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- start start 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4254154bb0 0x7f425406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f42540c7200 0x7f425406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425406aba0 con 0x7f4254154f80 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425406b720 con 0x7f4254154bb0 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425406adf0 con 0x7f42540c7200 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4258a82700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4254154bb0 0x7f425406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4253fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4254154f80 0x7f42540c6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36588/0 (socket says 172.21.15.3:36588) 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4253fff700 1 -- 172.21.15.3:0/1348442708 learned_addr learned my addr 172.21.15.3:0/1348442708 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4259283700 1 --2- 172.21.15.3:0/1348442708 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f42540c7200 0x7f425406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f42537fe700 1 -- 172.21.15.3:0/1348442708 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274041875 0 0) 0x7f425406aba0 con 0x7f4254154f80 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f42537fe700 1 -- 172.21.15.3:0/1348442708 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4240003570 con 0x7f4254154f80 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4258a82700 1 -- 172.21.15.3:0/1348442708 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f42540c7200 msgr2=0x7f425406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4258a82700 1 --2- 172.21.15.3:0/1348442708 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f42540c7200 0x7f425406c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4258a82700 1 -- 172.21.15.3:0/1348442708 >> v1:172.21.15.3:6789/0 conn(0x7f4254154f80 legacy=0x7f42540c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4258a82700 1 -- 172.21.15.3:0/1348442708 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425406b0d0 con 0x7f4254154bb0 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f4258a82700 1 --2- 172.21.15.3:0/1348442708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4254154bb0 0x7f425406bbb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42440098e0 tx=0x7f42440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94efc96dc165e81d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f42537fe700 1 -- 172.21.15.3:0/1348442708 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244011630 con 0x7f4254154bb0 2023-10-08T16:07:31.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f42537fe700 1 -- 172.21.15.3:0/1348442708 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244011790 con 0x7f4254154bb0 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f42537fe700 1 -- 172.21.15.3:0/1348442708 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244011b30 con 0x7f4254154bb0 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- 172.21.15.3:0/1348442708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4254154bb0 msgr2=0x7f425406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 --2- 172.21.15.3:0/1348442708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4254154bb0 0x7f425406bbb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42440098e0 tx=0x7f42440091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- 172.21.15.3:0/1348442708 shutdown_connections 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 --2- 172.21.15.3:0/1348442708 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f42540c7200 0x7f425406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 --2- 172.21.15.3:0/1348442708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4254154bb0 0x7f425406bbb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- 172.21.15.3:0/1348442708 >> 172.21.15.3:0/1348442708 conn(0x7f42540cc5d0 msgr2=0x7f42540c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- 172.21.15.3:0/1348442708 shutdown_connections 2023-10-08T16:07:31.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.622+0000 7f425ace6700 1 -- 172.21.15.3:0/1348442708 wait complete. 2023-10-08T16:07:31.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 Processor -- start 2023-10-08T16:07:31.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 -- start start 2023-10-08T16:07:31.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 0x7f4254143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4254154bb0 0x7f4254167fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4254154f80 0x7f425415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541689f0 con 0x7f42540c7200 2023-10-08T16:07:31.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254168cd0 con 0x7f4254154f80 2023-10-08T16:07:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254168fb0 con 0x7f4254154bb0 2023-10-08T16:07:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 0x7f4254143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 0x7f4254143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54730/0 (socket says 172.21.15.3:54730) 2023-10-08T16:07:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 -- 172.21.15.3:0/3378135976 learned_addr learned my addr 172.21.15.3:0/3378135976 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4259283700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4254154f80 0x7f425415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4253fff700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4254154bb0 0x7f4254167fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 -- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4254154bb0 msgr2=0x7f4254167fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4254154bb0 0x7f4254167fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 -- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4254154f80 msgr2=0x7f425415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4254154f80 0x7f425415bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 -- 172.21.15.3:0/3378135976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244009420 con 0x7f42540c7200 2023-10-08T16:07:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4258a82700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 0x7f4254143670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42540ccac0 tx=0x7f4244017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244011900 con 0x7f42540c7200 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244011a60 con 0x7f42540c7200 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.626+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4254169290 con 0x7f42540c7200 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244025640 con 0x7f42540c7200 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4254143bb0 con 0x7f42540c7200 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425404be40 con 0x7f42540c7200 2023-10-08T16:07:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4244025a30 con 0x7f42540c7200 2023-10-08T16:07:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f4250ff9700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4234060550 0x7f4234062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f424407df50 con 0x7f42540c7200 2023-10-08T16:07:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f4253fff700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4234060550 0x7f4234062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.630+0000 7f4253fff700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4234060550 0x7f4234062a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f425415a900 tx=0x7f423c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.638+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f424404e4a0 con 0x7f42540c7200 2023-10-08T16:07:31.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f425406a6c0 con 0x7f42540c7200 2023-10-08T16:07:31.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f4250ff9700 1 -- 172.21.15.3:0/3378135976 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f4244051ac0 con 0x7f42540c7200 2023-10-08T16:07:31.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:07:31.842 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:07:31.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4234060550 msgr2=0x7f4234062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4234060550 0x7f4234062a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f425415a900 tx=0x7f423c009040 comp rx=0 tx=0).stop 2023-10-08T16:07:31.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 msgr2=0x7f4254143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:31.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 0x7f4254143670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42540ccac0 tx=0x7f4244017000 comp rx=0 tx=0).stop 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 shutdown_connections 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4234060550 0x7f4234062a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4254154f80 0x7f425415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4254154bb0 0x7f4254167fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 --2- 172.21.15.3:0/3378135976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42540c7200 0x7f4254143670 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 >> 172.21.15.3:0/3378135976 conn(0x7f42540cc5d0 msgr2=0x7f42541505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 shutdown_connections 2023-10-08T16:07:31.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:31.838+0000 7f425ace6700 1 -- 172.21.15.3:0/3378135976 wait complete. 2023-10-08T16:07:31.846 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:07:32.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:07:27.136547+0000', 'modified': '2023-10-08T16:07:29.780125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5001}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5001': {'gid': 5001, 'name': 'a', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6835/3934697799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6834', 'nonce': 3934697799}, {'type': 'v1', 'addr': '172.21.15.3:6835', 'nonce': 3934697799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:07:32.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:07:32.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:07:32.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 Processor -- start 2023-10-08T16:07:32.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- start start 2023-10-08T16:07:32.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f499c06c700 0x7f499c159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f499c06dc10 0x7f499c154990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c06e0b0 con 0x7f499c158db0 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c06d780 con 0x7f499c06c700 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c06beb0 con 0x7f499c06dc10 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f499c06c700 0x7f499c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f499c06c700 0x7f499c159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54744/0 (socket says 172.21.15.3:54744) 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 -- 172.21.15.3:0/3080626242 learned_addr learned my addr 172.21.15.3:0/3080626242 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499b7fe700 1 --2- 172.21.15.3:0/3080626242 >> v2:172.21.15.27:3300/0 conn(0x7f499c06dc10 0x7f499c154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 -- 172.21.15.3:0/3080626242 >> v2:172.21.15.27:3300/0 conn(0x7f499c06dc10 msgr2=0x7f499c154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 --2- 172.21.15.3:0/3080626242 >> v2:172.21.15.27:3300/0 conn(0x7f499c06dc10 0x7f499c154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 -- 172.21.15.3:0/3080626242 >> v1:172.21.15.27:6789/0 conn(0x7f499c158db0 legacy=0x7f499c06b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 -- 172.21.15.3:0/3080626242 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c06cb70 con 0x7f499c06c700 2023-10-08T16:07:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f499a7fc700 1 --2- 172.21.15.3:0/3080626242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06c700 0x7f499c159180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f499c06d6f0 tx=0x7f498c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2319ca5e582fdf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f4999ffb700 1 -- 172.21.15.3:0/3080626242 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00dba0 con 0x7f499c06c700 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f4999ffb700 1 -- 172.21.15.3:0/3080626242 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c00dd00 con 0x7f499c06c700 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f4999ffb700 1 -- 172.21.15.3:0/3080626242 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0196d0 con 0x7f499c06c700 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- 172.21.15.3:0/3080626242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06c700 msgr2=0x7f499c159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 --2- 172.21.15.3:0/3080626242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06c700 0x7f499c159180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f499c06d6f0 tx=0x7f498c00b4f0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- 172.21.15.3:0/3080626242 shutdown_connections 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 --2- 172.21.15.3:0/3080626242 >> v2:172.21.15.27:3300/0 conn(0x7f499c06dc10 0x7f499c154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 --2- 172.21.15.3:0/3080626242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06c700 0x7f499c159180 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- 172.21.15.3:0/3080626242 >> 172.21.15.3:0/3080626242 conn(0x7f499c067b30 msgr2=0x7f499c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- 172.21.15.3:0/3080626242 shutdown_connections 2023-10-08T16:07:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.374+0000 7f49a14e0700 1 -- 172.21.15.3:0/3080626242 wait complete. 2023-10-08T16:07:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 Processor -- start 2023-10-08T16:07:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 -- start start 2023-10-08T16:07:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f499c06c700 0x7f499c14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 0x7f499c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f499c158db0 0x7f499c164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b11e0 con 0x7f499c06dc10 2023-10-08T16:07:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b0660 con 0x7f499c06c700 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f49a14e0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b0940 con 0x7f499c158db0 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 0x7f499c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 0x7f499c14c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54760/0 (socket says 172.21.15.3:54760) 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 -- 172.21.15.3:0/1321244629 learned_addr learned my addr 172.21.15.3:0/1321244629 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499affd700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f499c06c700 0x7f499c14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499b7fe700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f499c158db0 0x7f499c164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 -- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f499c158db0 msgr2=0x7f499c164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f499c158db0 0x7f499c164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 -- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f499c06c700 msgr2=0x7f499c14a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f499c06c700 0x7f499c14a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499a7fc700 1 -- 172.21.15.3:0/1321244629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c00b790 con 0x7f499c06dc10 2023-10-08T16:07:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.378+0000 7f499affd700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f499c06c700 0x7f499c14a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f499a7fc700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 0x7f499c14c5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f499c0cb650 tx=0x7f498c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f4992ffd700 1 -- 172.21.15.3:0/1321244629 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c010680 con 0x7f499c06dc10 2023-10-08T16:07:32.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f4992ffd700 1 -- 172.21.15.3:0/1321244629 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c0107e0 con 0x7f499c06dc10 2023-10-08T16:07:32.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c0b0c20 con 0x7f499c06dc10 2023-10-08T16:07:32.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f4992ffd700 1 -- 172.21.15.3:0/1321244629 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c010ba0 con 0x7f499c06dc10 2023-10-08T16:07:32.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c0b02c0 con 0x7f499c06dc10 2023-10-08T16:07:32.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f4992ffd700 1 -- 172.21.15.3:0/1321244629 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f498c024400 con 0x7f499c06dc10 2023-10-08T16:07:32.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.382+0000 7f4992ffd700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f497c060550 0x7f497c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499affd700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f497c060550 0x7f497c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f4992ffd700 1 -- 172.21.15.3:0/1321244629 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f498c014070 con 0x7f499c06dc10 2023-10-08T16:07:32.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499affd700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f497c060550 0x7f497c062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4984007fd0 tx=0x7f4984009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 Processor -- start 2023-10-08T16:07:32.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 -- start start 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x2271f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2272440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x2272980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x219ff30 con 0x203f790 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x219bed0 con 0x1ff4ae0 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x21620b0 con 0x1ff4710 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x2272980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x2271f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x2272980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54772/0 (socket says 172.21.15.3:54772) 2023-10-08T16:07:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x2271f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:38980/0 (socket says 172.21.15.3:38980) 2023-10-08T16:07:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 -- 172.21.15.3:0/2925190203 learned_addr learned my addr 172.21.15.3:0/2925190203 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2272440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 -- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 msgr2=0x2272440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2272440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 -- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 msgr2=0x2271f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.386+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x2271f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f499b7fe700 1 -- 172.21.15.3:0/2925190203 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20409e0 con 0x203f790 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x2272980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f49940107a0 tx=0x7f499400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9684c62ff3ce3fd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f497bfff700 1 -- 172.21.15.3:0/2925190203 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994007550 con 0x203f790 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f497bfff700 1 -- 172.21.15.3:0/2925190203 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49940076b0 con 0x203f790 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f497bfff700 1 -- 172.21.15.3:0/2925190203 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994007a50 con 0x203f790 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 -- 172.21.15.3:0/2925190203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 msgr2=0x2272980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x2272980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f49940107a0 tx=0x7f499400b040 comp rx=0 tx=0).stop 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 -- 172.21.15.3:0/2925190203 shutdown_connections 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x2272980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2272440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 --2- 172.21.15.3:0/2925190203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x2271f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 -- 172.21.15.3:0/2925190203 >> 172.21.15.3:0/2925190203 conn(0x1ff4eb0 msgr2=0x222e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 -- 172.21.15.3:0/2925190203 shutdown_connections 2023-10-08T16:07:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 -- 172.21.15.3:0/2925190203 wait complete. 2023-10-08T16:07:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 -- start start 2023-10-08T16:07:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.390+0000 7f49a3789740 1 Processor -- start 2023-10-08T16:07:32.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 0x2276510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4ae0 0x2276a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x2257cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2161d50 con 0x1ff4710 2023-10-08T16:07:32.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x213a970 con 0x203f790 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x2164920 con 0x1ff4ae0 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 0x2276510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 0x2276510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54780/0 (socket says 172.21.15.3:54780) 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 -- 172.21.15.3:0/2761530224 learned_addr learned my addr 172.21.15.3:0/2761530224 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 10 client.0 _ll_register_callbacks cb 0x21e56a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4ae0 0x2276a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x2257cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 -- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4ae0 msgr2=0x2276a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4ae0 0x2276a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 -- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 msgr2=0x2257cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x2257cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 -- 172.21.15.3:0/2761530224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940104d0 con 0x1ff4710 2023-10-08T16:07:32.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x2257cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499affd700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 0x2276510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4984014460 tx=0x7f4984013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef5ab29099d9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49797fa700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49797fa700 1 -- 172.21.15.3:0/2761530224 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984012660 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49797fa700 1 -- 172.21.15.3:0/2761530224 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49840127c0 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x213acc0 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49797fa700 1 -- 172.21.15.3:0/2761530224 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4984012b90 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 10 client.5184 fetch_fsmap learned FSMap version 12 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x216a370 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49797fa700 1 -- 172.21.15.3:0/2761530224 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x213acc0 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49797fa700 1 -- 172.21.15.3:0/2761530224 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4984020070 con 0x1ff4710 2023-10-08T16:07:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 10 client.5184 fetch_fsmap finished waiting for FSMap version 12 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 10 client.5184 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 20 client.5184 populate_metadata read hostname 'smithi003' 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2259300 0x22816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 4 client.5184 mds_command: new command op to 5001 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 --> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x213e3e0 con 0x2259300 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.394+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2259300 0x22816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49797fa700 10 client.5184 ms_handle_connect on v2:172.21.15.3:6834/3934697799 2023-10-08T16:07:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2259300 0x22816b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76c67d89e7d2b21 server_cookie=4af7f7908f5dd4c4 in_seq=0 out_seq=0 2023-10-08T16:07:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49797fa700 1 -- 172.21.15.3:0/2761530224 <== mds.0 v2:172.21.15.3:6834/3934697799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x213e3e0 con 0x2259300 2023-10-08T16:07:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49797fa700 10 client.5184 handle_command_reply: tid=0 2023-10-08T16:07:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 client.5184 shutdown 2023-10-08T16:07:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 msgr2=0x2276510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 0x2276510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4984014460 tx=0x7f4984013000 comp rx=0 tx=0).stop 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 shutdown_connections 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2259300 0x22816b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x2257cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4ae0 0x2276a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 --2- 172.21.15.3:0/2761530224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4710 0x2276510 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49797fa700 0 client.5184 ms_handle_reset on v2:172.21.15.3:6834/3934697799 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 >> 172.21.15.3:0/2761530224 conn(0x1ff4eb0 msgr2=0x2226f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 shutdown_connections 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 1 -- 172.21.15.3:0/2761530224 wait complete. 2023-10-08T16:07:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.398+0000 7f49a3789740 20 client.5184 trim_cache size 0 max 16384 2023-10-08T16:07:32.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.418+0000 7f49a3789740 1 Processor -- start 2023-10-08T16:07:32.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.418+0000 7f49a3789740 1 -- start start 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2255e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 0x22563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x22713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x216f040 con 0x1ff4ae0 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x214ac90 con 0x203f790 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x2197b50 con 0x1ff4710 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 0x22563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 0x22563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54784/0 (socket says 172.21.15.3:54784) 2023-10-08T16:07:32.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 -- 172.21.15.3:0/2985058791 learned_addr learned my addr 172.21.15.3:0/2985058791 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x22713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499affd700 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2255e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 -- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 msgr2=0x2255e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2255e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 -- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 msgr2=0x22713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x22713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 -- 172.21.15.3:0/2985058791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2150d80 con 0x1ff4ae0 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 0x22563d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f498c052b40 tx=0x7f498c012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ff28b08596d84a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f4990ff9700 1 -- 172.21.15.3:0/2985058791 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c059b90 con 0x1ff4ae0 2023-10-08T16:07:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f4990ff9700 1 -- 172.21.15.3:0/2985058791 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c07cf30 con 0x1ff4ae0 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f4990ff9700 1 -- 172.21.15.3:0/2985058791 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c050cf0 con 0x1ff4ae0 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- 172.21.15.3:0/2985058791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 msgr2=0x22563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 0x22563d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f498c052b40 tx=0x7f498c012040 comp rx=0 tx=0).stop 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- 172.21.15.3:0/2985058791 shutdown_connections 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x203f790 0x22713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1ff4ae0 0x22563d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 --2- 172.21.15.3:0/2985058791 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x2255e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- 172.21.15.3:0/2985058791 >> 172.21.15.3:0/2985058791 conn(0x1ff4eb0 msgr2=0x2255780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- 172.21.15.3:0/2985058791 shutdown_connections 2023-10-08T16:07:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.422+0000 7f49a3789740 1 -- 172.21.15.3:0/2985058791 wait complete. 2023-10-08T16:07:32.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- start start 2023-10-08T16:07:32.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 Processor -- start 2023-10-08T16:07:32.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x22cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x22cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x222b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x213cb80 con 0x203f790 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x2199890 con 0x1ff4ae0 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x206d7c0 con 0x1ff4710 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 10 client.0 _ll_register_callbacks cb 0x1fc09d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x222b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x222b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54794/0 (socket says 172.21.15.3:54794) 2023-10-08T16:07:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 -- 172.21.15.3:0/2599725503 learned_addr learned my addr 172.21.15.3:0/2599725503 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499affd700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x22cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499a7fc700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x22cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 -- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 msgr2=0x22cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x22cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 -- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 msgr2=0x22cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x22cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 -- 172.21.15.3:0/2599725503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c0b02c0 con 0x203f790 2023-10-08T16:07:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f499b7fe700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x222b4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x2148750 tx=0x7f499401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4500c8b15972ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49797fa700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:07:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49797fa700 1 -- 172.21.15.3:0/2599725503 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994007e80 con 0x203f790 2023-10-08T16:07:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49940076b0 con 0x203f790 2023-10-08T16:07:32.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49797fa700 1 -- 172.21.15.3:0/2599725503 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f499402c070 con 0x203f790 2023-10-08T16:07:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49797fa700 1 -- 172.21.15.3:0/2599725503 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4994009ac0 con 0x203f790 2023-10-08T16:07:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 10 client.5190 fetch_fsmap learned FSMap version 12 2023-10-08T16:07:32.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x2145130 con 0x203f790 2023-10-08T16:07:32.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49797fa700 1 -- 172.21.15.3:0/2599725503 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49940076b0 con 0x203f790 2023-10-08T16:07:32.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49797fa700 1 -- 172.21.15.3:0/2599725503 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f499401b860 con 0x203f790 2023-10-08T16:07:32.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 10 client.5190 fetch_fsmap finished waiting for FSMap version 12 2023-10-08T16:07:32.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:07:32.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 20 client.5190 populate_metadata read hostname 'smithi003' 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x22d2570 0x22d4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 4 client.5190 mds_command: new command op to 5001 tid=0[{"prefix": "status"}] 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.426+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 --> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2170410 con 0x22d2570 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f499affd700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x22d2570 0x22d4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49797fa700 10 client.5190 ms_handle_connect on v2:172.21.15.3:6834/3934697799 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f499affd700 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x22d2570 0x22d4950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4846647969c4885b server_cookie=c8e6569670e76991 in_seq=0 out_seq=0 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49797fa700 1 -- 172.21.15.3:0/2599725503 <== mds.0 v2:172.21.15.3:6834/3934697799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x2170410 con 0x22d2570 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49797fa700 10 client.5190 handle_command_reply: tid=0 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 client.5190 shutdown 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 msgr2=0x222b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x222b4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x2148750 tx=0x7f499401b000 comp rx=0 tx=0).stop 2023-10-08T16:07:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 shutdown_connections 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x22d2570 0x22d4950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x203f790 0x222b4c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49797fa700 0 client.5190 ms_handle_reset on v2:172.21.15.3:6834/3934697799 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x1ff4ae0 0x22cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 --2- 172.21.15.3:0/2599725503 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x1ff4710 0x22cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 >> 172.21.15.3:0/2599725503 conn(0x1ff4eb0 msgr2=0x2255780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 shutdown_connections 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 1 -- 172.21.15.3:0/2599725503 wait complete. 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a3789740 20 client.5190 trim_cache size 0 max 16384 2023-10-08T16:07:32.441 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3007c8b5-937d-4f26-8e83-7370fb7a9cb4", 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5001, 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 4.6608263680000004, 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 12, 2023-10-08T16:07:32.442 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 32, 2023-10-08T16:07:32.443 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 32, 2023-10-08T16:07:32.443 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 12.505824382 2023-10-08T16:07:32.443 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f497c060550 msgr2=0x7f497c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f497c060550 0x7f497c062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4984007fd0 tx=0x7f4984009040 comp rx=0 tx=0).stop 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 msgr2=0x7f499c14c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 0x7f499c14c5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f499c0cb650 tx=0x7f498c01b000 comp rx=0 tx=0).stop 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 shutdown_connections 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f497c060550 0x7f497c062a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f499c158db0 0x7f499c164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c06dc10 0x7f499c14c5a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 --2- 172.21.15.3:0/1321244629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f499c06c700 0x7f499c14a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 >> 172.21.15.3:0/1321244629 conn(0x7f499c067b30 msgr2=0x7f499c152970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 shutdown_connections 2023-10-08T16:07:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.430+0000 7f49a14e0700 1 -- 172.21.15.3:0/1321244629 wait complete. 2023-10-08T16:07:32.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:07:32.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.562+0000 7fa82588d700 1 Processor -- start 2023-10-08T16:07:32.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.562+0000 7fa82588d700 1 -- start start 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa8200ae230 0x7fa8200c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa8200c7ba0 0x7fa8200ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8201562c0 con 0x7fa8200ade60 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82006b0b0 con 0x7fa8200c7ba0 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82006b390 con 0x7fa8200ae230 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82488b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa8200ade60 0x7fa8200cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36590/0 (socket says 172.21.15.3:36590) 2023-10-08T16:07:32.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82488b700 1 -- 172.21.15.3:0/997447007 learned_addr learned my addr 172.21.15.3:0/997447007 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:07:32.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82508c700 1 --2- 172.21.15.3:0/997447007 >> v2:172.21.15.3:3300/0 conn(0x7fa8200c7ba0 0x7fa8200ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa81ffff700 1 --2- 172.21.15.3:0/997447007 >> v2:172.21.15.27:3300/0 conn(0x7fa8200ae230 0x7fa8200c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa81f7fe700 1 -- 172.21.15.3:0/997447007 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850459059 0 0) 0x7fa8201562c0 con 0x7fa8200ade60 2023-10-08T16:07:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa81f7fe700 1 -- 172.21.15.3:0/997447007 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa80c003570 con 0x7fa8200ade60 2023-10-08T16:07:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82508c700 1 -- 172.21.15.3:0/997447007 >> v2:172.21.15.27:3300/0 conn(0x7fa8200ae230 msgr2=0x7fa8200c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82508c700 1 --2- 172.21.15.3:0/997447007 >> v2:172.21.15.27:3300/0 conn(0x7fa8200ae230 0x7fa8200c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82508c700 1 -- 172.21.15.3:0/997447007 >> v1:172.21.15.3:6789/0 conn(0x7fa8200ade60 legacy=0x7fa8200cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82508c700 1 -- 172.21.15.3:0/997447007 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82006b670 con 0x7fa8200c7ba0 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82508c700 1 --2- 172.21.15.3:0/997447007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200c7ba0 0x7fa8200ae870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa8200c8330 tx=0x7fa818009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27a67959a662591 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa81f7fe700 1 -- 172.21.15.3:0/997447007 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800bab0 con 0x7fa8200c7ba0 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa81f7fe700 1 -- 172.21.15.3:0/997447007 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81800bc10 con 0x7fa8200c7ba0 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- 172.21.15.3:0/997447007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200c7ba0 msgr2=0x7fa8200ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 --2- 172.21.15.3:0/997447007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200c7ba0 0x7fa8200ae870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa8200c8330 tx=0x7fa818009780 comp rx=0 tx=0).stop 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- 172.21.15.3:0/997447007 shutdown_connections 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 --2- 172.21.15.3:0/997447007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200c7ba0 0x7fa8200ae870 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 --2- 172.21.15.3:0/997447007 >> v2:172.21.15.27:3300/0 conn(0x7fa8200ae230 0x7fa8200c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- 172.21.15.3:0/997447007 >> 172.21.15.3:0/997447007 conn(0x7fa8200c83d0 msgr2=0x7fa8200c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- 172.21.15.3:0/997447007 shutdown_connections 2023-10-08T16:07:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.566+0000 7fa82588d700 1 -- 172.21.15.3:0/997447007 wait complete. 2023-10-08T16:07:32.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 Processor -- start 2023-10-08T16:07:32.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 -- start start 2023-10-08T16:07:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 0x7fa820154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8200ae230 0x7fa820150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa8200c7ba0 0x7fa820151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200ae870 con 0x7fa8200ade60 2023-10-08T16:07:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200aeac0 con 0x7fa8200ae230 2023-10-08T16:07:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200aeda0 con 0x7fa8200c7ba0 2023-10-08T16:07:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 0x7fa820154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 0x7fa820154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54812/0 (socket says 172.21.15.3:54812) 2023-10-08T16:07:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 -- 172.21.15.3:0/1257342920 learned_addr learned my addr 172.21.15.3:0/1257342920 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82508c700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa8200c7ba0 0x7fa820151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa81ffff700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8200ae230 0x7fa820150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 -- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa8200c7ba0 msgr2=0x7fa820151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa8200c7ba0 0x7fa820151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 -- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8200ae230 msgr2=0x7fa820150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8200ae230 0x7fa820150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 -- 172.21.15.3:0/1257342920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009a20 con 0x7fa8200ade60 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82488b700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 0x7fa820154830 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c590 tx=0x7fa810007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810005b30 con 0x7fa8200ade60 2023-10-08T16:07:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810005cb0 con 0x7fa8200ade60 2023-10-08T16:07:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200af080 con 0x7fa8200ade60 2023-10-08T16:07:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.570+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810007320 con 0x7fa8200ade60 2023-10-08T16:07:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa820154d70 con 0x7fa8200ade60 2023-10-08T16:07:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa81001b3b0 con 0x7fa8200ade60 2023-10-08T16:07:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82004be40 con 0x7fa8200ade60 2023-10-08T16:07:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa81cff9700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa800060550 0x7fa800062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa81007bbe0 con 0x7fa8200ade60 2023-10-08T16:07:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa81ffff700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa800060550 0x7fa800062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:32.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.574+0000 7fa81ffff700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa800060550 0x7fa800062a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa820168190 tx=0x7fa8080091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.582+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa81004c1d0 con 0x7fa8200ade60 2023-10-08T16:07:32.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.774+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa820068800 con 0x7fa8200ade60 2023-10-08T16:07:32.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa81cff9700 1 -- 172.21.15.3:0/1257342920 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa810053e60 con 0x7fa8200ade60 2023-10-08T16:07:32.781 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa800060550 msgr2=0x7fa800062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa800060550 0x7fa800062a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa820168190 tx=0x7fa8080091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 msgr2=0x7fa820154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 0x7fa820154830 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c590 tx=0x7fa810007e00 comp rx=0 tx=0).stop 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 shutdown_connections 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa800060550 0x7fa800062a00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa8200c7ba0 0x7fa820151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8200ae230 0x7fa820150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 --2- 172.21.15.3:0/1257342920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8200ade60 0x7fa820154830 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:32.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.778+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 >> 172.21.15.3:0/1257342920 conn(0x7fa8200c83d0 msgr2=0x7fa8200ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.782+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 shutdown_connections 2023-10-08T16:07:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:32.782+0000 7fa82588d700 1 -- 172.21.15.3:0/1257342920 wait complete. 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:07:32.799 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:07:32.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:07:32.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:07:32.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:32.800 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:32.806 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42464sec preferred_lft 42464sec 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:07:32.807 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:23:c8:a3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec2d:51ff:fe60:39b2/64 scope link 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::10d3:e4ff:fe73:f282/64 scope link 2023-10-08T16:07:32.808 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.809 INFO:teuthology.orchestra.run.smithi003.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:32.809 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether be:9c:c5:92:be:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:07:32.809 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::bc9c:c5ff:fe92:be4a/64 scope link 2023-10-08T16:07:32.809 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:32.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:32.809 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:07:32.863 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-10-08T16:07:32.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:32.866 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-10-08T16:07:32.874 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-10-08T16:07:32.874 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:07:32.874 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:07:32.874 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:07:32.875 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:07:32.875 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:07:32.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:32.875 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:07:32.875 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:07:32.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:07:32.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:07:32.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:07:32.875 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:07:32.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:32.912 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:07:32.919 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:07:32.919 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:07:32.919 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:07:32.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:32.919 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-10-08T16:07:32.976 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T16:07:32.976 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:32.977 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:32.981 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:07:32.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:32.982 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:32.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:07:33.045 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:33.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:33.055 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:33.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:33.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:33.057 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:07:33.062 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:07:33.063 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T16:07:33.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:07:33.078 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:33.078 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:33.089 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:33.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:33.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:33.091 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:07:33.150 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-10-08T16:07:33.146+0000 7fbcaffe3380 -1 init, newargv = 0x55fcdc6672e0 newargc=15 2023-10-08T16:07:33.150 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[42892]: starting ceph client 2023-10-08T16:07:33.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[42892]: starting fuse 2023-10-08T16:07:34.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:07:34.217 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:34.217 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:34.276 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:34.276 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:34.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:34.277 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:07:34.284 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:07:34.285 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-10-08T16:07:34.285 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:07:34.286 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-10-08T16:07:34.287 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:34.371 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.42892.asok 2023-10-08T16:07:34.555 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42892.asok 2023-10-08T16:07:34.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:34.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42892.asok status 2023-10-08T16:07:34.695 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:07:34.695 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "42892", 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-10-08T16:07:34.696 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5208, 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 5208 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 345787581 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 345787581 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.5208 192.168.0.1:0/345787581", 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/345787581", 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 12, 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 32, 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-10-08T16:07:34.698 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-10-08T16:07:34.699 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:07:34.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:34.705 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-10-08T16:07:34.705 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:34.713 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-10-08T16:07:34.713 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:34.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:34.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:34.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:07:34.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 Processor -- start 2023-10-08T16:07:34.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- start start 2023-10-08T16:07:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ee40adc30 0x7f1ee406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1ee406ab00 0x7f1ee40ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee40ae540 con 0x7f1ee406af00 2023-10-08T16:07:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee406cae0 con 0x7f1ee406ab00 2023-10-08T16:07:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee406cdc0 con 0x7f1ee40adc30 2023-10-08T16:07:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1ee406ab00 0x7f1ee40ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1ee406ab00 0x7f1ee40ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54828/0 (socket says 172.21.15.3:54828) 2023-10-08T16:07:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 -- 172.21.15.3:0/3519712020 learned_addr learned my addr 172.21.15.3:0/3519712020 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee37fe700 1 --2- 172.21.15.3:0/3519712020 >> v2:172.21.15.27:3300/0 conn(0x7f1ee40adc30 0x7f1ee406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 -- 172.21.15.3:0/3519712020 >> v2:172.21.15.27:3300/0 conn(0x7f1ee40adc30 msgr2=0x7f1ee406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 --2- 172.21.15.3:0/3519712020 >> v2:172.21.15.27:3300/0 conn(0x7f1ee40adc30 0x7f1ee406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 -- 172.21.15.3:0/3519712020 >> v1:172.21.15.27:6789/0 conn(0x7f1ee406af00 legacy=0x7f1ee40ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 -- 172.21.15.3:0/3519712020 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee406d0a0 con 0x7f1ee406ab00 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee2ffd700 1 --2- 172.21.15.3:0/3519712020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406ab00 0x7f1ee40ae000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009f20 tx=0x7f1ed4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb8b6d452f709d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee27fc700 1 -- 172.21.15.3:0/3519712020 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed400e070 con 0x7f1ee406ab00 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee27fc700 1 -- 172.21.15.3:0/3519712020 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed400b990 con 0x7f1ee406ab00 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee27fc700 1 -- 172.21.15.3:0/3519712020 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40092e0 con 0x7f1ee406ab00 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/3519712020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406ab00 msgr2=0x7f1ee40ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/3519712020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406ab00 0x7f1ee40ae000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009f20 tx=0x7f1ed4009840 comp rx=0 tx=0).stop 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/3519712020 shutdown_connections 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/3519712020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406ab00 0x7f1ee40ae000 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/3519712020 >> v2:172.21.15.27:3300/0 conn(0x7f1ee40adc30 0x7f1ee406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/3519712020 >> 172.21.15.3:0/3519712020 conn(0x7f1ee40cc5d0 msgr2=0x7f1ee40c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/3519712020 shutdown_connections 2023-10-08T16:07:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.834+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/3519712020 wait complete. 2023-10-08T16:07:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 Processor -- start 2023-10-08T16:07:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 -- start start 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 0x7f1ee40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1ee40adc30 0x7f1ee40c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee4153cf0 0x7f1ee415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40aff60 con 0x7f1ee406af00 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40af880 con 0x7f1ee4153cf0 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee9e2c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4154190 con 0x7f1ee40adc30 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 0x7f1ee40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 0x7f1ee40ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54840/0 (socket says 172.21.15.3:54840) 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.838+0000 7f1ee37fe700 1 -- 172.21.15.3:0/1275976148 learned_addr learned my addr 172.21.15.3:0/1275976148 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee2ffd700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1ee40adc30 0x7f1ee40c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee3fff700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee4153cf0 0x7f1ee415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee37fe700 1 -- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1ee40adc30 msgr2=0x7f1ee40c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee37fe700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1ee40adc30 0x7f1ee40c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee37fe700 1 -- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee4153cf0 msgr2=0x7f1ee415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee37fe700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee4153cf0 0x7f1ee415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee37fe700 1 -- 172.21.15.3:0/1275976148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4009ae0 con 0x7f1ee406af00 2023-10-08T16:07:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee2ffd700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1ee40adc30 0x7f1ee40c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee37fe700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 0x7f1ee40ae8e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00ec80 tx=0x7f1ecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00c9d0 con 0x7f1ee406af00 2023-10-08T16:07:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00cb50 con 0x7f1ee406af00 2023-10-08T16:07:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee40aefe0 con 0x7f1ee406af00 2023-10-08T16:07:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc013470 con 0x7f1ee406af00 2023-10-08T16:07:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee40af5a0 con 0x7f1ee406af00 2023-10-08T16:07:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee404be40 con 0x7f1ee406af00 2023-10-08T16:07:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.842+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ecc013860 con 0x7f1ee406af00 2023-10-08T16:07:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.846+0000 7f1edb7fe700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1ec8060550 0x7f1ec8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.846+0000 7f1ee2ffd700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1ec8060550 0x7f1ec8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.846+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ecc07cb70 con 0x7f1ee406af00 2023-10-08T16:07:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.846+0000 7f1ee2ffd700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1ec8060550 0x7f1ec8062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009880 tx=0x7f1ed4018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:34.850+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ecc04d160 con 0x7f1ee406af00 2023-10-08T16:07:35.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.054+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ee406d380 con 0x7f1ee406af00 2023-10-08T16:07:35.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.054+0000 7f1edb7fe700 1 -- 172.21.15.3:0/1275976148 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ecc050780 con 0x7f1ee406af00 2023-10-08T16:07:35.059 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:07:35.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1ec8060550 msgr2=0x7f1ec8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:35.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1ec8060550 0x7f1ec8062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009880 tx=0x7f1ed4018000 comp rx=0 tx=0).stop 2023-10-08T16:07:35.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 msgr2=0x7f1ee40ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:35.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 0x7f1ee40ae8e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00ec80 tx=0x7f1ecc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:35.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 shutdown_connections 2023-10-08T16:07:35.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1ec8060550 0x7f1ec8062a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee4153cf0 0x7f1ee415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1ee40adc30 0x7f1ee40c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 --2- 172.21.15.3:0/1275976148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ee406af00 0x7f1ee40ae8e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 >> 172.21.15.3:0/1275976148 conn(0x7f1ee40cc5d0 msgr2=0x7f1ee40c1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 shutdown_connections 2023-10-08T16:07:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:35.058+0000 7f1ee9e2c700 1 -- 172.21.15.3:0/1275976148 wait complete. 2023-10-08T16:07:35.072 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:07:35.073 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:35.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:35.073 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.082 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42504sec preferred_lft 42504sec 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:35.083 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:88:23:76:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:7e:cd:39:46:09 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::e4d6:67ff:fe20:d296/64 scope link 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ce:f9:8e:0a:a5:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:07:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ccf9:8eff:fe0a:a5cd/64 scope link 2023-10-08T16:07:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.085 INFO:teuthology.orchestra.run.smithi027.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:7e:cd:39:46:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:07:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::587e:cdff:fe39:4609/64 scope link 2023-10-08T16:07:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:35.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:35.085 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:07:35.143 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-10-08T16:07:35.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:35.145 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-10-08T16:07:35.154 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-10-08T16:07:35.154 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:07:35.155 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:07:35.155 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:07:35.155 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:07:35.155 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:07:35.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:35.155 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:07:35.155 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:07:35.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:07:35.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:07:35.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:07:35.156 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:07:35.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:35.193 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-08T16:07:35.242 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:07:35.243 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:07:35.243 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:35.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:35.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-10-08T16:07:35.259 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-08T16:07:35.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:35.259 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:35.264 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:35.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:35.264 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:35.314 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:35.329 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:35.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:35.340 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:35.340 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:35.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:35.341 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:35.346 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:07:35.346 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-08T16:07:35.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:35.365 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:35.365 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:35.376 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:35.377 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:35.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:35.378 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:35.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:2023-10-08T16:07:35.437+0000 7fb13f181380 -1 init, newargv = 0x55d846a2e950 newargc=15 2023-10-08T16:07:35.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39739]: starting ceph client 2023-10-08T16:07:35.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39739]: starting fuse 2023-10-08T16:07:36.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:07:36.505 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:07:36.505 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:07:36.520 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:07:36.521 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:07:36.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:36.521 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:07:36.570 INFO:teuthology.orchestra.run.smithi027.stdout:52 2023-10-08T16:07:36.570 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> import re 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> import os 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:36.571 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> return f 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:07:36.572 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.1")) 2023-10-08T16:07:36.573 DEBUG:teuthology.orchestra.run.smithi027:> ' 2023-10-08T16:07:36.655 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.1.39739.asok 2023-10-08T16:07:36.839 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.39739.asok 2023-10-08T16:07:36.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:36.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.39739.asok status 2023-10-08T16:07:36.937 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-08T16:07:36.937 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2023-10-08T16:07:36.937 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "1", 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "39739", 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 5149, 2023-10-08T16:07:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 5149 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2535779045 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:07:36.939 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2535779045 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.5149 192.168.0.1:0/2535779045", 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "192.168.0.1:0/2535779045", 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 12, 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 32, 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2023-10-08T16:07:36.940 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-08T16:07:36.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:36.947 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2023-10-08T16:07:36.947 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:36.952 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2023-10-08T16:07:36.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:36.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:36.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:36.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 1 2023-10-08T16:07:37.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 Processor -- start 2023-10-08T16:07:37.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 -- start start 2023-10-08T16:07:37.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f727815c350 0x7f727806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f727806d600 0x7f72780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f72780b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727806f2d0 con 0x7f727806d600 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727806e6c0 con 0x7f727815c350 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.086+0000 7f727759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727806e9a0 con 0x7f727815c720 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f727806d600 0x7f72780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f727806d600 0x7f72780b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54850/0 (socket says 172.21.15.3:54850) 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 -- 172.21.15.3:0/2896684997 learned_addr learned my addr 172.21.15.3:0/2896684997 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7276d9d700 1 --2- 172.21.15.3:0/2896684997 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f72780b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727659c700 1 --2- 172.21.15.3:0/2896684997 >> v2:172.21.15.27:3300/0 conn(0x7f727815c350 0x7f727806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 -- 172.21.15.3:0/2896684997 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 msgr2=0x7f72780b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:37.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 --2- 172.21.15.3:0/2896684997 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f72780b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 -- 172.21.15.3:0/2896684997 >> v2:172.21.15.27:3300/0 conn(0x7f727815c350 msgr2=0x7f727806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:37.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 --2- 172.21.15.3:0/2896684997 >> v2:172.21.15.27:3300/0 conn(0x7f727815c350 0x7f727806d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 -- 172.21.15.3:0/2896684997 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727806ec80 con 0x7f727806d600 2023-10-08T16:07:37.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f7275d9b700 1 --2- 172.21.15.3:0/2896684997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f72780b2a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72780ceba0 tx=0x7f726c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84872383763ee1ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:37.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727559a700 1 -- 172.21.15.3:0/2896684997 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00b860 con 0x7f727806d600 2023-10-08T16:07:37.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727559a700 1 -- 172.21.15.3:0/2896684997 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00b9c0 con 0x7f727806d600 2023-10-08T16:07:37.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727559a700 1 -- 172.21.15.3:0/2896684997 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00bd60 con 0x7f727806d600 2023-10-08T16:07:37.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 -- 172.21.15.3:0/2896684997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 msgr2=0x7f72780b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 --2- 172.21.15.3:0/2896684997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f72780b2a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72780ceba0 tx=0x7f726c009250 comp rx=0 tx=0).stop 2023-10-08T16:07:37.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 -- 172.21.15.3:0/2896684997 shutdown_connections 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 --2- 172.21.15.3:0/2896684997 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f72780b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 --2- 172.21.15.3:0/2896684997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f72780b2a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 --2- 172.21.15.3:0/2896684997 >> v2:172.21.15.27:3300/0 conn(0x7f727815c350 0x7f727806d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 -- 172.21.15.3:0/2896684997 >> 172.21.15.3:0/2896684997 conn(0x7f7278096eb0 msgr2=0x7f72780b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 -- 172.21.15.3:0/2896684997 shutdown_connections 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.090+0000 7f727759e700 1 -- 172.21.15.3:0/2896684997 wait complete. 2023-10-08T16:07:37.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 Processor -- start 2023-10-08T16:07:37.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 -- start start 2023-10-08T16:07:37.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f7278152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f727815c350 0x7f727816c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f727816c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72780c4450 con 0x7f727806d600 2023-10-08T16:07:37.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72780aaff0 con 0x7f727815c350 2023-10-08T16:07:37.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72781525a0 con 0x7f727815c720 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f7278152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f7278152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54856/0 (socket says 172.21.15.3:54856) 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 -- 172.21.15.3:0/3077950879 learned_addr learned my addr 172.21.15.3:0/3077950879 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f7275d9b700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f727815c350 0x7f727816c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f7276d9d700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f727816c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 -- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 msgr2=0x7f727816c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f727816c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 -- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f727815c350 msgr2=0x7f727816c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f727815c350 0x7f727816c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 -- 172.21.15.3:0/3077950879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0094f0 con 0x7f727806d600 2023-10-08T16:07:37.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727659c700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f7278152060 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f726800d860 tx=0x7f7268008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:37.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680125f0 con 0x7f727806d600 2023-10-08T16:07:37.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7268012750 con 0x7f727806d600 2023-10-08T16:07:37.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72780ab270 con 0x7f727806d600 2023-10-08T16:07:37.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268012b10 con 0x7f727806d600 2023-10-08T16:07:37.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.094+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72780ab830 con 0x7f727806d600 2023-10-08T16:07:37.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.098+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727804be40 con 0x7f727806d600 2023-10-08T16:07:37.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.098+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f726801e460 con 0x7f727806d600 2023-10-08T16:07:37.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.098+0000 7f72667fc700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7258060580 0x7f7258062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.098+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f726807cd70 con 0x7f727806d600 2023-10-08T16:07:37.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.098+0000 7f7275d9b700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7258060580 0x7f7258062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.098+0000 7f7275d9b700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7258060580 0x7f7258062a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72780ceba0 tx=0x7f726c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:37.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.106+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7268050d50 con 0x7f727806d600 2023-10-08T16:07:37.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.274+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) v1 -- 0x7f72780c4590 con 0x7f727806d600 2023-10-08T16:07:37.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.278+0000 7f72667fc700 1 -- 172.21.15.3:0/3077950879 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v11)=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f72680508e0 con 0x7f727806d600 2023-10-08T16:07:37.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7258060580 msgr2=0x7f7258062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7258060580 0x7f7258062a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72780ceba0 tx=0x7f726c017000 comp rx=0 tx=0).stop 2023-10-08T16:07:37.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 msgr2=0x7f7278152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f7278152060 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f726800d860 tx=0x7f7268008040 comp rx=0 tx=0).stop 2023-10-08T16:07:37.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 shutdown_connections 2023-10-08T16:07:37.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7258060580 0x7f7258062a30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f727815c720 0x7f727816c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f727815c350 0x7f727816c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 --2- 172.21.15.3:0/3077950879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f727806d600 0x7f7278152060 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f726800d860 tx=0x7f7268008040 comp rx=0 tx=0).stop 2023-10-08T16:07:37.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 >> 172.21.15.3:0/3077950879 conn(0x7f7278096eb0 msgr2=0x7f7278157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:37.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 shutdown_connections 2023-10-08T16:07:37.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.282+0000 7f727759e700 1 -- 172.21.15.3:0/3077950879 wait complete. 2023-10-08T16:07:37.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_cap_acquisition_throttle 37 2023-10-08T16:07:37.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 Processor -- start 2023-10-08T16:07:37.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 -- start start 2023-10-08T16:07:37.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f626406db60 0x7f626415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62640b37c0 0x7f62640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640b4140 con 0x7f6264158c80 2023-10-08T16:07:37.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626415a060 con 0x7f62640b37c0 2023-10-08T16:07:37.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6263fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626406bb50 con 0x7f626406db60 2023-10-08T16:07:37.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62627fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f626406db60 0x7f626415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62640b37c0 0x7f62640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62640b37c0 0x7f62640b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:39056/0 (socket says 172.21.15.3:39056) 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62627fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f626406db60 0x7f626415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:39780/0 (socket says 172.21.15.3:39780) 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 -- 172.21.15.3:0/1135340777 learned_addr learned my addr 172.21.15.3:0/1135340777 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6262ffd700 1 --1- 172.21.15.3:0/1135340777 >> v1:172.21.15.27:6789/0 conn(0x7f6264158c80 0x7f626406b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:57694/0 (socket says 172.21.15.3:57694) 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 -- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f626406db60 msgr2=0x7f626415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 --2- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f626406db60 0x7f626415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 -- 172.21.15.3:0/1135340777 >> v1:172.21.15.27:6789/0 conn(0x7f6264158c80 legacy=0x7f626406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 -- 172.21.15.3:0/1135340777 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640b45a0 con 0x7f62640b37c0 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f62637fe700 1 --2- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62640b37c0 0x7f62640b3c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f625c009f20 tx=0x7f625c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1674b25eb5028526 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6261ffb700 1 -- 172.21.15.3:0/1135340777 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00e070 con 0x7f62640b37c0 2023-10-08T16:07:37.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.402+0000 7f6261ffb700 1 -- 172.21.15.3:0/1135340777 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c00b9d0 con 0x7f62640b37c0 2023-10-08T16:07:37.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6261ffb700 1 -- 172.21.15.3:0/1135340777 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0092e0 con 0x7f62640b37c0 2023-10-08T16:07:37.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 -- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62640b37c0 msgr2=0x7f62640b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 --2- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62640b37c0 0x7f62640b3c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f625c009f20 tx=0x7f625c009840 comp rx=0 tx=0).stop 2023-10-08T16:07:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 -- 172.21.15.3:0/1135340777 shutdown_connections 2023-10-08T16:07:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 --2- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62640b37c0 0x7f62640b3c00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 --2- 172.21.15.3:0/1135340777 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f626406db60 0x7f626415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 -- 172.21.15.3:0/1135340777 >> 172.21.15.3:0/1135340777 conn(0x7f62640d0820 msgr2=0x7f62640b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 -- 172.21.15.3:0/1135340777 shutdown_connections 2023-10-08T16:07:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 -- 172.21.15.3:0/1135340777 wait complete. 2023-10-08T16:07:37.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 Processor -- start 2023-10-08T16:07:37.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.406+0000 7f6263fff700 1 -- start start 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f626406db60 0x7f62640ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62640b37c0 0x7f6264154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 0x7f6264169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640ccef0 con 0x7f6264158c80 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cf1a0 con 0x7f626406db60 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cd9d0 con 0x7f62640b37c0 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 0x7f6264169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 0x7f6264169120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54870/0 (socket says 172.21.15.3:54870) 2023-10-08T16:07:37.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 -- 172.21.15.3:0/107784675 learned_addr learned my addr 172.21.15.3:0/107784675 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6262ffd700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f626406db60 0x7f62640ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62627fc700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62640b37c0 0x7f6264154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 -- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62640b37c0 msgr2=0x7f6264154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62640b37c0 0x7f6264154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 -- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f626406db60 msgr2=0x7f62640ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f626406db60 0x7f62640ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 -- 172.21.15.3:0/107784675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009ae0 con 0x7f6264158c80 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f62637fe700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 0x7f6264169120 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f625c009430 tx=0x7f625c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c008c60 con 0x7f6264158c80 2023-10-08T16:07:37.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c008dc0 con 0x7f6264158c80 2023-10-08T16:07:37.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640cd0e0 con 0x7f6264158c80 2023-10-08T16:07:37.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c026690 con 0x7f6264158c80 2023-10-08T16:07:37.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62640cd380 con 0x7f6264158c80 2023-10-08T16:07:37.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.410+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626404be40 con 0x7f6264158c80 2023-10-08T16:07:37.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.414+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f625c003040 con 0x7f6264158c80 2023-10-08T16:07:37.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.414+0000 7f625affd700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6244060550 0x7f6244062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:37.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.414+0000 7f6262ffd700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6244060550 0x7f6244062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:37.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.414+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f625c07e810 con 0x7f6264158c80 2023-10-08T16:07:37.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.414+0000 7f6262ffd700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6244060550 0x7f6244062a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6254007fd0 tx=0x7f6254007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:37.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.422+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f625c04eeb0 con 0x7f6264158c80 2023-10-08T16:07:37.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.578+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_session_cap_acquisition_throttle}] v 0) v1 -- 0x7f6264068070 con 0x7f6264158c80 2023-10-08T16:07:37.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.590+0000 7f625affd700 1 -- 172.21.15.3:0/107784675 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_cap_acquisition_throttle}]=0 v12)=0 v12) v1 ==== 135+0+0 (secure 0 0 0) 0x7f625c0210c0 con 0x7f6264158c80 2023-10-08T16:07:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.590+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6244060550 msgr2=0x7f6244062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.590+0000 7f6263fff700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6244060550 0x7f6244062a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6254007fd0 tx=0x7f6254007d70 comp rx=0 tx=0).stop 2023-10-08T16:07:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 msgr2=0x7f6264169120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 0x7f6264169120 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f625c009430 tx=0x7f625c018000 comp rx=0 tx=0).stop 2023-10-08T16:07:37.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 shutdown_connections 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6244060550 0x7f6244062a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6264158c80 0x7f6264169120 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62640b37c0 0x7f6264154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 --2- 172.21.15.3:0/107784675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f626406db60 0x7f62640ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 >> 172.21.15.3:0/107784675 conn(0x7f62640d0820 msgr2=0x7f6264067060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 shutdown_connections 2023-10-08T16:07:37.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:07:37.594+0000 7f6263fff700 1 -- 172.21.15.3:0/107784675 wait complete. 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> n = 25 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:07:37.613 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/dir1/file" 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:37.614 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> if True: 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:37.615 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:07:37.616 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:38.074 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> n = 25 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/dir2/file" 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:07:38.075 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> if True: 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:38.076 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:07:38.077 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> n = 25 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:07:38.538 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/dir3/file" 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:07:38.539 DEBUG:teuthology.orchestra.run.smithi003:> if True: 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:07:38.540 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:07:38.541 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:39.041 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> n = 25 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/dir4/file" 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.042 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> if True: 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:07:39.043 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:07:39.044 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:39.503 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:39.503 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-10-08T16:07:39.503 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-10-08T16:07:39.504 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-10-08T16:07:39.505 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:07:39.588 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.42892.asok 2023-10-08T16:07:39.771 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42892.asok 2023-10-08T16:07:39.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:39.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42892.asok mds_sessions 2023-10-08T16:07:39.907 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5208, 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 5208 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:39.908 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 345787581 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.5208 v1:192.168.0.1:0/345787581", 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "v1:192.168.0.1:0/345787581", 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: "sessions": [ 2023-10-08T16:07:39.909 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": 0, 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: "addrs": { 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6834", 2023-10-08T16:07:39.910 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3934697799 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6835", 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3934697799 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:07:39.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "seq": 204, 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_gen": 0, 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_ttl": "2023-10-08T16:08:34.153417+0000", 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "last_cap_renew_request": "2023-10-08T16:07:34.153417+0000", 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_renew_seq": 2, 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "num_caps": 105, 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "open" 2023-10-08T16:07:39.912 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:07:39.913 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-10-08T16:07:39.913 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 12 2023-10-08T16:07:39.913 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:07:39.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:07:39.917 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'find . | wc') 2023-10-08T16:07:42.025 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:42.027 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:12.076 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:12.079 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: 105 105 1490 2023-10-08T16:08:18.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:19.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 Processor -- start 2023-10-08T16:08:19.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 -- start start 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa228158dd0 0x7fa2281591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 0x7fa22806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa228159d80 con 0x7fa22806c700 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22806b8b0 con 0x7fa228158dd0 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa22dec7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22806bb90 con 0x7fa22806d9d0 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 0x7fa22806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa2277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa228158dd0 0x7fa2281591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 0x7fa22806b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:40470/0 (socket says 172.21.15.3:40470) 2023-10-08T16:08:19.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 -- 172.21.15.3:0/563636281 learned_addr learned my addr 172.21.15.3:0/563636281 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:19.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa227fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa22806c700 0x7fa2280b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:43166/0 (socket says 172.21.15.3:43166) 2023-10-08T16:08:19.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa2277fe700 1 --2- 172.21.15.3:0/563636281 >> v2:172.21.15.27:3300/0 conn(0x7fa228158dd0 0x7fa2281591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:44364/0 (socket says 172.21.15.3:44364) 2023-10-08T16:08:19.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 -- 172.21.15.3:0/563636281 >> v2:172.21.15.27:3300/0 conn(0x7fa228158dd0 msgr2=0x7fa2281591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:19.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 --2- 172.21.15.3:0/563636281 >> v2:172.21.15.27:3300/0 conn(0x7fa228158dd0 0x7fa2281591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 -- 172.21.15.3:0/563636281 >> v1:172.21.15.27:6789/0 conn(0x7fa22806c700 legacy=0x7fa2280b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 -- 172.21.15.3:0/563636281 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228159a10 con 0x7fa22806d9d0 2023-10-08T16:08:19.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa226ffd700 1 --2- 172.21.15.3:0/563636281 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 0x7fa22806b000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa220009f20 tx=0x7fa220009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9acaa585f149d50e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa2267fc700 1 -- 172.21.15.3:0/563636281 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000e070 con 0x7fa22806d9d0 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa2267fc700 1 -- 172.21.15.3:0/563636281 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000b9d0 con 0x7fa22806d9d0 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.089+0000 7fa2267fc700 1 -- 172.21.15.3:0/563636281 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200092e0 con 0x7fa22806d9d0 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- 172.21.15.3:0/563636281 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 msgr2=0x7fa22806b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 --2- 172.21.15.3:0/563636281 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 0x7fa22806b000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa220009f20 tx=0x7fa220009840 comp rx=0 tx=0).stop 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- 172.21.15.3:0/563636281 shutdown_connections 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 --2- 172.21.15.3:0/563636281 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806d9d0 0x7fa22806b000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 --2- 172.21.15.3:0/563636281 >> v2:172.21.15.27:3300/0 conn(0x7fa228158dd0 0x7fa2281591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- 172.21.15.3:0/563636281 >> 172.21.15.3:0/563636281 conn(0x7fa2280d09d0 msgr2=0x7fa2280b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:19.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- 172.21.15.3:0/563636281 shutdown_connections 2023-10-08T16:08:19.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- 172.21.15.3:0/563636281 wait complete. 2023-10-08T16:08:19.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 Processor -- start 2023-10-08T16:08:19.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- start start 2023-10-08T16:08:19.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 0x7fa2281549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22806d9d0 0x7fa2280c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa228158dd0 0x7fa2280c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c6530 con 0x7fa228158dd0 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228154f00 con 0x7fa22806d9d0 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa22dec7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c59b0 con 0x7fa22806c700 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa227fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa228158dd0 0x7fa2280c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.093+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 0x7fa2281549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa227fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa228158dd0 0x7fa2280c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41366/0 (socket says 172.21.15.3:41366) 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 0x7fa2281549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:40474/0 (socket says 172.21.15.3:40474) 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa227fff700 1 -- 172.21.15.3:0/321611591 learned_addr learned my addr 172.21.15.3:0/321611591 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:19.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa226ffd700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22806d9d0 0x7fa2280c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 -- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22806d9d0 msgr2=0x7fa2280c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22806d9d0 0x7fa2280c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 -- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa228158dd0 msgr2=0x7fa2280c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa228158dd0 0x7fa2280c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 -- 172.21.15.3:0/321611591 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009ae0 con 0x7fa22806c700 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa2277fe700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 0x7fa2281549c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa21000e900 tx=0x7fa2100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210013680 con 0x7fa22806c700 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2100137e0 con 0x7fa22806c700 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2280c5c90 con 0x7fa22806c700 2023-10-08T16:08:19.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210013b80 con 0x7fa22806c700 2023-10-08T16:08:19.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2280c6250 con 0x7fa22806c700 2023-10-08T16:08:19.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.097+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22804be40 con 0x7fa22806c700 2023-10-08T16:08:19.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.101+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa210005a00 con 0x7fa22806c700 2023-10-08T16:08:19.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.101+0000 7fa21f7fe700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.101+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa21007ccc0 con 0x7fa22806c700 2023-10-08T16:08:19.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.101+0000 7fa226ffd700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.101+0000 7fa226ffd700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa220009880 tx=0x7fa220018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.109+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa21004d210 con 0x7fa22806c700 2023-10-08T16:08:19.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.309+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2281596e0 con 0x7fa22806c700 2023-10-08T16:08:19.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.309+0000 7fa21f7fe700 1 -- 172.21.15.3:0/321611591 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7fa210050830 con 0x7fa22806c700 2023-10-08T16:08:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:19.315 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:08:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 msgr2=0x7fa208062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa220009880 tx=0x7fa220018000 comp rx=0 tx=0).stop 2023-10-08T16:08:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 msgr2=0x7fa2281549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 0x7fa2281549c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa21000e900 tx=0x7fa2100091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 shutdown_connections 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa208060550 0x7fa208062a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa228158dd0 0x7fa2280c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22806d9d0 0x7fa2280c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 --2- 172.21.15.3:0/321611591 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa22806c700 0x7fa2281549c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 >> 172.21.15.3:0/321611591 conn(0x7fa2280d09d0 msgr2=0x7fa228155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 shutdown_connections 2023-10-08T16:08:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.313+0000 7fa22dec7700 1 -- 172.21.15.3:0/321611591 wait complete. 2023-10-08T16:08:19.319 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:08:19.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-08T16:08:19.444 INFO:teuthology.orchestra.run.smithi003.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":73,"msgr_send_messages":67,"msgr_recv_bytes":107149,"msgr_send_bytes":27993,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.014674583,"msgr_running_send_time":0.003064031,"msgr_running_recv_time":0.011812611,"msgr_running_fast_dispatch_time":0.001065809,"msgr_send_messages_queue_lat":{"avgcount":67,"sum":0.026950292,"avgtime":0.000402243},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":492,"msgr_send_messages":475,"msgr_recv_bytes":146046,"msgr_send_bytes":346309,"msgr_created_connections":9,"msgr_active_connections":7,"msgr_running_total_time":0.076289381,"msgr_running_send_time":0.034198130,"msgr_running_recv_time":0.050124773,"msgr_running_fast_dispatch_time":0.003902725,"msgr_send_messages_queue_lat":{"avgcount":473,"sum":0.017240087,"avgtime":0.000036448},"msgr_handle_ack_lat":{"avgcount":937,"sum":0.000324906,"avgtime":0.000000346}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":189,"msgr_send_messages":149,"msgr_recv_bytes":54398,"msgr_send_bytes":650894,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.030624772,"msgr_running_send_time":0.009563837,"msgr_running_recv_time":0.010431701,"msgr_running_fast_dispatch_time":0.009132054,"msgr_send_messages_queue_lat":{"avgcount":146,"sum":0.056434683,"avgtime":0.000386538},"msgr_handle_ack_lat":{"avgcount":57,"sum":0.000014170,"avgtime":0.000000248}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":256,"sum":0.126290347,"avgtime":0.000493321}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000015634,"avgtime":0.000007817}},"mds":{"request":130,"reply":130,"reply_latency":{"avgcount":130,"sum":39.131427633,"avgtime":0.301010981},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":114,"inodes_top":0,"inodes_bottom":114,"inodes_pin_tail":0,"inodes_pinned":114,"inodes_expired":0,"inodes_with_caps":100,"caps":101,"subtrees":2,"traverse":155,"traverse_hit":144,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":886,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":100,"root_rbytes":160,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":9,"ceph_cap_op_grant":103,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":204,"handle_client_caps_dirty":100,"handle_client_cap_release":1,"process_request_cap_release":105},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":313,"evex":0,"evtrm":0,"ev":313,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4790122,"rdpos":0,"jlat":{"avgcount":112,"sum":0.381068716,"avgtime":0.003402399},"replayed":0},"mds_mem":{"ino":117,"ino+":117,"ino-":0,"dir":16,"dir+":16,"dir-":0,"dn":114,"dn+":114,"dn-":0,"cap":101,"cap+":106,"cap-":5,"rss":45828,"heap":207072},"mds_server":{"dispatch_client_request":217,"dispatch_server_request":0,"handle_client_request":130,"handle_client_session":110,"handle_peer_request":0,"req_create_latency":{"avgcount":100,"sum":0.091881065,"avgtime":0.000918810},"req_getattr_latency":{"avgcount":17,"sum":0.006028483,"avgtime":0.000354616},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":3,"sum":0.000901209,"avgtime":0.000300403},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":4,"sum":0.009159106,"avgtime":0.002289776},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":5,"sum":39.022880881,"avgtime":7.804576176},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000576889,"avgtime":0.000576889},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":78,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":2,"session_add":2,"session_remove":0,"sessions_open":2,"sessions_stale":0,"total_load":82,"average_load":41,"avg_session_uptime":40,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":222133,"buffer_anon_items":87,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5240,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":376288,"mds_co_items":2313,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":154,"op_send_bytes":614846,"op_resend":27,"op_reply":154,"oplen_avg":{"avgcount":154,"sum":181},"op":154,"op_r":0,"op_w":154,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":112,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":32,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":19,"omap_rd":0,"omap_del":3},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":747,"get_sum":235222,"get_or_fail_fail":0,"get_or_fail_success":747,"take":0,"take_sum":0,"put":747,"put_sum":235222,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":154,"take_sum":614846,"put":154,"put_sum":614846,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":154,"take_sum":154,"put":154,"put_sum":154,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dbb1487e00":{"val":0,"max":3758096384,"get_started":0,"get":313,"get_sum":595818,"get_or_fail_fail":0,"get_or_fail_success":313,"take":0,"take_sum":0,"put":112,"put_sum":595818,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-08T16:08:19.446 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 107149, "msgr_recv_messages": 73, "msgr_running_fast_dispatch_time": 0.001065809, "msgr_running_recv_time": 0.011812611, "msgr_running_send_time": 0.003064031, "msgr_running_total_time": 0.014674583, "msgr_send_bytes": 27993, "msgr_send_messages": 67, "msgr_send_messages_queue_lat": { "avgcount": 67, "avgtime": 0.000402243, "sum": 0.026950292 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 7, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 937, "avgtime": 3.46e-07, "sum": 0.000324906 }, "msgr_recv_bytes": 146046, "msgr_recv_messages": 492, "msgr_running_fast_dispatch_time": 0.003902725, "msgr_running_recv_time": 0.050124773, "msgr_running_send_time": 0.03419813, "msgr_running_total_time": 0.076289381, "msgr_send_bytes": 346309, "msgr_send_messages": 475, "msgr_send_messages_queue_lat": { "avgcount": 473, "avgtime": 3.6448e-05, "sum": 0.017240087 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 57, "avgtime": 2.48e-07, "sum": 1.417e-05 }, "msgr_recv_bytes": 54398, "msgr_recv_messages": 189, "msgr_running_fast_dispatch_time": 0.009132054, "msgr_running_recv_time": 0.010431701, "msgr_running_send_time": 0.009563837, "msgr_running_total_time": 0.030624772, "msgr_send_bytes": 650894, "msgr_send_messages": 149, "msgr_send_messages_queue_lat": { "avgcount": 146, "avgtime": 0.000386538, "sum": 0.056434683 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 256, "avgtime": 0.000493321, "sum": 0.126290347 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 7.817e-06, "sum": 1.5634e-05 }, "queue_len": 0 }, "mds": { "caps": 101, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 103, "ceph_cap_op_revoke": 9, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 204, "handle_client_caps_dirty": 100, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 114, "inodes_bottom": 114, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 114, "inodes_top": 0, "inodes_with_caps": 100, "load_cent": 886, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 105, "q": 0, "reply": 130, "reply_latency": { "avgcount": 130, "avgtime": 0.301010981, "sum": 39.131427633 }, "request": 130, "root_rbytes": 160, "root_rfiles": 100, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 155, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 144, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 313, "evadd": 313, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 112, "avgtime": 0.003402399, "sum": 0.381068716 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4790122 }, "mds_mem": { "cap": 101, "cap+": 106, "cap-": 5, "dir": 16, "dir+": 16, "dir-": 0, "dn": 114, "dn+": 114, "dn-": 0, "heap": 207072, "ino": 117, "ino+": 117, "ino-": 0, "rss": 45828 }, "mds_server": { "cap_acquisition_throttle": 78, "cap_revoke_eviction": 0, "dispatch_client_request": 217, "dispatch_server_request": 0, "handle_client_request": 130, "handle_client_session": 110, "handle_peer_request": 0, "req_create_latency": { "avgcount": 100, "avgtime": 0.00091881, "sum": 0.091881065 }, "req_getattr_latency": { "avgcount": 17, "avgtime": 0.000354616, "sum": 0.006028483 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 3, "avgtime": 0.000300403, "sum": 0.000901209 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 4, "avgtime": 0.002289776, "sum": 0.009159106 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 5, "avgtime": 7.804576176, "sum": 39.022880881 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000576889, "sum": 0.000576889 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 41, "avg_session_uptime": 40, "mdthresh_evicted": 0, "session_add": 2, "session_count": 2, "session_remove": 0, "sessions_open": 2, "sessions_stale": 0, "total_load": 82 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 222133, "buffer_anon_items": 87, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 376288, "mds_co_items": 2313, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5240, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 32, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 0, "omap_wr": 19, "op": 154, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 154, "op_resend": 27, "op_rmw": 0, "op_send": 154, "op_send_bytes": 614846, "op_w": 154, "oplen_avg": { "avgcount": 154, "sum": 181 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 112, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 747, "get_or_fail_fail": 0, "get_or_fail_success": 747, "get_started": 0, "get_sum": 235222, "max": 104857600, "put": 747, "put_sum": 235222, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 154, "put_sum": 614846, "take": 154, "take_sum": 614846, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 154, "put_sum": 154, "take": 154, "take_sum": 154, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dbb1487e00": { "get": 313, "get_or_fail_fail": 0, "get_or_fail_success": 313, "get_started": 0, "get_sum": 595818, "max": 3758096384, "put": 112, "put_sum": 595818, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-08T16:08:19.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:19.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 Processor -- start 2023-10-08T16:08:19.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- start start 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2741592d0 0x7fc274067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2740675a0 0x7fc27406a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2740ca690 con 0x7fc274158f00 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc274067a20 con 0x7fc2740675a0 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740caf30 con 0x7fc2741592d0 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27a0e7700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc274158f00 0x7fc2740cb3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46610/0 (socket says 172.21.15.3:46610) 2023-10-08T16:08:19.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27a0e7700 1 -- 172.21.15.3:0/2920746067 learned_addr learned my addr 172.21.15.3:0/2920746067 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2798e6700 1 --2- 172.21.15.3:0/2920746067 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2741592d0 0x7fc274067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27a8e8700 1 --2- 172.21.15.3:0/2920746067 >> v2:172.21.15.27:3300/0 conn(0x7fc2740675a0 0x7fc27406a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2790e5700 1 -- 172.21.15.3:0/2920746067 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584504312 0 0) 0x7fc2740ca690 con 0x7fc274158f00 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2790e5700 1 -- 172.21.15.3:0/2920746067 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc260003570 con 0x7fc274158f00 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2790e5700 1 -- 172.21.15.3:0/2920746067 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181741145 0 0) 0x7fc260003570 con 0x7fc274158f00 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2798e6700 1 -- 172.21.15.3:0/2920746067 >> v2:172.21.15.27:3300/0 conn(0x7fc2740675a0 msgr2=0x7fc27406a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2798e6700 1 --2- 172.21.15.3:0/2920746067 >> v2:172.21.15.27:3300/0 conn(0x7fc2740675a0 0x7fc27406a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2798e6700 1 -- 172.21.15.3:0/2920746067 >> v1:172.21.15.3:6789/0 conn(0x7fc274158f00 legacy=0x7fc2740cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2798e6700 1 -- 172.21.15.3:0/2920746067 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27406b3a0 con 0x7fc2741592d0 2023-10-08T16:08:19.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2798e6700 1 --2- 172.21.15.3:0/2920746067 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2741592d0 0x7fc274067060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009e60 tx=0x7fc26c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518bd3821faa111 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:19.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2790e5700 1 -- 172.21.15.3:0/2920746067 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00e070 con 0x7fc2741592d0 2023-10-08T16:08:19.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2790e5700 1 -- 172.21.15.3:0/2920746067 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c00b7a0 con 0x7fc2741592d0 2023-10-08T16:08:19.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc2790e5700 1 -- 172.21.15.3:0/2920746067 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268001470 con 0x7fc2741592d0 2023-10-08T16:08:19.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- 172.21.15.3:0/2920746067 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2741592d0 msgr2=0x7fc274067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 --2- 172.21.15.3:0/2920746067 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2741592d0 0x7fc274067060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009e60 tx=0x7fc26c009780 comp rx=0 tx=0).stop 2023-10-08T16:08:19.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- 172.21.15.3:0/2920746067 shutdown_connections 2023-10-08T16:08:19.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 --2- 172.21.15.3:0/2920746067 >> v2:172.21.15.27:3300/0 conn(0x7fc2740675a0 0x7fc27406a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 --2- 172.21.15.3:0/2920746067 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2741592d0 0x7fc274067060 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- 172.21.15.3:0/2920746067 >> 172.21.15.3:0/2920746067 conn(0x7fc2740cfee0 msgr2=0x7fc2740d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:19.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- 172.21.15.3:0/2920746067 shutdown_connections 2023-10-08T16:08:19.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.549+0000 7fc27c34b700 1 -- 172.21.15.3:0/2920746067 wait complete. 2023-10-08T16:08:19.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 Processor -- start 2023-10-08T16:08:19.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 -- start start 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2740675a0 0x7fc2740b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 0x7fc2740c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2741592d0 0x7fc2741584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740c8930 con 0x7fc274158f00 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b2d70 con 0x7fc2741592d0 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27c34b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b3050 con 0x7fc2740675a0 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 0x7fc2740c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 0x7fc2740c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41378/0 (socket says 172.21.15.3:41378) 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 -- 172.21.15.3:0/1502694806 learned_addr learned my addr 172.21.15.3:0/1502694806 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27a8e8700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2741592d0 0x7fc2741584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27a0e7700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2740675a0 0x7fc2740b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 -- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2740675a0 msgr2=0x7fc2740b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2740675a0 0x7fc2740b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 -- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2741592d0 msgr2=0x7fc2741584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2741592d0 0x7fc2741584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 -- 172.21.15.3:0/1502694806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009a20 con 0x7fc274158f00 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc27a8e8700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2741592d0 0x7fc2741584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:19.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.553+0000 7fc2798e6700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 0x7fc2740c83f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00b610 tx=0x7fc26c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:19.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00be80 con 0x7fc274158f00 2023-10-08T16:08:19.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c012bd0 con 0x7fc274158f00 2023-10-08T16:08:19.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc274158a20 con 0x7fc274158f00 2023-10-08T16:08:19.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c01e430 con 0x7fc274158f00 2023-10-08T16:08:19.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc274169610 con 0x7fc274158f00 2023-10-08T16:08:19.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27404be40 con 0x7fc274158f00 2023-10-08T16:08:19.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc26c01e7a0 con 0x7fc274158f00 2023-10-08T16:08:19.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc2667fc700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc258060550 0x7fc258062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:19.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc26c07e330 con 0x7fc274158f00 2023-10-08T16:08:19.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc27a0e7700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc258060550 0x7fc258062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:19.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.557+0000 7fc27a0e7700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc258060550 0x7fc258062a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc268004e60 tx=0x7fc268001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:19.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.565+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc26c04e920 con 0x7fc274158f00 2023-10-08T16:08:19.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.761+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc27406bc20 con 0x7fc274158f00 2023-10-08T16:08:19.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.761+0000 7fc2667fc700 1 -- 172.21.15.3:0/1502694806 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7fc26c051f40 con 0x7fc274158f00 2023-10-08T16:08:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:19.768 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:08:19.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc258060550 msgr2=0x7fc258062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc258060550 0x7fc258062a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc268004e60 tx=0x7fc268001a10 comp rx=0 tx=0).stop 2023-10-08T16:08:19.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 msgr2=0x7fc2740c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 0x7fc2740c83f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00b610 tx=0x7fc26c018000 comp rx=0 tx=0).stop 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 shutdown_connections 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc258060550 0x7fc258062a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2741592d0 0x7fc2741584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc274158f00 0x7fc2740c83f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 --2- 172.21.15.3:0/1502694806 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc2740675a0 0x7fc2740b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 >> 172.21.15.3:0/1502694806 conn(0x7fc2740cfee0 msgr2=0x7fc2740cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 shutdown_connections 2023-10-08T16:08:19.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:19.765+0000 7fc27c34b700 1 -- 172.21.15.3:0/1502694806 wait complete. 2023-10-08T16:08:19.772 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:08:19.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-08T16:08:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:[{"id":5149,"entity":{"name":{"type":"client","num":5149},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2535779045}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":44.443342244,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.7166545744977029,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5149 192.168.0.1:0/2535779045","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017ffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"08cac0187919fc3a247efdf445f652e2fb30a647","ceph_version":"ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)","entity_id":"1","hostname":"smithi027","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"39739","root":"/"}},{"id":5208,"entity":{"name":{"type":"client","num":5208},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":345787581}},"state":"open","num_leases":0,"num_caps":100,"request_load_avg":80,"uptime":46.731297312000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":6.3292202927113221,"halflife":60},"release_caps":{"value":3.2201701582789632,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":294.94332233848451,"halflife":300},"cap_acquisition":{"value":60.482906532538486,"halflife":30},"last_trim_completed_requests_tid":128,"last_trim_completed_flushes_tid":101,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5208 192.168.0.1:0/345787581","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000025c","length":899}],"client_metadata":{"client_features":{"feature_bits":"0x000000000017ffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"08cac0187919fc3a247efdf445f652e2fb30a647","ceph_version":"ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)","entity_id":"0","hostname":"smithi003","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"42892","root":"/"}}] 2023-10-08T16:08:19.898 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", "client_features": { "feature_bits": "0x000000000017ffff" }, "entity_id": "1", "hostname": "smithi027", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "39739", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2535779045, "type": "any" }, "name": { "num": 5149, "type": "client" } }, "id": 5149, "inst": "client.5149 192.168.0.1:0/2535779045", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.716654574497703 }, "state": "open", "uptime": 44.443342244 }, { "cap_acquisition": { "halflife": 30, "value": 60.482906532538486 }, "client_metadata": { "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", "client_features": { "feature_bits": "0x000000000017ffff" }, "entity_id": "0", "hostname": "smithi003", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "42892", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 345787581, "type": "any" }, "name": { "num": 5208, "type": "client" } }, "id": 5208, "inst": "client.5208 192.168.0.1:0/345787581", "last_trim_completed_flushes_tid": 101, "last_trim_completed_requests_tid": 128, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 899, "start": "0x1000000025c" } ], "recall_caps": { "halflife": 60, "value": 6.329220292711322 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 3.2201701582789632 }, "request_load_avg": 80, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 294.9433223384845 }, "state": "open", "uptime": 46.731297312 } ] 2023-10-08T16:08:19.898 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump_historic_ops 2023-10-08T16:08:20.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.005+0000 7efe04af0700 1 Processor -- start 2023-10-08T16:08:20.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.005+0000 7efe04af0700 1 -- start start 2023-10-08T16:08:20.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efe00159d40 0x7efe00068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efe000687c0 0x7efe000c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe00068c00 con 0x7efe0013eed0 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000c7fb0 con 0x7efe00159d40 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000c8290 con 0x7efe000687c0 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdff7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7efe0013eed0 0x7efe000c7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33816/0 (socket says 172.21.15.3:33816) 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdff7fe700 1 -- 172.21.15.3:0/1682780217 learned_addr learned my addr 172.21.15.3:0/1682780217 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1682780217 >> v2:172.21.15.3:3300/0 conn(0x7efe00159d40 0x7efe00068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfffff700 1 --2- 172.21.15.3:0/1682780217 >> v2:172.21.15.27:3300/0 conn(0x7efe000687c0 0x7efe000c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfe7fc700 1 -- 172.21.15.3:0/1682780217 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807275321 0 0) 0x7efe00068c00 con 0x7efe0013eed0 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfe7fc700 1 -- 172.21.15.3:0/1682780217 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde8003570 con 0x7efe0013eed0 2023-10-08T16:08:20.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfeffd700 1 -- 172.21.15.3:0/1682780217 >> v2:172.21.15.27:3300/0 conn(0x7efe000687c0 msgr2=0x7efe000c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1682780217 >> v2:172.21.15.27:3300/0 conn(0x7efe000687c0 0x7efe000c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfeffd700 1 -- 172.21.15.3:0/1682780217 >> v1:172.21.15.3:6789/0 conn(0x7efe0013eed0 legacy=0x7efe000c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfeffd700 1 -- 172.21.15.3:0/1682780217 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000c8570 con 0x7efe00159d40 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfffff700 1 --2- 172.21.15.3:0/1682780217 >> v2:172.21.15.27:3300/0 conn(0x7efe000687c0 0x7efe000c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1682780217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe00159d40 0x7efe00068280 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe00069e80 tx=0x7efdf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273693284314ad15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfe7fc700 1 -- 172.21.15.3:0/1682780217 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4010600 con 0x7efe00159d40 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfe7fc700 1 -- 172.21.15.3:0/1682780217 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4010760 con 0x7efe00159d40 2023-10-08T16:08:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efdfe7fc700 1 -- 172.21.15.3:0/1682780217 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4010ae0 con 0x7efe00159d40 2023-10-08T16:08:20.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 -- 172.21.15.3:0/1682780217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe00159d40 msgr2=0x7efe00068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.009+0000 7efe04af0700 1 --2- 172.21.15.3:0/1682780217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe00159d40 0x7efe00068280 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe00069e80 tx=0x7efdf40091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- 172.21.15.3:0/1682780217 shutdown_connections 2023-10-08T16:08:20.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 --2- 172.21.15.3:0/1682780217 >> v2:172.21.15.27:3300/0 conn(0x7efe000687c0 0x7efe000c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 --2- 172.21.15.3:0/1682780217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe00159d40 0x7efe00068280 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- 172.21.15.3:0/1682780217 >> 172.21.15.3:0/1682780217 conn(0x7efe000c8c90 msgr2=0x7efe000c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- 172.21.15.3:0/1682780217 shutdown_connections 2023-10-08T16:08:20.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- 172.21.15.3:0/1682780217 wait complete. 2023-10-08T16:08:20.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 Processor -- start 2023-10-08T16:08:20.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- start start 2023-10-08T16:08:20.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 0x7efe000c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe0013eed0 0x7efe0016a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe00159d40 0x7efe001547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00155980 con 0x7efe000687c0 2023-10-08T16:08:20.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000ae140 con 0x7efe00159d40 2023-10-08T16:08:20.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efe04af0700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000ae420 con 0x7efe0013eed0 2023-10-08T16:08:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 0x7efe000c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 0x7efe000c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58952/0 (socket says 172.21.15.3:58952) 2023-10-08T16:08:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efdff7fe700 1 -- 172.21.15.3:0/1156424868 learned_addr learned my addr 172.21.15.3:0/1156424868 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe0013eed0 0x7efe0016a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.013+0000 7efdfffff700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe00159d40 0x7efe001547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdff7fe700 1 -- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe0013eed0 msgr2=0x7efe0016a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdff7fe700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe0013eed0 0x7efe0016a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdff7fe700 1 -- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe00159d40 msgr2=0x7efe001547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdff7fe700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe00159d40 0x7efe001547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdff7fe700 1 -- 172.21.15.3:0/1156424868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009420 con 0x7efe000687c0 2023-10-08T16:08:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe0013eed0 0x7efe0016a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efdff7fe700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 0x7efe000c5230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efdf00011e0 tx=0x7efdf0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efde77fe700 1 -- 172.21.15.3:0/1156424868 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0005b30 con 0x7efe000687c0 2023-10-08T16:08:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efde77fe700 1 -- 172.21.15.3:0/1156424868 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0005c90 con 0x7efe000687c0 2023-10-08T16:08:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe00155c20 con 0x7efe000687c0 2023-10-08T16:08:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efde77fe700 1 -- 172.21.15.3:0/1156424868 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0007320 con 0x7efe000687c0 2023-10-08T16:08:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000c5770 con 0x7efe000687c0 2023-10-08T16:08:20.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.017+0000 7efde77fe700 1 -- 172.21.15.3:0/1156424868 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efdf0007690 con 0x7efe000687c0 2023-10-08T16:08:20.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efde77fe700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efdec060550 0x7efdec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efde77fe700 1 -- 172.21.15.3:0/1156424868 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdf007bc70 con 0x7efe000687c0 2023-10-08T16:08:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efdec060550 0x7efdec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efdec060550 0x7efdec062a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efdf40091e0 tx=0x7efdf4018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 Processor -- start 2023-10-08T16:08:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 -- start start 2023-10-08T16:08:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 0x2ad9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2ad98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x28a7850 0x2ad9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a0aab0 con 0x285cba0 2023-10-08T16:08:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a08080 con 0x285c7d0 2023-10-08T16:08:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a04020 con 0x28a7850 2023-10-08T16:08:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 0x2ad9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 0x2ad9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58968/0 (socket says 172.21.15.3:58968) 2023-10-08T16:08:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdff7fe700 1 -- 172.21.15.3:0/2980574079 learned_addr learned my addr 172.21.15.3:0/2980574079 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdfeffd700 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2ad98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.021+0000 7efdfffff700 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x28a7850 0x2ad9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efdff7fe700 1 -- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x28a7850 msgr2=0x2ad9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efdff7fe700 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x28a7850 0x2ad9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efdff7fe700 1 -- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 msgr2=0x2ad98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efdff7fe700 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2ad98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efdff7fe700 1 -- 172.21.15.3:0/2980574079 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28a8aa0 con 0x285cba0 2023-10-08T16:08:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efdff7fe700 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 0x2ad9380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efdf004feb0 tx=0x7efdf007a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6078525e74ef945e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efde4ff9700 1 -- 172.21.15.3:0/2980574079 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0056f00 con 0x285cba0 2023-10-08T16:08:20.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efde4ff9700 1 -- 172.21.15.3:0/2980574079 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0005e00 con 0x285cba0 2023-10-08T16:08:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efde4ff9700 1 -- 172.21.15.3:0/2980574079 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf004e060 con 0x285cba0 2023-10-08T16:08:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- 172.21.15.3:0/2980574079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 msgr2=0x2ad9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 0x2ad9380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efdf004feb0 tx=0x7efdf007a0f0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- 172.21.15.3:0/2980574079 shutdown_connections 2023-10-08T16:08:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x28a7850 0x2ad9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2ad98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- 172.21.15.3:0/2980574079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285cba0 0x2ad9380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- 172.21.15.3:0/2980574079 >> 172.21.15.3:0/2980574079 conn(0x285cf70 msgr2=0x2a96a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- 172.21.15.3:0/2980574079 shutdown_connections 2023-10-08T16:08:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- 172.21.15.3:0/2980574079 wait complete. 2023-10-08T16:08:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- start start 2023-10-08T16:08:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 Processor -- start 2023-10-08T16:08:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 0x2add990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2added0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x28a7850 0x2a93cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ca210 con 0x285c7d0 2023-10-08T16:08:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x29c9eb0 con 0x28a7850 2023-10-08T16:08:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.025+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x29a2a10 con 0x285cba0 2023-10-08T16:08:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 10 client.0 _ll_register_callbacks cb 0x29a6cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:08:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 0x2add990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 0x2add990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58984/0 (socket says 172.21.15.3:58984) 2023-10-08T16:08:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 -- 172.21.15.3:0/4266568604 learned_addr learned my addr 172.21.15.3:0/4266568604 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdfffff700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x28a7850 0x2a93cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdfeffd700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2added0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 -- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 msgr2=0x2added0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2added0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 -- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x28a7850 msgr2=0x2a93cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x28a7850 0x2a93cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 -- 172.21.15.3:0/4266568604 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000c5770 con 0x285c7d0 2023-10-08T16:08:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdff7fe700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 0x2add990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efdf007a270 tx=0x7efdf0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58904eb7722a590 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 1 -- 172.21.15.3:0/4266568604 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0056f00 con 0x285c7d0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29a6530 con 0x285c7d0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 1 -- 172.21.15.3:0/4266568604 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdf004e060 con 0x285c7d0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 1 -- 172.21.15.3:0/4266568604 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdf00503d0 con 0x285c7d0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 10 client.5253 fetch_fsmap learned FSMap version 12 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x29d2410 con 0x285c7d0 2023-10-08T16:08:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 1 -- 172.21.15.3:0/4266568604 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0070080 con 0x285c7d0 2023-10-08T16:08:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 1 -- 172.21.15.3:0/4266568604 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efdf004f410 con 0x285c7d0 2023-10-08T16:08:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 10 client.5253 fetch_fsmap finished waiting for FSMap version 12 2023-10-08T16:08:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 10 client.5253 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2023-10-08T16:08:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 20 client.5253 populate_metadata read hostname 'smithi003' 2023-10-08T16:08:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2ae6b20 0x2ae8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 4 client.5253 mds_command: new command op to 5001 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:08:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 --> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29a6250 con 0x2ae6b20 2023-10-08T16:08:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdfeffd700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2ae6b20 0x2ae8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 10 client.5253 ms_handle_connect on v2:172.21.15.3:6834/3934697799 2023-10-08T16:08:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdfeffd700 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2ae6b20 0x2ae8f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58db35addbd6f00a server_cookie=64d1e3450bf9b09b in_seq=0 out_seq=0 2023-10-08T16:08:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 1 -- 172.21.15.3:0/4266568604 <== mds.0 v2:172.21.15.3:6834/3934697799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x29a6250 con 0x2ae6b20 2023-10-08T16:08:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 10 client.5253 handle_command_reply: tid=0 2023-10-08T16:08:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 client.5253 shutdown 2023-10-08T16:08:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 msgr2=0x2add990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 0x2add990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efdf007a270 tx=0x7efdf0013000 comp rx=0 tx=0).stop 2023-10-08T16:08:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 shutdown_connections 2023-10-08T16:08:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2ae6b20 0x2ae8f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x28a7850 0x2a93cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efdddffb700 0 client.5253 ms_handle_reset on v2:172.21.15.3:6834/3934697799 2023-10-08T16:08:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2added0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 --2- 172.21.15.3:0/4266568604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x285c7d0 0x2add990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 >> 172.21.15.3:0/4266568604 conn(0x285cf70 msgr2=0x2abeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.029+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 shutdown_connections 2023-10-08T16:08:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.033+0000 7efe07ffb740 1 -- 172.21.15.3:0/4266568604 wait complete. 2023-10-08T16:08:20.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.033+0000 7efe07ffb740 20 client.5253 trim_cache size 0 max 16384 2023-10-08T16:08:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.045+0000 7efe07ffb740 1 Processor -- start 2023-10-08T16:08:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.045+0000 7efe07ffb740 1 -- start start 2023-10-08T16:08:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2b32f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2b334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2b33a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a02eb0 con 0x28a7850 2023-10-08T16:08:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a09040 con 0x285c7d0 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d5880 con 0x285cba0 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2b33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2b33a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58994/0 (socket says 172.21.15.3:58994) 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2b32f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 -- 172.21.15.3:0/818136702 learned_addr learned my addr 172.21.15.3:0/818136702 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfeffd700 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2b334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 -- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 msgr2=0x2b334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2b334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 -- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 msgr2=0x2b32f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2b32f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 -- 172.21.15.3:0/818136702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29b8e20 con 0x28a7850 2023-10-08T16:08:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efdfffff700 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2b33a10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efdf8007910 tx=0x7efdf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb36b8cc9e662614 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efde57fa700 1 -- 172.21.15.3:0/818136702 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8017620 con 0x28a7850 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efde57fa700 1 -- 172.21.15.3:0/818136702 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800f040 con 0x28a7850 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efde57fa700 1 -- 172.21.15.3:0/818136702 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8017990 con 0x28a7850 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- 172.21.15.3:0/818136702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 msgr2=0x2b33a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2b33a10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efdf8007910 tx=0x7efdf800b040 comp rx=0 tx=0).stop 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- 172.21.15.3:0/818136702 shutdown_connections 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2b33a10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2b334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- 172.21.15.3:0/818136702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2b32f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- 172.21.15.3:0/818136702 >> 172.21.15.3:0/818136702 conn(0x285cf70 msgr2=0x2a954f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- 172.21.15.3:0/818136702 shutdown_connections 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- 172.21.15.3:0/818136702 wait complete. 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 -- start start 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 Processor -- start 2023-10-08T16:08:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2a92280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.049+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2a927c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2af28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x29d7670 con 0x28a7850 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a019e0 con 0x285c7d0 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x29dbc90 con 0x285cba0 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 10 client.0 _ll_register_callbacks cb 0x29a53a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:08:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2af28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2a92280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2af28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59002/0 (socket says 172.21.15.3:59002) 2023-10-08T16:08:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 -- 172.21.15.3:0/1151620912 learned_addr learned my addr 172.21.15.3:0/1151620912 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfeffd700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2a927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 -- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 msgr2=0x2a927c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2a927c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 -- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 msgr2=0x2a92280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2a92280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 -- 172.21.15.3:0/1151620912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf8007640 con 0x28a7850 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdff7fe700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2a92280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdfffff700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2af28d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efdf8017aa0 tx=0x7efdf801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1411d396ed1433 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:08:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 1 -- 172.21.15.3:0/1151620912 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8017e20 con 0x28a7850 2023-10-08T16:08:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efdf0005e00 con 0x28a7850 2023-10-08T16:08:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 1 -- 172.21.15.3:0/1151620912 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdf8007440 con 0x28a7850 2023-10-08T16:08:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 1 -- 172.21.15.3:0/1151620912 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdf802ace0 con 0x28a7850 2023-10-08T16:08:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 10 client.5259 fetch_fsmap learned FSMap version 12 2023-10-08T16:08:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x29ad1d0 con 0x28a7850 2023-10-08T16:08:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 1 -- 172.21.15.3:0/1151620912 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0005e00 con 0x28a7850 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 1 -- 172.21.15.3:0/1151620912 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efdf801d020 con 0x28a7850 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 10 client.5259 fetch_fsmap finished waiting for FSMap version 12 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 10 client.5259 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 20 client.5259 populate_metadata read hostname 'smithi003' 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2af3290 0x2b3f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 4 client.5259 mds_command: new command op to 5001 tid=0[{"prefix": "dump_historic_ops"}] 2023-10-08T16:08:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 --> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] -- command(tid 0: {"prefix": "dump_historic_ops"}) v1 -- 0x28b45a0 con 0x2af3290 2023-10-08T16:08:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdff7fe700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2af3290 0x2b3f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdddffb700 10 client.5259 ms_handle_connect on v2:172.21.15.3:6834/3934697799 2023-10-08T16:08:20.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.053+0000 7efdff7fe700 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2af3290 0x2b3f220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f8d51b9cfae2c8f server_cookie=3203ac98d662e5d4 in_seq=0 out_seq=0 2023-10-08T16:08:20.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efdddffb700 1 -- 172.21.15.3:0/1151620912 <== mds.0 v2:172.21.15.3:6834/3934697799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69168 (crc 0 0 0) 0x28b45a0 con 0x2af3290 2023-10-08T16:08:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efdddffb700 10 client.5259 handle_command_reply: tid=0 2023-10-08T16:08:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 client.5259 shutdown 2023-10-08T16:08:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 msgr2=0x2af28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2af28d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efdf8017aa0 tx=0x7efdf801f000 comp rx=0 tx=0).stop 2023-10-08T16:08:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 shutdown_connections 2023-10-08T16:08:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:6834/3934697799,v1:172.21.15.3:6835/3934697799] conn(0x2af3290 0x2b3f220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28a7850 0x2af28d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efdddffb700 0 client.5259 ms_handle_reset on v2:172.21.15.3:6834/3934697799 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x285cba0 0x2a927c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 --2- 172.21.15.3:0/1151620912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x285c7d0 0x2a92280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 >> 172.21.15.3:0/1151620912 conn(0x285cf70 msgr2=0x2adbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 shutdown_connections 2023-10-08T16:08:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 1 -- 172.21.15.3:0/1151620912 wait complete. 2023-10-08T16:08:20.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.057+0000 7efe07ffb740 20 client.5259 trim_cache size 0 max 16384 2023-10-08T16:08:20.075 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:08:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: "size": 20, 2023-10-08T16:08:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 600, 2023-10-08T16:08:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: "ops": [ 2023-10-08T16:08:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:2 setattr mode=041777 #0x1 2023-10-08T16:07:34.726026+0000 caller_uid=0, caller_gid=0{0,})", 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:34.726204+0000", 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 45.334471264999998, 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.21178572200000001, 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:2", 2023-10-08T16:08:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 2 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726204+0000", 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726205+0000", 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726204+0000", 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726221+0000", 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726296+0000", 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726616+0000", 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726791+0000", 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.726793+0000", 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.937691+0000", 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.937775+0000", 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.937938+0000", 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.937988+0000", 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:34.937989+0000", 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:5 create owner_uid=1000, owner_gid=1267 #0x10000000000/file_0 2023-10-08T16:07:37.701200+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:37.701389+0000", 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 42.359285438000001, 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.012162206, 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:5", 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 5 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.701389+0000", 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.701391+0000", 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.701389+0000", 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.701404+0000", 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.701436+0000", 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.701673+0000", 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "failed to rdlock, waiting" 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.702016+0000", 2023-10-08T16:08:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.702324+0000", 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.702325+0000", 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.713185+0000", 2023-10-08T16:08:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.713415+0000", 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.713497+0000", 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.713551+0000", 2023-10-08T16:08:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.713552+0000", 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:15 create owner_uid=1000, owner_gid=1267 #0x10000000000/file_10 2023-10-08T16:07:37.783202+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:37.783362+0000", 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 42.277312803000001, 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.010992487, 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:15", 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 15 2023-10-08T16:08:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.783362+0000", 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.783363+0000", 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.783362+0000", 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.783373+0000", 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.783424+0000", 2023-10-08T16:08:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.783658+0000", 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.784313+0000", 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.784314+0000", 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.793654+0000", 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.794013+0000", 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.794201+0000", 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.794352+0000", 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.794355+0000", 2023-10-08T16:08:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:23 create owner_uid=1000, owner_gid=1267 #0x10000000000/file_18 2023-10-08T16:07:37.850190+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:37.850387+0000", 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 42.210288235, 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0090323580000000007, 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:23", 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 23 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.850387+0000", 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.850388+0000", 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.850387+0000", 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.850399+0000", 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.850463+0000", 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.850683+0000", 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.851266+0000", 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.851267+0000", 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.858869+0000", 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.859128+0000", 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.859296+0000", 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.859417+0000", 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.859419+0000", 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.101 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:29 create owner_uid=1000, owner_gid=1267 #0x10000000000/file_24 2023-10-08T16:07:37.900124+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:37.900290+0000", 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 42.160384491000002, 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0086819810000000001, 2023-10-08T16:08:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:29", 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 29 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.900290+0000", 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.900292+0000", 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.900290+0000", 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.900305+0000", 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.900346+0000", 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.900557+0000", 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.901298+0000", 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.901299+0000", 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.908510+0000", 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.908785+0000", 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.908884+0000", 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.908971+0000", 2023-10-08T16:08:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:37.908972+0000", 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:32 mkdir owner_uid=1000, owner_gid=1267 #0x1/dir2 2023-10-08T16:07:38.162572+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.162705+0000", 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.897970131000001, 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.011860605, 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:32", 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 32 2023-10-08T16:08:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.162705+0000", 2023-10-08T16:08:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.162706+0000", 2023-10-08T16:08:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.162705+0000", 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.162719+0000", 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.162782+0000", 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.163495+0000", 2023-10-08T16:08:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.164254+0000", 2023-10-08T16:08:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.164257+0000", 2023-10-08T16:08:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174288+0000", 2023-10-08T16:08:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174438+0000", 2023-10-08T16:08:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174527+0000", 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174565+0000", 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174565+0000", 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:33 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_0 2023-10-08T16:07:38.165804+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.166055+0000", 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.894619388000002, 2023-10-08T16:08:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0088376340000000005, 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:33", 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 33 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.166055+0000", 2023-10-08T16:08:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.166057+0000", 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.166055+0000", 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.166071+0000", 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.166141+0000", 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.166738+0000", 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "failed to rdlock, waiting" 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.167304+0000", 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.168204+0000", 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.168206+0000", 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174569+0000", 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174750+0000", 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174828+0000", 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174892+0000", 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.174893+0000", 2023-10-08T16:08:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:43 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_10 2023-10-08T16:07:38.250578+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.250773+0000", 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.809901607, 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0091411789999999993, 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:43", 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 43 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.250773+0000", 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.250774+0000", 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.250773+0000", 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.250783+0000", 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.250826+0000", 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.251195+0000", 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.252266+0000", 2023-10-08T16:08:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.252268+0000", 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.259127+0000", 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.259514+0000", 2023-10-08T16:08:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.259747+0000", 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.259911+0000", 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.259914+0000", 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:44 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_11 2023-10-08T16:07:38.261011+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.261195+0000", 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.799479533000003, 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0085096939999999999, 2023-10-08T16:08:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:44", 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 44 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.261195+0000", 2023-10-08T16:08:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.261196+0000", 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.261195+0000", 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.261205+0000", 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.261252+0000", 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.261526+0000", 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.262309+0000", 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.262310+0000", 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.269019+0000", 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.269369+0000", 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.269564+0000", 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.269702+0000", 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.269705+0000", 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:45 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_12 2023-10-08T16:07:38.270824+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.270987+0000", 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.789687397999998, 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0084906719999999995, 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:45", 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 45 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.270987+0000", 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.270988+0000", 2023-10-08T16:08:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.270987+0000", 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.270998+0000", 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.271040+0000", 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.271269+0000", 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.271927+0000", 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.271927+0000", 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.278826+0000", 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.279136+0000", 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.279333+0000", 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.279475+0000", 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.279478+0000", 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:46 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_13 2023-10-08T16:07:38.280664+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.280883+0000", 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.779791824999997, 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0088343620000000001, 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:46", 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 46 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.280883+0000", 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.280884+0000", 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.280883+0000", 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.280897+0000", 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.280957+0000", 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.281216+0000", 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.281945+0000", 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.281947+0000", 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.289059+0000", 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.289440+0000", 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.289603+0000", 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.289716+0000", 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.289717+0000", 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:49 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_16 2023-10-08T16:07:38.308779+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.308982+0000", 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.751692968999997, 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.011197962000000001, 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:49", 2023-10-08T16:08:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 49 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.308982+0000", 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.308983+0000", 2023-10-08T16:08:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.308982+0000", 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.308994+0000", 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.309056+0000", 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.309284+0000", 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.309985+0000", 2023-10-08T16:08:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.309986+0000", 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.319646+0000", 2023-10-08T16:08:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.319886+0000", 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.320040+0000", 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.320177+0000", 2023-10-08T16:08:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.320180+0000", 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:50 create owner_uid=1000, owner_gid=1267 #0x1000000020e/file_17 2023-10-08T16:07:38.321355+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.321501+0000", 2023-10-08T16:08:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.739173856000001, 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0094238050000000004, 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:50", 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 50 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.321501+0000", 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.321502+0000", 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.321501+0000", 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.321516+0000", 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.321556+0000", 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.321736+0000", 2023-10-08T16:08:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.322279+0000", 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.322280+0000", 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.330226+0000", 2023-10-08T16:08:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.330551+0000", 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.330775+0000", 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.330923+0000", 2023-10-08T16:08:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.330925+0000", 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:60 mkdir owner_uid=1000, owner_gid=1267 #0x1/dir3 2023-10-08T16:07:38.665126+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:38.665399+0000", 2023-10-08T16:08:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 41.395276138, 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.010494798, 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:60", 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 60 2023-10-08T16:08:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.665399+0000", 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.665400+0000", 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.665399+0000", 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.665412+0000", 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.665475+0000", 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.665999+0000", 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.666585+0000", 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.666588+0000", 2023-10-08T16:08:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.675532+0000", 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.675713+0000", 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.675840+0000", 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.675893+0000", 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:38.675894+0000", 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:88 mkdir owner_uid=1000, owner_gid=1267 #0x1/dir4 2023-10-08T16:07:39.127315+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:39.127420+0000", 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 40.933254976000001, 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.010537032999999999, 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:88", 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 88 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.127420+0000", 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.127421+0000", 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.127420+0000", 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.127434+0000", 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.127478+0000", 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.128149+0000", 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.128939+0000", 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.128940+0000", 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.137587+0000", 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.137778+0000", 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.137898+0000", 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.137956+0000", 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.137957+0000", 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:101 create owner_uid=1000, owner_gid=1267 #0x10000000242/file_12 2023-10-08T16:07:39.222668+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:39.222891+0000", 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 40.837783532000003, 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0098800369999999995, 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:101", 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 101 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.222891+0000", 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.222893+0000", 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.222891+0000", 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.222906+0000", 2023-10-08T16:08:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.222946+0000", 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.223106+0000", 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.223653+0000", 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.223654+0000", 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.232425+0000", 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.232631+0000", 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.232718+0000", 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.232770+0000", 2023-10-08T16:08:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.232771+0000", 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:104 create owner_uid=1000, owner_gid=1267 #0x10000000242/file_15 2023-10-08T16:07:39.251421+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:39.251620+0000", 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 40.809054521, 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0087154329999999999, 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:104", 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 104 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.251620+0000", 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.251621+0000", 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.251620+0000", 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.251633+0000", 2023-10-08T16:08:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.251668+0000", 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.251832+0000", 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.252362+0000", 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.252363+0000", 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.259806+0000", 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.260095+0000", 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.260213+0000", 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.260333+0000", 2023-10-08T16:08:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.260336+0000", 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:113 create owner_uid=1000, owner_gid=1267 #0x10000000242/file_24 2023-10-08T16:07:39.323214+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:39.323358+0000", 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 40.737317128999997, 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 0.0093820569999999992, 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:113", 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 113 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.323358+0000", 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.323359+0000", 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.323358+0000", 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.323370+0000", 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.323413+0000", 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.323668+0000", 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.324364+0000", 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "early_replied" 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.324365+0000", 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "submit entry: journal_and_reply" 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.332295+0000", 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "journal_committed: " 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.332510+0000", 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.332644+0000", 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.332739+0000", 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.332740+0000", 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:126 readdir #0x10000000242 2023-10-08T16:07:39.947294+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:39.947394+0000", 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 40.113280934999999, 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 16.508726421999999, 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:126", 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 126 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.947394+0000", 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.947395+0000", 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.947394+0000", 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.947403+0000", 2023-10-08T16:08:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.947433+0000", 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:39.947514+0000", 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:40.447701+0000", 2023-10-08T16:08:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:40.947900+0000", 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:41.448073+0000", 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:41.948208+0000", 2023-10-08T16:08:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:42.448349+0000", 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:42.948525+0000", 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:43.448719+0000", 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:43.948888+0000", 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:44.449063+0000", 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:44.949339+0000", 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:45.449543+0000", 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:45.949732+0000", 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:46.449914+0000", 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:46.950083+0000", 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:47.450278+0000", 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:47.950459+0000", 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:48.450655+0000", 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:48.950835+0000", 2023-10-08T16:08:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:49.451024+0000", 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:49.951144+0000", 2023-10-08T16:08:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:50.451332+0000", 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:50.951505+0000", 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:51.451700+0000", 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:51.951885+0000", 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:52.452061+0000", 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:52.952251+0000", 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:53.452442+0000", 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:53.952625+0000", 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:54.452790+0000", 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:54.952985+0000", 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:55.453185+0000", 2023-10-08T16:08:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:55.953351+0000", 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.453868+0000", 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "failed to rdlock, waiting" 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.454885+0000", 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.455711+0000", 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.455806+0000", 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.456112+0000", 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.456120+0000", 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: "description": "client_request(client.5208:129 readdir #0x10000000228 2023-10-08T16:07:56.462353+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,})", 2023-10-08T16:08:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2023-10-08T16:07:56.462552+0000", 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 23.598122970999999, 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 22.510796455000001, 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "type_data": { 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "flag_point": "done", 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5208:129", 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "client_request", 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "client_info": { 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "client": "client.5208", 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "tid": 129 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.462552+0000", 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "initiated" 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.462553+0000", 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "throttled" 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.462552+0000", 2023-10-08T16:08:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "header_read" 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.462568+0000", 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "all_read" 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.462620+0000", 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "dispatched" 2023-10-08T16:08:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.462765+0000", 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:56.962943+0000", 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:57.463118+0000", 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:57.963303+0000", 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:58.463424+0000", 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:58.963593+0000", 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:59.463781+0000", 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:07:59.963958+0000", 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:00.464141+0000", 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:00.964333+0000", 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:01.464509+0000", 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:01.964672+0000", 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:02.464878+0000", 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:02.965041+0000", 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:03.465240+0000", 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:03.965430+0000", 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:04.465592+0000", 2023-10-08T16:08:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:04.965782+0000", 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:05.465957+0000", 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:05.966130+0000", 2023-10-08T16:08:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:06.466325+0000", 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:06.966492+0000", 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:07.466684+0000", 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:07.966869+0000", 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:08.467070+0000", 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:08.967262+0000", 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:09.467453+0000", 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:09.967623+0000", 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:10.467816+0000", 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:10.968009+0000", 2023-10-08T16:08:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:11.468201+0000", 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:11.968398+0000", 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:12.468598+0000", 2023-10-08T16:08:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:12.968795+0000", 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:13.468994+0000", 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:13.969123+0000", 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:14.469321+0000", 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:14.969480+0000", 2023-10-08T16:08:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:15.469637+0000", 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:15.969807+0000", 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:16.469981+0000", 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:16.970163+0000", 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:17.470342+0000", 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:17.970527+0000", 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.470699+0000", 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cap_acquisition_throttle" 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.971275+0000", 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "failed to rdlock, waiting" 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.972138+0000", 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "acquired locks" 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.973001+0000", 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "replying" 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.973095+0000", 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "finishing request" 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.973346+0000", 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "cleaned up request" 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: "time": "2023-10-08T16:08:18.973348+0000", 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: "event": "done" 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:20.235 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:08:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efdec060550 msgr2=0x7efdec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efdec060550 0x7efdec062a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efdf40091e0 tx=0x7efdf4018000 comp rx=0 tx=0).stop 2023-10-08T16:08:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 msgr2=0x7efe000c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 0x7efe000c5230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efdf00011e0 tx=0x7efdf0007df0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 shutdown_connections 2023-10-08T16:08:20.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efdec060550 0x7efdec062a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe00159d40 0x7efe001547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7efe0013eed0 0x7efe0016a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 --2- 172.21.15.3:0/1156424868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe000687c0 0x7efe000c5230 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 >> 172.21.15.3:0/1156424868 conn(0x7efe000c8c90 msgr2=0x7efe0006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 shutdown_connections 2023-10-08T16:08:20.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.061+0000 7efe04af0700 1 -- 172.21.15.3:0/1156424868 wait complete. 2023-10-08T16:08:20.239 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:08:20.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:20.260 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:20.281 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:08:20.282 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-10-08T16:08:20.282 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:08:20.282 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:20.296 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[42892]: fuse finished with error 0 and tester_r 0 2023-10-08T16:08:20.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:08:20.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:20.298 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:08:20.409 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2023-10-08T16:08:20.410 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:08:20.410 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:20.426 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39739]: fuse finished with error 0 and tester_r 0 2023-10-08T16:08:20.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:08:20.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:20.428 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:08:20.494 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:08:20.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:20.494 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T16:08:20.501 INFO:teuthology.orchestra.run.smithi003.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T16:08:20.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:08:20.503 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:08:20.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:20.503 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T16:08:20.509 INFO:teuthology.orchestra.run.smithi027.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T16:08:20.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:08:20.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:20.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 Processor -- start 2023-10-08T16:08:20.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 -- start start 2023-10-08T16:08:20.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0a940ade60 0x7f0a940cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940c7d70 0x7f0a940cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a941562c0 con 0x7f0a940ae230 2023-10-08T16:08:20.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9406b0b0 con 0x7f0a940ade60 2023-10-08T16:08:20.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a8d2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9406b390 con 0x7f0a940c7d70 2023-10-08T16:08:20.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a998d0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0a940ade60 0x7f0a940cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a9a0d1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940c7d70 0x7f0a940cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a998d0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0a940ade60 0x7f0a940cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59008/0 (socket says 172.21.15.3:59008) 2023-10-08T16:08:20.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.653+0000 7f0a998d0700 1 -- 172.21.15.3:0/3752274502 learned_addr learned my addr 172.21.15.3:0/3752274502 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a0d1700 1 -- 172.21.15.3:0/3752274502 >> v2:172.21.15.3:3300/0 conn(0x7f0a940ade60 msgr2=0x7f0a940cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:20.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a0d1700 1 --2- 172.21.15.3:0/3752274502 >> v2:172.21.15.3:3300/0 conn(0x7f0a940ade60 0x7f0a940cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a0d1700 1 -- 172.21.15.3:0/3752274502 >> v1:172.21.15.27:6789/0 conn(0x7f0a940ae230 legacy=0x7f0a940c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a988ce700 1 -- 172.21.15.3:0/3752274502 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529204227 0 0) 0x7f0a941562c0 con 0x7f0a940ae230 2023-10-08T16:08:20.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a0d1700 1 -- 172.21.15.3:0/3752274502 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9406b670 con 0x7f0a940c7d70 2023-10-08T16:08:20.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a0d1700 1 --2- 172.21.15.3:0/3752274502 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940c7d70 0x7f0a940cb390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009e60 tx=0x7f0a8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3fed8d990a554e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a988ce700 1 -- 172.21.15.3:0/3752274502 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00e070 con 0x7f0a940c7d70 2023-10-08T16:08:20.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a988ce700 1 -- 172.21.15.3:0/3752274502 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00bb60 con 0x7f0a940c7d70 2023-10-08T16:08:20.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a988ce700 1 -- 172.21.15.3:0/3752274502 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c012430 con 0x7f0a940c7d70 2023-10-08T16:08:20.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/3752274502 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940c7d70 msgr2=0x7f0a940cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/3752274502 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940c7d70 0x7f0a940cb390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009e60 tx=0x7f0a8c009780 comp rx=0 tx=0).stop 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/3752274502 shutdown_connections 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/3752274502 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940c7d70 0x7f0a940cb390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/3752274502 >> v2:172.21.15.3:3300/0 conn(0x7f0a940ade60 0x7f0a940cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/3752274502 >> 172.21.15.3:0/3752274502 conn(0x7f0a940c83d0 msgr2=0x7f0a940c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/3752274502 shutdown_connections 2023-10-08T16:08:20.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.657+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/3752274502 wait complete. 2023-10-08T16:08:20.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 Processor -- start 2023-10-08T16:08:20.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 -- start start 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940ade60 0x7f0a94140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 0x7f0a9414cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a940c7d70 0x7f0a9414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9414abb0 con 0x7f0a940ae230 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9414d450 con 0x7f0a940c7d70 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.661+0000 7f0a9a8d2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9414b380 con 0x7f0a940ade60 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 0x7f0a9414cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 0x7f0a9414cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59010/0 (socket says 172.21.15.3:59010) 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 -- 172.21.15.3:0/2154087749 learned_addr learned my addr 172.21.15.3:0/2154087749 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a9a0d1700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a940c7d70 0x7f0a9414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a998d0700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940ade60 0x7f0a94140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 -- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940ade60 msgr2=0x7f0a94140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940ade60 0x7f0a94140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 -- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a940c7d70 msgr2=0x7f0a9414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a940c7d70 0x7f0a9414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 -- 172.21.15.3:0/2154087749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c009a20 con 0x7f0a940ae230 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a990cf700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 0x7f0a9414cf10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000c530 tx=0x7f0a9000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90011590 con 0x7f0a940ae230 2023-10-08T16:08:20.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90011710 con 0x7f0a940ae230 2023-10-08T16:08:20.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9414ca80 con 0x7f0a940ae230 2023-10-08T16:08:20.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90011ad0 con 0x7f0a940ae230 2023-10-08T16:08:20.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9414ae70 con 0x7f0a940ae230 2023-10-08T16:08:20.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.665+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9414cc10 con 0x7f0a940ae230 2023-10-08T16:08:20.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.669+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0a9001b3b0 con 0x7f0a940ae230 2023-10-08T16:08:20.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.669+0000 7f0a89ffb700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0a80060550 0x7f0a80062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:20.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.669+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a9007bb60 con 0x7f0a940ae230 2023-10-08T16:08:20.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.669+0000 7f0a998d0700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0a80060550 0x7f0a80062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:20.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.669+0000 7f0a998d0700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0a80060550 0x7f0a80062a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0a94145f30 tx=0x7f0a84009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:20.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.673+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0a9004c130 con 0x7f0a940ae230 2023-10-08T16:08:20.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.869+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a9404be40 con 0x7f0a940ae230 2023-10-08T16:08:20.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.869+0000 7f0a89ffb700 1 -- 172.21.15.3:0/2154087749 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f0a9004f750 con 0x7f0a940ae230 2023-10-08T16:08:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0a80060550 msgr2=0x7f0a80062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0a80060550 0x7f0a80062a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0a94145f30 tx=0x7f0a84009250 comp rx=0 tx=0).stop 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 msgr2=0x7f0a9414cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 0x7f0a9414cf10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000c530 tx=0x7f0a9000c840 comp rx=0 tx=0).stop 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 shutdown_connections 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0a80060550 0x7f0a80062a00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a940c7d70 0x7f0a9414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a940ae230 0x7f0a9414cf10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 --2- 172.21.15.3:0/2154087749 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0a940ade60 0x7f0a94140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 >> 172.21.15.3:0/2154087749 conn(0x7f0a940c83d0 msgr2=0x7f0a940c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 shutdown_connections 2023-10-08T16:08:20.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.873+0000 7f0a9a8d2700 1 -- 172.21.15.3:0/2154087749 wait complete. 2023-10-08T16:08:20.880 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:08:20.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:21.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 Processor -- start 2023-10-08T16:08:21.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- start start 2023-10-08T16:08:21.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280adc30 0x7fe72806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe72806ab00 0x7fe7280ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280ae540 con 0x7fe72806af00 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72806cae0 con 0x7fe72806ab00 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72806cdc0 con 0x7fe7280adc30 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe72806ab00 0x7fe7280ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe72806ab00 0x7fe7280ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59020/0 (socket says 172.21.15.3:59020) 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 -- 172.21.15.3:0/2663700645 learned_addr learned my addr 172.21.15.3:0/2663700645 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe726d9d700 1 --2- 172.21.15.3:0/2663700645 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280adc30 0x7fe72806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 -- 172.21.15.3:0/2663700645 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280adc30 msgr2=0x7fe72806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:21.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 --2- 172.21.15.3:0/2663700645 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280adc30 0x7fe72806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 -- 172.21.15.3:0/2663700645 >> v1:172.21.15.27:6789/0 conn(0x7fe72806af00 legacy=0x7fe7280ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 -- 172.21.15.3:0/2663700645 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72806d0a0 con 0x7fe72806ab00 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72659c700 1 --2- 172.21.15.3:0/2663700645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806ab00 0x7fe7280ae000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe7180099b0 tx=0x7fe718009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e8dc22a5f8fb21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe725d9b700 1 -- 172.21.15.3:0/2663700645 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718009ea0 con 0x7fe72806ab00 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe725d9b700 1 -- 172.21.15.3:0/2663700645 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71800b860 con 0x7fe72806ab00 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe725d9b700 1 -- 172.21.15.3:0/2663700645 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800bc00 con 0x7fe72806ab00 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- 172.21.15.3:0/2663700645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806ab00 msgr2=0x7fe7280ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 --2- 172.21.15.3:0/2663700645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806ab00 0x7fe7280ae000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe7180099b0 tx=0x7fe718009250 comp rx=0 tx=0).stop 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- 172.21.15.3:0/2663700645 shutdown_connections 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 --2- 172.21.15.3:0/2663700645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806ab00 0x7fe7280ae000 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 --2- 172.21.15.3:0/2663700645 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280adc30 0x7fe72806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- 172.21.15.3:0/2663700645 >> 172.21.15.3:0/2663700645 conn(0x7fe7280cc5d0 msgr2=0x7fe7280c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- 172.21.15.3:0/2663700645 shutdown_connections 2023-10-08T16:08:21.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:20.997+0000 7fe72d09e700 1 -- 172.21.15.3:0/2663700645 wait complete. 2023-10-08T16:08:21.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 Processor -- start 2023-10-08T16:08:21.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 -- start start 2023-10-08T16:08:21.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 0x7fe72815f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7280adc30 0x7fe72816ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280c4670 0x7fe7280c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280c2ce0 con 0x7fe72806af00 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72816ef50 con 0x7fe7280adc30 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280c50c0 con 0x7fe7280c4670 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 0x7fe72815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 0x7fe72815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59036/0 (socket says 172.21.15.3:59036) 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 -- 172.21.15.3:0/3135787664 learned_addr learned my addr 172.21.15.3:0/3135787664 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72659c700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7280adc30 0x7fe72816ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72759e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280c4670 0x7fe7280c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 -- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280c4670 msgr2=0x7fe7280c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280c4670 0x7fe7280c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 -- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7280adc30 msgr2=0x7fe72816ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7280adc30 0x7fe72816ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 -- 172.21.15.3:0/3135787664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180094f0 con 0x7fe72806af00 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe726d9d700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 0x7fe72815f370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe71000ec80 tx=0x7fe7100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000c9d0 con 0x7fe72806af00 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000cb30 con 0x7fe72806af00 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710013470 con 0x7fe72806af00 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280c53a0 con 0x7fe72806af00 2023-10-08T16:08:21.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.001+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7280c5960 con 0x7fe72806af00 2023-10-08T16:08:21.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.005+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72804be40 con 0x7fe72806af00 2023-10-08T16:08:21.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.005+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe710013820 con 0x7fe72806af00 2023-10-08T16:08:21.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.005+0000 7fe71effd700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe70c060550 0x7fe70c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.005+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe71007cbb0 con 0x7fe72806af00 2023-10-08T16:08:21.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.005+0000 7fe72659c700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe70c060550 0x7fe70c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.009+0000 7fe72659c700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe70c060550 0x7fe70c062a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7180099b0 tx=0x7fe718017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.013+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe71004d100 con 0x7fe72806af00 2023-10-08T16:08:21.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.173+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe72806d380 con 0x7fe72806af00 2023-10-08T16:08:21.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.173+0000 7fe71effd700 1 -- 172.21.15.3:0/3135787664 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fe710050720 con 0x7fe72806af00 2023-10-08T16:08:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":32,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:28.751208+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:25.214157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:26.118148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:21.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe70c060550 msgr2=0x7fe70c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe70c060550 0x7fe70c062a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7180099b0 tx=0x7fe718017000 comp rx=0 tx=0).stop 2023-10-08T16:08:21.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 msgr2=0x7fe72815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 0x7fe72815f370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe71000ec80 tx=0x7fe7100091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 shutdown_connections 2023-10-08T16:08:21.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe70c060550 0x7fe70c062a00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7280c4670 0x7fe7280c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7280adc30 0x7fe72816ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 --2- 172.21.15.3:0/3135787664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe72806af00 0x7fe72815f370 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 >> 172.21.15.3:0/3135787664 conn(0x7fe7280cc5d0 msgr2=0x7fe728161300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 shutdown_connections 2023-10-08T16:08:21.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.177+0000 7fe72d09e700 1 -- 172.21.15.3:0/3135787664 wait complete. 2023-10-08T16:08:21.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:07:25.214157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:07:26.118148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:08:21.196 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:08:21.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2b16f8700 1 Processor -- start 2023-10-08T16:08:21.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2b16f8700 1 -- start start 2023-10-08T16:08:21.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2b16f8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac0ca6e0 0x7fa2ac0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2b16f8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac0b3c70 con 0x7fa2ac154850 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2b16f8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac0cd820 con 0x7fa2ac15b000 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2b16f8700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0ccc70 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2aaffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa2ac154850 0x7fa2ac15a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33828/0 (socket says 172.21.15.3:33828) 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2aaffd700 1 -- 172.21.15.3:0/2930259495 learned_addr learned my addr 172.21.15.3:0/2930259495 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2ab7fe700 1 --2- 172.21.15.3:0/2930259495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac0ca6e0 0x7fa2ac0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2a9ffb700 1 -- 172.21.15.3:0/2930259495 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909659361 0 0) 0x7fa2ac0b3c70 con 0x7fa2ac154850 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2ab7fe700 1 -- 172.21.15.3:0/2930259495 >> v1:172.21.15.27:6789/0 conn(0x7fa2ac15b000 legacy=0x7fa2ac06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2ab7fe700 1 -- 172.21.15.3:0/2930259495 >> v1:172.21.15.3:6789/0 conn(0x7fa2ac154850 legacy=0x7fa2ac15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2ab7fe700 1 -- 172.21.15.3:0/2930259495 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0cab60 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2ab7fe700 1 --2- 172.21.15.3:0/2930259495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac0ca6e0 0x7fa2ac0b3730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009e10 tx=0x7fa2a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc38d0797b1e4479 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2a9ffb700 1 -- 172.21.15.3:0/2930259495 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400e070 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2a9ffb700 1 -- 172.21.15.3:0/2930259495 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400bbb0 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.301+0000 7fa2a9ffb700 1 -- 172.21.15.3:0/2930259495 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4012430 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 -- 172.21.15.3:0/2930259495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac0ca6e0 msgr2=0x7fa2ac0b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/2930259495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac0ca6e0 0x7fa2ac0b3730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009e10 tx=0x7fa2a4009780 comp rx=0 tx=0).stop 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 -- 172.21.15.3:0/2930259495 shutdown_connections 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/2930259495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac0ca6e0 0x7fa2ac0b3730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 -- 172.21.15.3:0/2930259495 >> 172.21.15.3:0/2930259495 conn(0x7fa2ac0cdce0 msgr2=0x7fa2ac0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 -- 172.21.15.3:0/2930259495 shutdown_connections 2023-10-08T16:08:21.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 -- 172.21.15.3:0/2930259495 wait complete. 2023-10-08T16:08:21.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 Processor -- start 2023-10-08T16:08:21.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.305+0000 7fa2b16f8700 1 -- start start 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 0x7fa2ac166d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2ac154850 0x7fa2ac158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac15b000 0x7fa2ac142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac156d40 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac156130 con 0x7fa2ac154850 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac156410 con 0x7fa2ac15b000 2023-10-08T16:08:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 0x7fa2ac166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 0x7fa2ac166d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59042/0 (socket says 172.21.15.3:59042) 2023-10-08T16:08:21.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 -- 172.21.15.3:0/549875743 learned_addr learned my addr 172.21.15.3:0/549875743 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:21.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2ab7fe700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac15b000 0x7fa2ac142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aa7fc700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2ac154850 0x7fa2ac158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 -- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac15b000 msgr2=0x7fa2ac142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac15b000 0x7fa2ac142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 -- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2ac154850 msgr2=0x7fa2ac158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2ac154850 0x7fa2ac158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 -- 172.21.15.3:0/549875743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4009a20 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2aaffd700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 0x7fa2ac166d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c7e0 tx=0x7fa2a0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0005b30 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a0005c90 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0007300 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac1566f0 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.309+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac1593e0 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.313+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac071180 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.313+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2a001b3b0 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.313+0000 7fa292ffd700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa298060550 0x7fa298062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.313+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2a007bca0 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.313+0000 7fa2aa7fc700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa298060550 0x7fa298062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.313+0000 7fa2aa7fc700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa298060550 0x7fa298062a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0ae420 tx=0x7fa29c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.321+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2a004c1f0 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.477+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2ac156b70 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa292ffd700 1 -- 172.21.15.3:0/549875743 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a0001d60 con 0x7fa2ac0ca6e0 2023-10-08T16:08:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa298060550 msgr2=0x7fa298062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa298060550 0x7fa298062a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0ae420 tx=0x7fa29c007ec0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 msgr2=0x7fa2ac166d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 0x7fa2ac166d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c7e0 tx=0x7fa2a0007df0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 shutdown_connections 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa298060550 0x7fa298062a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2ac15b000 0x7fa2ac142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2ac154850 0x7fa2ac158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 --2- 172.21.15.3:0/549875743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2ac0ca6e0 0x7fa2ac166d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 >> 172.21.15.3:0/549875743 conn(0x7fa2ac0cdce0 msgr2=0x7fa2ac0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 shutdown_connections 2023-10-08T16:08:21.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.481+0000 7fa2b16f8700 1 -- 172.21.15.3:0/549875743 wait complete. 2023-10-08T16:08:21.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:08:21.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.605+0000 7f561ca93700 1 Processor -- start 2023-10-08T16:08:21.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.605+0000 7f561ca93700 1 -- start start 2023-10-08T16:08:21.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5618158c80 0x7f561815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f561806db60 0x7f561806b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56180b45a0 con 0x7f56180b37c0 2023-10-08T16:08:21.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561815a060 con 0x7f5618158c80 2023-10-08T16:08:21.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561806a3a0 con 0x7f561806db60 2023-10-08T16:08:21.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56177fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5618158c80 0x7f561815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f5617fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f56180b37c0 0x7f561806c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33832/0 (socket says 172.21.15.3:33832) 2023-10-08T16:08:21.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f5617fff700 1 -- 172.21.15.3:0/3596325030 learned_addr learned my addr 172.21.15.3:0/3596325030 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:21.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f5616ffd700 1 --2- 172.21.15.3:0/3596325030 >> v2:172.21.15.27:3300/0 conn(0x7f561806db60 0x7f561806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56167fc700 1 -- 172.21.15.3:0/3596325030 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362319820 0 0) 0x7f56180b45a0 con 0x7f56180b37c0 2023-10-08T16:08:21.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56167fc700 1 -- 172.21.15.3:0/3596325030 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5604003570 con 0x7f56180b37c0 2023-10-08T16:08:21.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56177fe700 1 -- 172.21.15.3:0/3596325030 >> v2:172.21.15.27:3300/0 conn(0x7f561806db60 msgr2=0x7f561806b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:21.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56177fe700 1 --2- 172.21.15.3:0/3596325030 >> v2:172.21.15.27:3300/0 conn(0x7f561806db60 0x7f561806b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56177fe700 1 -- 172.21.15.3:0/3596325030 >> v1:172.21.15.3:6789/0 conn(0x7f56180b37c0 legacy=0x7f561806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56177fe700 1 -- 172.21.15.3:0/3596325030 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561806a680 con 0x7f5618158c80 2023-10-08T16:08:21.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f5616ffd700 1 --2- 172.21.15.3:0/3596325030 >> v2:172.21.15.27:3300/0 conn(0x7f561806db60 0x7f561806b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:21.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56177fe700 1 --2- 172.21.15.3:0/3596325030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f561815d4c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56180b2990 tx=0x7f56000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bd56ca2e26c60a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56167fc700 1 -- 172.21.15.3:0/3596325030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600011630 con 0x7f5618158c80 2023-10-08T16:08:21.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56167fc700 1 -- 172.21.15.3:0/3596325030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600011790 con 0x7f5618158c80 2023-10-08T16:08:21.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f56167fc700 1 -- 172.21.15.3:0/3596325030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600011b30 con 0x7f5618158c80 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- 172.21.15.3:0/3596325030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 msgr2=0x7f561815d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 --2- 172.21.15.3:0/3596325030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f561815d4c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56180b2990 tx=0x7f56000091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- 172.21.15.3:0/3596325030 shutdown_connections 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 --2- 172.21.15.3:0/3596325030 >> v2:172.21.15.27:3300/0 conn(0x7f561806db60 0x7f561806b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 --2- 172.21.15.3:0/3596325030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f561815d4c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- 172.21.15.3:0/3596325030 >> 172.21.15.3:0/3596325030 conn(0x7f56180d0820 msgr2=0x7f56180b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- 172.21.15.3:0/3596325030 shutdown_connections 2023-10-08T16:08:21.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.609+0000 7f561ca93700 1 -- 172.21.15.3:0/3596325030 wait complete. 2023-10-08T16:08:21.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 Processor -- start 2023-10-08T16:08:21.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 -- start start 2023-10-08T16:08:21.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561806db60 0x7f5618169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f56180b37c0 0x7f5618150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f56180aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56180a9ac0 con 0x7f5618158c80 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561816a300 con 0x7f561806db60 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56180a8eb0 con 0x7f56180b37c0 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f56180aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f56180aa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59062/0 (socket says 172.21.15.3:59062) 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 -- 172.21.15.3:0/3601615062 learned_addr learned my addr 172.21.15.3:0/3601615062 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5616ffd700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f56180b37c0 0x7f5618150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f56177fe700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561806db60 0x7f5618169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 -- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f56180b37c0 msgr2=0x7f5618150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f56180b37c0 0x7f5618150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 -- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561806db60 msgr2=0x7f5618169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561806db60 0x7f5618169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 -- 172.21.15.3:0/3601615062 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5608009420 con 0x7f5618158c80 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f5617fff700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f56180aa930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5610001460 tx=0x7f5610001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000ce80 con 0x7f5618158c80 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561000ab70 con 0x7f5618158c80 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5600009420 con 0x7f5618158c80 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.613+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100070f0 con 0x7f5618158c80 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.617+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56180a9470 con 0x7f5618158c80 2023-10-08T16:08:21.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.617+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56180a9c30 con 0x7f5618158c80 2023-10-08T16:08:21.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.617+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5610007520 con 0x7f5618158c80 2023-10-08T16:08:21.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.617+0000 7f560f7fe700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f55f8060550 0x7f55f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.617+0000 7f56177fe700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f55f8060550 0x7f55f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.621+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f561007d830 con 0x7f5618158c80 2023-10-08T16:08:21.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.621+0000 7f56177fe700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f55f8060550 0x7f55f8062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56180b2990 tx=0x7f5600017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.625+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f561004de80 con 0x7f5618158c80 2023-10-08T16:08:21.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.781+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f561804be40 con 0x7f5618158c80 2023-10-08T16:08:21.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.781+0000 7f560f7fe700 1 -- 172.21.15.3:0/3601615062 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56100514a0 con 0x7f5618158c80 2023-10-08T16:08:21.788 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f55f8060550 msgr2=0x7f55f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f55f8060550 0x7f55f8062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56180b2990 tx=0x7f5600017000 comp rx=0 tx=0).stop 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 msgr2=0x7f56180aa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f56180aa930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5610001460 tx=0x7f5610001ae0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 shutdown_connections 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f55f8060550 0x7f55f8062a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5618158c80 0x7f56180aa930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f56180b37c0 0x7f5618150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 --2- 172.21.15.3:0/3601615062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561806db60 0x7f5618169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 >> 172.21.15.3:0/3601615062 conn(0x7f56180d0820 msgr2=0x7f5618152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 shutdown_connections 2023-10-08T16:08:21.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.785+0000 7f561ca93700 1 -- 172.21.15.3:0/3601615062 wait complete. 2023-10-08T16:08:21.802 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:08:21.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 Processor -- start 2023-10-08T16:08:21.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 -- start start 2023-10-08T16:08:21.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 0x7fa48415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa48406db60 0x7fa48406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840b45a0 con 0x7fa4840b37c0 2023-10-08T16:08:21.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48415a060 con 0x7fa48406db60 2023-10-08T16:08:21.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489e56700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406a3a0 con 0x7fa484158c80 2023-10-08T16:08:21.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489655700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa4840b37c0 0x7fa48406c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33840/0 (socket says 172.21.15.3:33840) 2023-10-08T16:08:21.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.913+0000 7fa489655700 1 -- 172.21.15.3:0/8026155 learned_addr learned my addr 172.21.15.3:0/8026155 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa483fff700 1 --2- 172.21.15.3:0/8026155 >> v2:172.21.15.27:3300/0 conn(0x7fa48406db60 0x7fa48406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa488e54700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 0x7fa48415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978378575 0 0) 0x7fa4840b45a0 con 0x7fa4840b37c0 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa470003570 con 0x7fa4840b37c0 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3470787432 0 0) 0x7fa470003570 con 0x7fa4840b37c0 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 msgr2=0x7fa48415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 0x7fa48415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 >> v2:172.21.15.27:3300/0 conn(0x7fa48406db60 msgr2=0x7fa48406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 --2- 172.21.15.3:0/8026155 >> v2:172.21.15.27:3300/0 conn(0x7fa48406db60 0x7fa48406b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48406a680 con 0x7fa4840b37c0 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fa47c0017f0 con 0x7fa4840b37c0 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 >> v1:172.21.15.3:6789/0 conn(0x7fa4840b37c0 legacy=0x7fa48406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 0x7fa470003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa470003fe0 0x7fa470004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa470004d50 0x7fa4700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415a060 con 0x7fa470003fe0 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406a3a0 con 0x7fa470004d50 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47000bb40 con 0x7fa484158c80 2023-10-08T16:08:21.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa483fff700 1 --2- 172.21.15.3:0/8026155 >> v2:172.21.15.27:3300/0 conn(0x7fa48406db60 0x7fa48406b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa470004d50 0x7fa4700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa488e54700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 0x7fa470003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa483fff700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa470003fe0 0x7fa470004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 -- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 msgr2=0x7fa470003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa484158c80 0x7fa470003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 -- 172.21.15.3:0/8026155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa470003fe0 msgr2=0x7fa470004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa470003fe0 0x7fa470004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 -- 172.21.15.3:0/8026155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470003570 con 0x7fa470004d50 2023-10-08T16:08:21.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa483fff700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa470003fe0 0x7fa470004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:21.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa470004d50 0x7fa4700051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a940 tx=0x7fa47c002210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94500e9d56a135b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c007110 con 0x7fa470004d50 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c007290 con 0x7fa470004d50 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa4837fe700 1 -- 172.21.15.3:0/8026155 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c007650 con 0x7fa470004d50 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489e56700 1 -- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa470004d50 msgr2=0x7fa4700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489e56700 1 --2- 172.21.15.3:0/8026155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa470004d50 0x7fa4700051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a940 tx=0x7fa47c002210 comp rx=0 tx=0).stop 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.917+0000 7fa489655700 1 -- 172.21.15.3:0/8026155 reap_dead start 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.921+0000 7fa489e56700 1 -- 172.21.15.3:0/8026155 shutdown_connections 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.921+0000 7fa489e56700 1 -- 172.21.15.3:0/8026155 >> 172.21.15.3:0/8026155 conn(0x7fa4840d0820 msgr2=0x7fa4840b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:21.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.921+0000 7fa489e56700 1 -- 172.21.15.3:0/8026155 shutdown_connections 2023-10-08T16:08:21.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.921+0000 7fa489e56700 1 -- 172.21.15.3:0/8026155 wait complete. 2023-10-08T16:08:21.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.921+0000 7fa489e56700 1 Processor -- start 2023-10-08T16:08:21.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.921+0000 7fa489e56700 1 -- start start 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa48414e1b0 0x7fa484151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa48415c110 0x7fa4840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 0x7fa48415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48414e580 con 0x7fa4840cf0e0 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840cf550 con 0x7fa48415c110 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415d4c0 con 0x7fa48414e1b0 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 0x7fa48415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 0x7fa48415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59088/0 (socket says 172.21.15.3:59088) 2023-10-08T16:08:21.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 -- 172.21.15.3:0/1935162684 learned_addr learned my addr 172.21.15.3:0/1935162684 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:21.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa483fff700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa48415c110 0x7fa4840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa488e54700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa48414e1b0 0x7fa484151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 -- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa48414e1b0 msgr2=0x7fa484151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa48414e1b0 0x7fa484151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 -- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa48415c110 msgr2=0x7fa4840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:21.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa48415c110 0x7fa4840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 -- 172.21.15.3:0/1935162684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48415d950 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489655700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 0x7fa48415a1a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bb10 tx=0x7fa47c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c007110 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0017b0 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48415c8b0 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c000f40 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48415ce70 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.925+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48415d670 con 0x7fa4840cf0e0 2023-10-08T16:08:21.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.929+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa47c019030 con 0x7fa4840cf0e0 2023-10-08T16:08:21.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.929+0000 7fa480ff9700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa464060550 0x7fa464062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:21.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.929+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa47c07ed20 con 0x7fa4840cf0e0 2023-10-08T16:08:21.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.929+0000 7fa488e54700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa464060550 0x7fa464062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:21.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.929+0000 7fa488e54700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa464060550 0x7fa464062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa474006f00 tx=0x7fa4740091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:21.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:21.937+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa47c04f450 con 0x7fa4840cf0e0 2023-10-08T16:08:22.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.093+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa48415d630 con 0x7fa4840cf0e0 2023-10-08T16:08:22.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa480ff9700 1 -- 172.21.15.3:0/1935162684 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa47c0170a0 con 0x7fa4840cf0e0 2023-10-08T16:08:22.101 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:08:22.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa464060550 msgr2=0x7fa464062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa464060550 0x7fa464062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa474006f00 tx=0x7fa4740091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 msgr2=0x7fa48415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 0x7fa48415a1a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bb10 tx=0x7fa47c015000 comp rx=0 tx=0).stop 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 shutdown_connections 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa464060550 0x7fa464062a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4840cf0e0 0x7fa48415a1a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa48415c110 0x7fa4840ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 --2- 172.21.15.3:0/1935162684 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa48414e1b0 0x7fa484151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 >> 172.21.15.3:0/1935162684 conn(0x7fa4840d0820 msgr2=0x7fa484152650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 shutdown_connections 2023-10-08T16:08:22.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.097+0000 7fa489e56700 1 -- 172.21.15.3:0/1935162684 wait complete. 2023-10-08T16:08:22.116 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:22.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 Processor -- start 2023-10-08T16:08:22.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- start start 2023-10-08T16:08:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6eb80ae230 0x7f6eb80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80c7ba0 0x7f6eb80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb81562c0 con 0x7f6eb80ade60 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb806b0b0 con 0x7f6eb80ae230 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb806b390 con 0x7f6eb80c7ba0 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe1b6700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6eb80ade60 0x7f6eb80cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33852/0 (socket says 172.21.15.3:33852) 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe1b6700 1 -- 172.21.15.3:0/3484747013 learned_addr learned my addr 172.21.15.3:0/3484747013 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd9b5700 1 --2- 172.21.15.3:0/3484747013 >> v2:172.21.15.27:3300/0 conn(0x7f6eb80ae230 0x7f6eb80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe9b7700 1 --2- 172.21.15.3:0/3484747013 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80c7ba0 0x7f6eb80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd1b4700 1 -- 172.21.15.3:0/3484747013 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932878883 0 0) 0x7f6eb81562c0 con 0x7f6eb80ade60 2023-10-08T16:08:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd1b4700 1 -- 172.21.15.3:0/3484747013 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea4003570 con 0x7f6eb80ade60 2023-10-08T16:08:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe9b7700 1 -- 172.21.15.3:0/3484747013 >> v2:172.21.15.27:3300/0 conn(0x7f6eb80ae230 msgr2=0x7f6eb80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe9b7700 1 --2- 172.21.15.3:0/3484747013 >> v2:172.21.15.27:3300/0 conn(0x7f6eb80ae230 0x7f6eb80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe9b7700 1 -- 172.21.15.3:0/3484747013 >> v1:172.21.15.3:6789/0 conn(0x7f6eb80ade60 legacy=0x7f6eb80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd1b4700 1 -- 172.21.15.3:0/3484747013 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 674156723 0 0) 0x7f6ea4003570 con 0x7f6eb80ade60 2023-10-08T16:08:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe9b7700 1 -- 172.21.15.3:0/3484747013 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb806b670 con 0x7f6eb80c7ba0 2023-10-08T16:08:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebe9b7700 1 --2- 172.21.15.3:0/3484747013 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80c7ba0 0x7f6eb80ae870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009e60 tx=0x7f6eb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6b1070ca5dfa16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd1b4700 1 -- 172.21.15.3:0/3484747013 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000e070 con 0x7f6eb80c7ba0 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd1b4700 1 -- 172.21.15.3:0/3484747013 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000b7a0 con 0x7f6eb80c7ba0 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebd1b4700 1 -- 172.21.15.3:0/3484747013 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4001470 con 0x7f6eb80c7ba0 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/3484747013 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80c7ba0 msgr2=0x7f6eb80ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/3484747013 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80c7ba0 0x7f6eb80ae870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009e60 tx=0x7f6eb0009780 comp rx=0 tx=0).stop 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/3484747013 shutdown_connections 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/3484747013 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80c7ba0 0x7f6eb80ae870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/3484747013 >> v2:172.21.15.27:3300/0 conn(0x7f6eb80ae230 0x7f6eb80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/3484747013 >> 172.21.15.3:0/3484747013 conn(0x7f6eb80c83d0 msgr2=0x7f6eb80c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/3484747013 shutdown_connections 2023-10-08T16:08:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.217+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/3484747013 wait complete. 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 Processor -- start 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 -- start start 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80ade60 0x7f6eb80c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 0x7f6eb815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6eb80c7ba0 0x7f6eb8155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80a5040 con 0x7f6eb80ae230 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80c4c20 con 0x7f6eb80c7ba0 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80c4f00 con 0x7f6eb80ade60 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 0x7f6eb815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebe1b6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80ade60 0x7f6eb80c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebe9b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6eb80c7ba0 0x7f6eb8155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 0x7f6eb815a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59100/0 (socket says 172.21.15.3:59100) 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 -- 172.21.15.3:0/2179339428 learned_addr learned my addr 172.21.15.3:0/2179339428 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 -- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80ade60 msgr2=0x7f6eb80c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80ade60 0x7f6eb80c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 -- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6eb80c7ba0 msgr2=0x7f6eb8155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6eb80c7ba0 0x7f6eb8155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 -- 172.21.15.3:0/2179339428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0009a20 con 0x7f6eb80ae230 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebe1b6700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80ade60 0x7f6eb80c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebd9b5700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 0x7f6eb815a990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00ec80 tx=0x7f6eac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00c850 con 0x7f6eb80ae230 2023-10-08T16:08:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00c9b0 con 0x7f6eb80ae230 2023-10-08T16:08:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.221+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb80c51e0 con 0x7f6eb80ae230 2023-10-08T16:08:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00cd50 con 0x7f6eb80ae230 2023-10-08T16:08:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb80c48d0 con 0x7f6eb80ae230 2023-10-08T16:08:22.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb80a5210 con 0x7f6eb80ae230 2023-10-08T16:08:22.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6eac013680 con 0x7f6eb80ae230 2023-10-08T16:08:22.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6eaa7fc700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6e9c060550 0x7f6e9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6eac07cb10 con 0x7f6eb80ae230 2023-10-08T16:08:22.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6ebe1b6700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6e9c060550 0x7f6e9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.225+0000 7f6ebe1b6700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6e9c060550 0x7f6e9c062a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4001ed0 tx=0x7f6eb4001970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.233+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6eac04d060 con 0x7f6eb80ae230 2023-10-08T16:08:22.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.429+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eb80c5660 con 0x7f6eb80ae230 2023-10-08T16:08:22.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.429+0000 7f6eaa7fc700 1 -- 172.21.15.3:0/2179339428 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f6eac050680 con 0x7f6eb80ae230 2023-10-08T16:08:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:22.437 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:08:22.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6e9c060550 msgr2=0x7f6e9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6e9c060550 0x7f6e9c062a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4001ed0 tx=0x7f6eb4001970 comp rx=0 tx=0).stop 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 msgr2=0x7f6eb815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 0x7f6eb815a990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00ec80 tx=0x7f6eac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 shutdown_connections 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6e9c060550 0x7f6e9c062a00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6eb80c7ba0 0x7f6eb8155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb80ae230 0x7f6eb815a990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 --2- 172.21.15.3:0/2179339428 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6eb80ade60 0x7f6eb80c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 >> 172.21.15.3:0/2179339428 conn(0x7f6eb80c83d0 msgr2=0x7f6eb8158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:22.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 shutdown_connections 2023-10-08T16:08:22.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.433+0000 7f6ebf1b8700 1 -- 172.21.15.3:0/2179339428 wait complete. 2023-10-08T16:08:22.441 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:08:22.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:22.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 Processor -- start 2023-10-08T16:08:22.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 -- start start 2023-10-08T16:08:22.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f09ac068ab0 0x7f09ac0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac159e80 0x7f09ac0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac068e80 con 0x7f09ac155c00 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ac156930 con 0x7f09ac068ab0 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09b180c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac1593a0 con 0x7f09ac159e80 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aaffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f09ac068ab0 0x7f09ac0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aaffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f09ac068ab0 0x7f09ac0cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59102/0 (socket says 172.21.15.3:59102) 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aaffd700 1 -- 172.21.15.3:0/4203400893 learned_addr learned my addr 172.21.15.3:0/4203400893 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aa7fc700 1 --2- 172.21.15.3:0/4203400893 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac159e80 0x7f09ac0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aaffd700 1 -- 172.21.15.3:0/4203400893 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac159e80 msgr2=0x7f09ac0cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aaffd700 1 --2- 172.21.15.3:0/4203400893 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac159e80 0x7f09ac0cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.557+0000 7f09aaffd700 1 -- 172.21.15.3:0/4203400893 >> v1:172.21.15.27:6789/0 conn(0x7f09ac155c00 legacy=0x7f09ac156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09aaffd700 1 -- 172.21.15.3:0/4203400893 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac159680 con 0x7f09ac068ab0 2023-10-08T16:08:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09aaffd700 1 --2- 172.21.15.3:0/4203400893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac0cb170 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f099c0099b0 tx=0x7f099c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632579fe5643eb5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09a9ffb700 1 -- 172.21.15.3:0/4203400893 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c009ea0 con 0x7f09ac068ab0 2023-10-08T16:08:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09a9ffb700 1 -- 172.21.15.3:0/4203400893 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00b860 con 0x7f09ac068ab0 2023-10-08T16:08:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09a9ffb700 1 -- 172.21.15.3:0/4203400893 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00bc00 con 0x7f09ac068ab0 2023-10-08T16:08:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 -- 172.21.15.3:0/4203400893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 msgr2=0x7f09ac0cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 --2- 172.21.15.3:0/4203400893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac0cb170 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f099c0099b0 tx=0x7f099c009250 comp rx=0 tx=0).stop 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 -- 172.21.15.3:0/4203400893 shutdown_connections 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 --2- 172.21.15.3:0/4203400893 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac159e80 0x7f09ac0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 --2- 172.21.15.3:0/4203400893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac0cb170 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 -- 172.21.15.3:0/4203400893 >> 172.21.15.3:0/4203400893 conn(0x7f09ac0c8de0 msgr2=0x7f09ac0c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 -- 172.21.15.3:0/4203400893 shutdown_connections 2023-10-08T16:08:22.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.561+0000 7f09b180c700 1 -- 172.21.15.3:0/4203400893 wait complete. 2023-10-08T16:08:22.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 Processor -- start 2023-10-08T16:08:22.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 -- start start 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac1684c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac155c00 0x7f09ac1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09ac159e80 0x7f09ac0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac168a00 con 0x7f09ac068ab0 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0a45d0 con 0x7f09ac159e80 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0a48b0 con 0x7f09ac155c00 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac1684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac1684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59112/0 (socket says 172.21.15.3:59112) 2023-10-08T16:08:22.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 -- 172.21.15.3:0/6209504 learned_addr learned my addr 172.21.15.3:0/6209504 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09ab7fe700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09ac159e80 0x7f09ac0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aa7fc700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac155c00 0x7f09ac1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 -- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac155c00 msgr2=0x7f09ac1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac155c00 0x7f09ac1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 -- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09ac159e80 msgr2=0x7f09ac0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09ac159e80 0x7f09ac0c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 -- 172.21.15.3:0/6209504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0094f0 con 0x7f09ac068ab0 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aa7fc700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac155c00 0x7f09ac1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:22.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09aaffd700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac1684c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f09ac06aa80 tx=0x7f099c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c01c070 con 0x7f09ac068ab0 2023-10-08T16:08:22.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c000cc0 con 0x7f09ac068ab0 2023-10-08T16:08:22.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac0a4b90 con 0x7f09ac068ab0 2023-10-08T16:08:22.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c022420 con 0x7f09ac068ab0 2023-10-08T16:08:22.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.565+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac0a5150 con 0x7f09ac068ab0 2023-10-08T16:08:22.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.569+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac0a5370 con 0x7f09ac068ab0 2023-10-08T16:08:22.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.569+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f099c020070 con 0x7f09ac068ab0 2023-10-08T16:08:22.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.569+0000 7f0992ffd700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0998060550 0x7f0998062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.569+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f099c07da80 con 0x7f09ac068ab0 2023-10-08T16:08:22.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.569+0000 7f09aa7fc700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0998060550 0x7f0998062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.569+0000 7f09aa7fc700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0998060550 0x7f0998062a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f09ac15a290 tx=0x7f09a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.577+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f099c04e070 con 0x7f09ac068ab0 2023-10-08T16:08:22.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.741+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09ac04be40 con 0x7f09ac068ab0 2023-10-08T16:08:22.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.741+0000 7f0992ffd700 1 -- 172.21.15.3:0/6209504 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f099c051690 con 0x7f09ac068ab0 2023-10-08T16:08:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":32,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:28.751208+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:25.214157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:26.118148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0998060550 msgr2=0x7f0998062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0998060550 0x7f0998062a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f09ac15a290 tx=0x7f09a0008040 comp rx=0 tx=0).stop 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 msgr2=0x7f09ac1684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac1684c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f09ac06aa80 tx=0x7f099c018000 comp rx=0 tx=0).stop 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 shutdown_connections 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0998060550 0x7f0998062a00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09ac159e80 0x7f09ac0c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f09ac155c00 0x7f09ac1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 --2- 172.21.15.3:0/6209504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09ac068ab0 0x7f09ac1684c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 >> 172.21.15.3:0/6209504 conn(0x7f09ac0c8de0 msgr2=0x7f09ac06adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:22.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 shutdown_connections 2023-10-08T16:08:22.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.745+0000 7f09b180c700 1 -- 172.21.15.3:0/6209504 wait complete. 2023-10-08T16:08:22.763 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:08:22.764 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:22.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 Processor -- start 2023-10-08T16:08:22.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 -- start start 2023-10-08T16:08:22.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff948155e20 0x7ff9480c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff94815a3a0 0x7ff94806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480c16b0 con 0x7ff94806e300 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480c8710 con 0x7ff948155e20 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94d0cc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480c1060 con 0x7ff94815a3a0 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff947fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff948155e20 0x7ff9480c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff947fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff948155e20 0x7ff9480c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59116/0 (socket says 172.21.15.3:59116) 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff947fff700 1 -- 172.21.15.3:0/2723107512 learned_addr learned my addr 172.21.15.3:0/2723107512 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff94c8cb700 1 --1- 172.21.15.3:0/2723107512 >> v1:172.21.15.27:6789/0 conn(0x7ff94806e300 0x7ff9480c6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:37322/0 (socket says 172.21.15.3:37322) 2023-10-08T16:08:22.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff9477fe700 1 --2- 172.21.15.3:0/2723107512 >> v2:172.21.15.27:3300/0 conn(0x7ff94815a3a0 0x7ff94806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.869+0000 7ff947fff700 1 -- 172.21.15.3:0/2723107512 >> v2:172.21.15.27:3300/0 conn(0x7ff94815a3a0 msgr2=0x7ff94806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:22.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff947fff700 1 --2- 172.21.15.3:0/2723107512 >> v2:172.21.15.27:3300/0 conn(0x7ff94815a3a0 0x7ff94806ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff947fff700 1 -- 172.21.15.3:0/2723107512 >> v1:172.21.15.27:6789/0 conn(0x7ff94806e300 legacy=0x7ff9480c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff947fff700 1 -- 172.21.15.3:0/2723107512 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480c1340 con 0x7ff948155e20 2023-10-08T16:08:22.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff947fff700 1 --2- 172.21.15.3:0/2723107512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9480c80d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff948069990 tx=0x7ff938009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2634bbd9075f0237 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff946ffd700 1 -- 172.21.15.3:0/2723107512 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800e070 con 0x7ff948155e20 2023-10-08T16:08:22.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff946ffd700 1 -- 172.21.15.3:0/2723107512 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800ba20 con 0x7ff948155e20 2023-10-08T16:08:22.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff946ffd700 1 -- 172.21.15.3:0/2723107512 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380092e0 con 0x7ff948155e20 2023-10-08T16:08:22.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 -- 172.21.15.3:0/2723107512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 msgr2=0x7ff9480c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/2723107512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9480c80d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff948069990 tx=0x7ff938009840 comp rx=0 tx=0).stop 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 -- 172.21.15.3:0/2723107512 shutdown_connections 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/2723107512 >> v2:172.21.15.27:3300/0 conn(0x7ff94815a3a0 0x7ff94806ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/2723107512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9480c80d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 -- 172.21.15.3:0/2723107512 >> 172.21.15.3:0/2723107512 conn(0x7ff9480c8c90 msgr2=0x7ff9480c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 -- 172.21.15.3:0/2723107512 shutdown_connections 2023-10-08T16:08:22.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 -- 172.21.15.3:0/2723107512 wait complete. 2023-10-08T16:08:22.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 Processor -- start 2023-10-08T16:08:22.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.873+0000 7ff94d0cc700 1 -- start start 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff94806e300 0x7ff94814bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9481574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff94815a3a0 0x7ff9480b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480afe50 con 0x7ff948155e20 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480af240 con 0x7ff94815a3a0 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480af520 con 0x7ff94806e300 2023-10-08T16:08:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9481574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9481574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59124/0 (socket says 172.21.15.3:59124) 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 -- 172.21.15.3:0/1523981841 learned_addr learned my addr 172.21.15.3:0/1523981841 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff947fff700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff94806e300 0x7ff94814bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94c8cb700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff94815a3a0 0x7ff9480b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 -- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff94806e300 msgr2=0x7ff94814bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff94806e300 0x7ff94814bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 -- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff94815a3a0 msgr2=0x7ff9480b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff94815a3a0 0x7ff9480b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 -- 172.21.15.3:0/1523981841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009ae0 con 0x7ff948155e20 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff947fff700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff94806e300 0x7ff94814bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:22.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff9477fe700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9481574a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff93000e930 tx=0x7ff9300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000eed0 con 0x7ff948155e20 2023-10-08T16:08:22.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93000c850 con 0x7ff948155e20 2023-10-08T16:08:22.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9480af800 con 0x7ff948155e20 2023-10-08T16:08:22.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000cbf0 con 0x7ff948155e20 2023-10-08T16:08:22.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94814c140 con 0x7ff948155e20 2023-10-08T16:08:22.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.877+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480b0000 con 0x7ff948155e20 2023-10-08T16:08:22.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.881+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff930013470 con 0x7ff948155e20 2023-10-08T16:08:22.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.881+0000 7ff93ffff700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff928060550 0x7ff928062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:22.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.881+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff93007c9d0 con 0x7ff948155e20 2023-10-08T16:08:22.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.881+0000 7ff947fff700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff928060550 0x7ff928062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:22.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.881+0000 7ff947fff700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff928060550 0x7ff928062a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff938009880 tx=0x7ff938018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:22.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:22.885+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff9480b0000 con 0x7ff948155e20 2023-10-08T16:08:23.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.077+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff94804be40 con 0x7ff948155e20 2023-10-08T16:08:23.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.077+0000 7ff93ffff700 1 -- 172.21.15.3:0/1523981841 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7ff93004cfc0 con 0x7ff948155e20 2023-10-08T16:08:23.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:23.083 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:08:23.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff928060550 msgr2=0x7ff928062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff928060550 0x7ff928062a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff938009880 tx=0x7ff938018000 comp rx=0 tx=0).stop 2023-10-08T16:08:23.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 msgr2=0x7ff9481574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9481574a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff93000e930 tx=0x7ff9300091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 shutdown_connections 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff928060550 0x7ff928062a00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff94815a3a0 0x7ff9480b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff948155e20 0x7ff9481574a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 --2- 172.21.15.3:0/1523981841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff94806e300 0x7ff94814bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 >> 172.21.15.3:0/1523981841 conn(0x7ff9480c8c90 msgr2=0x7ff9480c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 shutdown_connections 2023-10-08T16:08:23.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.081+0000 7ff94d0cc700 1 -- 172.21.15.3:0/1523981841 wait complete. 2023-10-08T16:08:23.087 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:08:23.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:23.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.197+0000 7f674acac700 1 Processor -- start 2023-10-08T16:08:23.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.197+0000 7f674acac700 1 -- start start 2023-10-08T16:08:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6744158dd0 0x7f67441591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f674406c700 0x7f674406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6744159d80 con 0x7f674406d9d0 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674406d070 con 0x7f6744158dd0 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674406b8b0 con 0x7f674406c700 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6748a48700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6744158dd0 0x7f67441591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6743fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f674406d9d0 0x7f674406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:37328/0 (socket says 172.21.15.3:37328) 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6743fff700 1 -- 172.21.15.3:0/3757548877 learned_addr learned my addr 172.21.15.3:0/3757548877 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6749249700 1 --2- 172.21.15.3:0/3757548877 >> v2:172.21.15.27:3300/0 conn(0x7f674406c700 0x7f674406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6748a48700 1 -- 172.21.15.3:0/3757548877 >> v2:172.21.15.27:3300/0 conn(0x7f674406c700 msgr2=0x7f674406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6748a48700 1 --2- 172.21.15.3:0/3757548877 >> v2:172.21.15.27:3300/0 conn(0x7f674406c700 0x7f674406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6748a48700 1 -- 172.21.15.3:0/3757548877 >> v1:172.21.15.27:6789/0 conn(0x7f674406d9d0 legacy=0x7f674406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6748a48700 1 -- 172.21.15.3:0/3757548877 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674406bb90 con 0x7f6744158dd0 2023-10-08T16:08:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f6748a48700 1 --2- 172.21.15.3:0/3757548877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6744158dd0 0x7f67441591a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f674406de50 tx=0x7f67380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17296917e2c00259 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f67437fe700 1 -- 172.21.15.3:0/3757548877 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738011630 con 0x7f6744158dd0 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f67437fe700 1 -- 172.21.15.3:0/3757548877 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738011790 con 0x7f6744158dd0 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f67437fe700 1 -- 172.21.15.3:0/3757548877 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738011b30 con 0x7f6744158dd0 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- 172.21.15.3:0/3757548877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6744158dd0 msgr2=0x7f67441591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 --2- 172.21.15.3:0/3757548877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6744158dd0 0x7f67441591a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f674406de50 tx=0x7f67380091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- 172.21.15.3:0/3757548877 shutdown_connections 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 --2- 172.21.15.3:0/3757548877 >> v2:172.21.15.27:3300/0 conn(0x7f674406c700 0x7f674406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 --2- 172.21.15.3:0/3757548877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6744158dd0 0x7f67441591a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- 172.21.15.3:0/3757548877 >> 172.21.15.3:0/3757548877 conn(0x7f67440d09d0 msgr2=0x7f67440b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- 172.21.15.3:0/3757548877 shutdown_connections 2023-10-08T16:08:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.201+0000 7f674acac700 1 -- 172.21.15.3:0/3757548877 wait complete. 2023-10-08T16:08:23.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 Processor -- start 2023-10-08T16:08:23.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 -- start start 2023-10-08T16:08:23.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 0x7f674416c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f674406d9d0 0x7f674415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6744158dd0 0x7f674415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440b02e0 con 0x7f674406c700 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440b05c0 con 0x7f6744158dd0 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f674acac700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440b08a0 con 0x7f674406d9d0 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 0x7f674416c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 0x7f674416c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59142/0 (socket says 172.21.15.3:59142) 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 -- 172.21.15.3:0/1675142971 learned_addr learned my addr 172.21.15.3:0/1675142971 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6743fff700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f674406d9d0 0x7f674415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6749249700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6744158dd0 0x7f674415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 -- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f674406d9d0 msgr2=0x7f674415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f674406d9d0 0x7f674415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 -- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6744158dd0 msgr2=0x7f674415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6744158dd0 0x7f674415efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6748a48700 1 -- 172.21.15.3:0/1675142971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738009420 con 0x7f674406c700 2023-10-08T16:08:23.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6743fff700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f674406d9d0 0x7f674415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:23.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.205+0000 7f6749249700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6744158dd0 0x7f674415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:23.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f6748a48700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 0x7f674416c310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6744069b70 tx=0x7f6738017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738011b10 con 0x7f674406c700 2023-10-08T16:08:23.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67380253f0 con 0x7f674406c700 2023-10-08T16:08:23.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67440b0b80 con 0x7f674406c700 2023-10-08T16:08:23.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738025790 con 0x7f674406c700 2023-10-08T16:08:23.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67440aff90 con 0x7f674406c700 2023-10-08T16:08:23.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67440b0dc0 con 0x7f674406c700 2023-10-08T16:08:23.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.209+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6738025b80 con 0x7f674406c700 2023-10-08T16:08:23.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.213+0000 7f6740ff9700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6728060550 0x7f6728062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.213+0000 7f6743fff700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6728060550 0x7f6728062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.213+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f673807e100 con 0x7f674406c700 2023-10-08T16:08:23.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.213+0000 7f6743fff700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6728060550 0x7f6728062a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67441333f0 tx=0x7f6730009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.217+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f673804e650 con 0x7f674406c700 2023-10-08T16:08:23.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.417+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67440b0420 con 0x7f674406c700 2023-10-08T16:08:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.417+0000 7f6740ff9700 1 -- 172.21.15.3:0/1675142971 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4585 (secure 0 0 0) 0x7f67440b0420 con 0x7f674406c700 2023-10-08T16:08:23.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:23.423 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:27.136547+0000","modified":"2023-10-08T16:07:29.780125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3934697799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3934697799},{"type":"v1","addr":"172.21.15.3:6835","nonce":3934697799}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6728060550 msgr2=0x7f6728062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6728060550 0x7f6728062a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67441333f0 tx=0x7f6730009040 comp rx=0 tx=0).stop 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 msgr2=0x7f674416c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 0x7f674416c310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6744069b70 tx=0x7f6738017000 comp rx=0 tx=0).stop 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 shutdown_connections 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6728060550 0x7f6728062a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6744158dd0 0x7f674415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f674406d9d0 0x7f674415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 --2- 172.21.15.3:0/1675142971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674406c700 0x7f674416c310 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 >> 172.21.15.3:0/1675142971 conn(0x7f67440d09d0 msgr2=0x7f6744155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 shutdown_connections 2023-10-08T16:08:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.421+0000 7f674acac700 1 -- 172.21.15.3:0/1675142971 wait complete. 2023-10-08T16:08:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2023-10-08T16:08:23.437 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:23.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 Processor -- start 2023-10-08T16:08:23.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- start start 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa2d40ade60 0x7fa2d40cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa2d40ae230 0x7fa2d40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d40c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d41562c0 con 0x7fa2d40ae230 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d406b0b0 con 0x7fa2d40ade60 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d406b390 con 0x7fa2d40c7660 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa2d40ae230 0x7fa2d40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa2d40ae230 0x7fa2d40cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59156/0 (socket says 172.21.15.3:59156) 2023-10-08T16:08:23.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 -- 172.21.15.3:0/467352117 learned_addr learned my addr 172.21.15.3:0/467352117 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d2d9d700 1 --2- 172.21.15.3:0/467352117 >> v2:172.21.15.27:3300/0 conn(0x7fa2d40ade60 0x7fa2d40cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d359e700 1 --2- 172.21.15.3:0/467352117 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d40c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 -- 172.21.15.3:0/467352117 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 msgr2=0x7fa2d40c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 --2- 172.21.15.3:0/467352117 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d40c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 -- 172.21.15.3:0/467352117 >> v2:172.21.15.27:3300/0 conn(0x7fa2d40ade60 msgr2=0x7fa2d40cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 --2- 172.21.15.3:0/467352117 >> v2:172.21.15.27:3300/0 conn(0x7fa2d40ade60 0x7fa2d40cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 -- 172.21.15.3:0/467352117 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d406b670 con 0x7fa2d40ae230 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d259c700 1 --2- 172.21.15.3:0/467352117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d40cb390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4069ca0 tx=0x7fa2bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9be8858d0ff346 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/467352117 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00b860 con 0x7fa2d40ae230 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/467352117 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00b9c0 con 0x7fa2d40ae230 2023-10-08T16:08:23.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d1d9b700 1 -- 172.21.15.3:0/467352117 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00bd60 con 0x7fa2d40ae230 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- 172.21.15.3:0/467352117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 msgr2=0x7fa2d40cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/467352117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d40cb390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4069ca0 tx=0x7fa2bc009250 comp rx=0 tx=0).stop 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- 172.21.15.3:0/467352117 shutdown_connections 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/467352117 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d40c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/467352117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d40cb390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/467352117 >> v2:172.21.15.27:3300/0 conn(0x7fa2d40ade60 0x7fa2d40cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- 172.21.15.3:0/467352117 >> 172.21.15.3:0/467352117 conn(0x7fa2d40c83d0 msgr2=0x7fa2d40c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- 172.21.15.3:0/467352117 shutdown_connections 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.533+0000 7fa2d88ed700 1 -- 172.21.15.3:0/467352117 wait complete. 2023-10-08T16:08:23.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 Processor -- start 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- start start 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d40ade60 0x7fa2d406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d41553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40c4330 con 0x7fa2d40ae230 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d414ead0 con 0x7fa2d40ade60 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d414f610 con 0x7fa2d40c7660 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d41553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d41553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59164/0 (socket says 172.21.15.3:59164) 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 -- 172.21.15.3:0/2981271331 learned_addr learned my addr 172.21.15.3:0/2981271331 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d2d9d700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d40ade60 0x7fa2d406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d359e700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 -- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 msgr2=0x7fa2d41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d41558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 -- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d40ade60 msgr2=0x7fa2d406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d40ade60 0x7fa2d406d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 -- 172.21.15.3:0/2981271331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc0094f0 con 0x7fa2d40ae230 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d359e700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d259c700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d41553b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40698f0 tx=0x7fa2bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc011e70 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc024440 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d414faa0 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc024800 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d414efc0 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.537+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d414f7c0 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.541+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2bc01a420 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.541+0000 7fa2caffd700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa2b4060580 0x7fa2b4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.541+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2bc07e610 con 0x7fa2d40ae230 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.541+0000 7fa2d2d9d700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa2b4060580 0x7fa2b4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.541+0000 7fa2d2d9d700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa2b4060580 0x7fa2b4062a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0075a0 tx=0x7fa2cc0097e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.545+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2d414f7c0 con 0x7fa2d40ae230 2023-10-08T16:08:23.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.701+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2d414f780 con 0x7fa2d40ae230 2023-10-08T16:08:23.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2caffd700 1 -- 172.21.15.3:0/2981271331 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fa2bc04ec00 con 0x7fa2d40ae230 2023-10-08T16:08:23.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:23.710 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":32,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:07:28.751208+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:25.214157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:26.118148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:23.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa2b4060580 msgr2=0x7fa2b4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa2b4060580 0x7fa2b4062a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0075a0 tx=0x7fa2cc0097e0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 msgr2=0x7fa2d41553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d41553b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40698f0 tx=0x7fa2bc017000 comp rx=0 tx=0).stop 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 shutdown_connections 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa2b4060580 0x7fa2b4062a30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa2d40c7660 0x7fa2d41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa2d40ae230 0x7fa2d41553b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 --2- 172.21.15.3:0/2981271331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d40ade60 0x7fa2d406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 >> 172.21.15.3:0/2981271331 conn(0x7fa2d40c83d0 msgr2=0x7fa2d40c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 shutdown_connections 2023-10-08T16:08:23.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.705+0000 7fa2d88ed700 1 -- 172.21.15.3:0/2981271331 wait complete. 2023-10-08T16:08:23.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:08:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.833+0000 7fbd8ae1e700 1 Processor -- start 2023-10-08T16:08:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.833+0000 7fbd8ae1e700 1 -- start start 2023-10-08T16:08:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbd84155b30 0x7fbd840ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbd840c67c0 0x7fbd8406a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd840adcc0 con 0x7fbd84155f00 2023-10-08T16:08:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd840ad0b0 con 0x7fbd84155b30 2023-10-08T16:08:23.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd840ad390 con 0x7fbd840c67c0 2023-10-08T16:08:23.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbd84155b30 0x7fbd840ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbd84155b30 0x7fbd840ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59166/0 (socket says 172.21.15.3:59166) 2023-10-08T16:08:23.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 -- 172.21.15.3:0/1565653624 learned_addr learned my addr 172.21.15.3:0/1565653624 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:23.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd893bb700 1 --2- 172.21.15.3:0/1565653624 >> v2:172.21.15.27:3300/0 conn(0x7fbd840c67c0 0x7fbd8406a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 -- 172.21.15.3:0/1565653624 >> v2:172.21.15.27:3300/0 conn(0x7fbd840c67c0 msgr2=0x7fbd8406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 --2- 172.21.15.3:0/1565653624 >> v2:172.21.15.27:3300/0 conn(0x7fbd840c67c0 0x7fbd8406a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 -- 172.21.15.3:0/1565653624 >> v1:172.21.15.27:6789/0 conn(0x7fbd84155f00 legacy=0x7fbd840c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 -- 172.21.15.3:0/1565653624 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd840ad670 con 0x7fbd84155b30 2023-10-08T16:08:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd88bba700 1 --2- 172.21.15.3:0/1565653624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd84155b30 0x7fbd840ae150 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbd8406a500 tx=0x7fbd78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdca779577df0a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd837fe700 1 -- 172.21.15.3:0/1565653624 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78009e70 con 0x7fbd84155b30 2023-10-08T16:08:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd837fe700 1 -- 172.21.15.3:0/1565653624 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7800b860 con 0x7fbd84155b30 2023-10-08T16:08:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd837fe700 1 -- 172.21.15.3:0/1565653624 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800bc00 con 0x7fbd84155b30 2023-10-08T16:08:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1565653624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd84155b30 msgr2=0x7fbd840ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1565653624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd84155b30 0x7fbd840ae150 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbd8406a500 tx=0x7fbd78009250 comp rx=0 tx=0).stop 2023-10-08T16:08:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1565653624 shutdown_connections 2023-10-08T16:08:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1565653624 >> v2:172.21.15.27:3300/0 conn(0x7fbd840c67c0 0x7fbd8406a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1565653624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd84155b30 0x7fbd840ae150 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1565653624 >> 172.21.15.3:0/1565653624 conn(0x7fbd84067b30 msgr2=0x7fbd840cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1565653624 shutdown_connections 2023-10-08T16:08:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.837+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1565653624 wait complete. 2023-10-08T16:08:23.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 Processor -- start 2023-10-08T16:08:23.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 -- start start 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 0x7fbd84154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd84155b30 0x7fbd84156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbd84155f00 0x7fbd840b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841596a0 con 0x7fbd840c67c0 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841593a0 con 0x7fbd84155b30 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd8ae1e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84159b30 con 0x7fbd84155f00 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 0x7fbd84154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 0x7fbd84154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59176/0 (socket says 172.21.15.3:59176) 2023-10-08T16:08:23.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 -- 172.21.15.3:0/1067580185 learned_addr learned my addr 172.21.15.3:0/1067580185 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd893bb700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbd84155f00 0x7fbd840b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd83fff700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd84155b30 0x7fbd84156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 -- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbd84155f00 msgr2=0x7fbd840b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbd84155f00 0x7fbd840b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 -- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd84155b30 msgr2=0x7fbd84156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd84155b30 0x7fbd84156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:23.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 -- 172.21.15.3:0/1067580185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780094f0 con 0x7fbd840c67c0 2023-10-08T16:08:23.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd88bba700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 0x7fbd84154210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78011420 con 0x7fbd840c67c0 2023-10-08T16:08:23.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.841+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd78011580 con 0x7fbd840c67c0 2023-10-08T16:08:23.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8415a070 con 0x7fbd840c67c0 2023-10-08T16:08:23.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78011940 con 0x7fbd840c67c0 2023-10-08T16:08:23.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd841568c0 con 0x7fbd840c67c0 2023-10-08T16:08:23.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8404be40 con 0x7fbd840c67c0 2023-10-08T16:08:23.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbd780253f0 con 0x7fbd840c67c0 2023-10-08T16:08:23.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd80ff9700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbd70060550 0x7fbd70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:23.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd7807e150 con 0x7fbd840c67c0 2023-10-08T16:08:23.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd83fff700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbd70060550 0x7fbd70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:23.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.845+0000 7fbd83fff700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbd70060550 0x7fbd70062a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd840a8a40 tx=0x7fbd74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:23.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:23.853+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd7804e740 con 0x7fbd840c67c0 2023-10-08T16:08:24.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.053+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbd840ad950 con 0x7fbd840c67c0 2023-10-08T16:08:24.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T16:08:24.053+0000 7ff88634f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:08:24.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.065+0000 7fbd80ff9700 1 -- 172.21.15.3:0/1067580185 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd78051d60 con 0x7fbd840c67c0 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.065+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbd70060550 msgr2=0x7fbd70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.065+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbd70060550 0x7fbd70062a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd840a8a40 tx=0x7fbd74009040 comp rx=0 tx=0).stop 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.065+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 msgr2=0x7fbd84154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.065+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 0x7fbd84154210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78017000 comp rx=0 tx=0).stop 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 shutdown_connections 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbd70060550 0x7fbd70062a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbd84155f00 0x7fbd840b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd84155b30 0x7fbd84156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 --2- 172.21.15.3:0/1067580185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd840c67c0 0x7fbd84154210 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 >> 172.21.15.3:0/1067580185 conn(0x7fbd84067b30 msgr2=0x7fbd840ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:24.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 shutdown_connections 2023-10-08T16:08:24.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.069+0000 7fbd8ae1e700 1 -- 172.21.15.3:0/1067580185 wait complete. 2023-10-08T16:08:24.074 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:08:24.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:08:24.107 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T16:08:24.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.193+0000 7f3278865700 1 Processor -- start 2023-10-08T16:08:24.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.193+0000 7f3278865700 1 -- start start 2023-10-08T16:08:24.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f327406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f32740af3d0 0x7f32740af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327406d5f0 con 0x7f3274155d80 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327406c700 con 0x7f32740af3d0 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327406c9e0 con 0x7f32740af000 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f326bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3274155d80 0x7f32740b0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33864/0 (socket says 172.21.15.3:33864) 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f326bfff700 1 -- 172.21.15.3:0/1864126728 learned_addr learned my addr 172.21.15.3:0/1864126728 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327359e700 1 --2- 172.21.15.3:0/1864126728 >> v2:172.21.15.27:3300/0 conn(0x7f32740af3d0 0x7f32740af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3272d9d700 1 --2- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f327406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327259c700 1 -- 172.21.15.3:0/1864126728 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104107681 0 0) 0x7f327406d5f0 con 0x7f3274155d80 2023-10-08T16:08:24.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327259c700 1 -- 172.21.15.3:0/1864126728 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3260003570 con 0x7f3274155d80 2023-10-08T16:08:24.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327359e700 1 -- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 msgr2=0x7f327406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:24.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327359e700 1 --2- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f327406da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327359e700 1 -- 172.21.15.3:0/1864126728 >> v1:172.21.15.3:6789/0 conn(0x7f3274155d80 legacy=0x7f32740b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:24.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327259c700 1 -- 172.21.15.3:0/1864126728 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1629851515 0 0) 0x7f3260003570 con 0x7f3274155d80 2023-10-08T16:08:24.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327359e700 1 -- 172.21.15.3:0/1864126728 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327406ccc0 con 0x7f32740af3d0 2023-10-08T16:08:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327359e700 1 --2- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32740af3d0 0x7f32740af870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f326c009e60 tx=0x7f326c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28ecc658fe1b9c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327259c700 1 -- 172.21.15.3:0/1864126728 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00e070 con 0x7f32740af3d0 2023-10-08T16:08:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327259c700 1 -- 172.21.15.3:0/1864126728 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00b7a0 con 0x7f32740af3d0 2023-10-08T16:08:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f327259c700 1 -- 172.21.15.3:0/1864126728 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c001470 con 0x7f32740af3d0 2023-10-08T16:08:24.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32740af3d0 msgr2=0x7f32740af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 --2- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32740af3d0 0x7f32740af870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f326c009e60 tx=0x7f326c009780 comp rx=0 tx=0).stop 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- 172.21.15.3:0/1864126728 shutdown_connections 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 --2- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32740af3d0 0x7f32740af870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 --2- 172.21.15.3:0/1864126728 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f327406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- 172.21.15.3:0/1864126728 >> 172.21.15.3:0/1864126728 conn(0x7f3274067b30 msgr2=0x7f32740adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- 172.21.15.3:0/1864126728 shutdown_connections 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.197+0000 7f3278865700 1 -- 172.21.15.3:0/1864126728 wait complete. 2023-10-08T16:08:24.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 Processor -- start 2023-10-08T16:08:24.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 -- start start 2023-10-08T16:08:24.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f32740c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 0x7f3274164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3274155d80 0x7f32740a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3274167ce0 con 0x7f32740af3d0 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3274167fc0 con 0x7f3274155d80 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3278865700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32741682a0 con 0x7f32740af000 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f326bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 0x7f3274164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f326bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 0x7f3274164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59210/0 (socket says 172.21.15.3:59210) 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f326bfff700 1 -- 172.21.15.3:0/3144870593 learned_addr learned my addr 172.21.15.3:0/3144870593 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f327359e700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3274155d80 0x7f32740a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:24.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.201+0000 7f3272d9d700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f32740c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:24.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326bfff700 1 -- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 msgr2=0x7f32740c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:24.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326bfff700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f32740c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326bfff700 1 -- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3274155d80 msgr2=0x7f32740a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:24.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326bfff700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3274155d80 0x7f32740a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:24.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326bfff700 1 -- 172.21.15.3:0/3144870593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c009a20 con 0x7f32740af3d0 2023-10-08T16:08:24.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326bfff700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 0x7f3274164300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f325c00cb90 tx=0x7f325c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c007150 con 0x7f32740af3d0 2023-10-08T16:08:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c0072d0 con 0x7f32740af3d0 2023-10-08T16:08:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3274168580 con 0x7f32740af3d0 2023-10-08T16:08:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c007690 con 0x7f32740af3d0 2023-10-08T16:08:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3274167900 con 0x7f32740af3d0 2023-10-08T16:08:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327404be40 con 0x7f32740af3d0 2023-10-08T16:08:24.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.205+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f325c004a40 con 0x7f32740af3d0 2023-10-08T16:08:24.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.209+0000 7f326affd700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3254060550 0x7f3254062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:24.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.209+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f325c07c050 con 0x7f32740af3d0 2023-10-08T16:08:24.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.209+0000 7f3272d9d700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3254060550 0x7f3254062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:24.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.209+0000 7f3272d9d700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3254060550 0x7f3254062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f32740adec0 tx=0x7f3264008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:24.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.213+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f325c04c5f0 con 0x7f32740af3d0 2023-10-08T16:08:24.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:24.413+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f327406cfa0 con 0x7f32740af3d0 2023-10-08T16:08:25.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.065+0000 7f326affd700 1 -- 172.21.15.3:0/3144870593 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f325c04fc10 con 0x7f32740af3d0 2023-10-08T16:08:25.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3254060550 msgr2=0x7f3254062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:25.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3254060550 0x7f3254062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f32740adec0 tx=0x7f3264008040 comp rx=0 tx=0).stop 2023-10-08T16:08:25.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 msgr2=0x7f3274164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:25.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 0x7f3274164300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f325c00cb90 tx=0x7f325c001a30 comp rx=0 tx=0).stop 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 shutdown_connections 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3254060550 0x7f3254062a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3274155d80 0x7f32740a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32740af3d0 0x7f3274164300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 --2- 172.21.15.3:0/3144870593 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32740af000 0x7f32740c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 >> 172.21.15.3:0/3144870593 conn(0x7f3274067b30 msgr2=0x7f32741561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 shutdown_connections 2023-10-08T16:08:25.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.069+0000 7f3278865700 1 -- 172.21.15.3:0/3144870593 wait complete. 2023-10-08T16:08:25.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:08:25.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.209+0000 7fbce944f700 1 Processor -- start 2023-10-08T16:08:25.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.209+0000 7fbce944f700 1 -- start start 2023-10-08T16:08:25.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbce40c92e0 0x7fbce40c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:25.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbce40c9780 0x7fbce40c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:25.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40cb200 con 0x7fbce4157a80 2023-10-08T16:08:25.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40c9cf0 con 0x7fbce40c9780 2023-10-08T16:08:25.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40c9fd0 con 0x7fbce40c92e0 2023-10-08T16:08:25.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbce40c9780 0x7fbce40c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:25.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbce40c9780 0x7fbce40c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59212/0 (socket says 172.21.15.3:59212) 2023-10-08T16:08:25.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 -- 172.21.15.3:0/1284915709 learned_addr learned my addr 172.21.15.3:0/1284915709 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:25.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbcda7fc700 1 --2- 172.21.15.3:0/1284915709 >> v2:172.21.15.27:3300/0 conn(0x7fbce40c92e0 0x7fbce40c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:25.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 -- 172.21.15.3:0/1284915709 >> v2:172.21.15.27:3300/0 conn(0x7fbce40c92e0 msgr2=0x7fbce40c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:25.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 --2- 172.21.15.3:0/1284915709 >> v2:172.21.15.27:3300/0 conn(0x7fbce40c92e0 0x7fbce40c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 -- 172.21.15.3:0/1284915709 >> v1:172.21.15.27:6789/0 conn(0x7fbce4157a80 legacy=0x7fbce4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:25.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 -- 172.21.15.3:0/1284915709 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40ca2b0 con 0x7fbce40c9780 2023-10-08T16:08:25.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbcda7fc700 1 --2- 172.21.15.3:0/1284915709 >> v2:172.21.15.27:3300/0 conn(0x7fbce40c92e0 0x7fbce40c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:25.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce37fe700 1 --2- 172.21.15.3:0/1284915709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c9780 0x7fbce40c80a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbce415ab10 tx=0x7fbcdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ecdc3b012b9a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:25.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce27fc700 1 -- 172.21.15.3:0/1284915709 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00e070 con 0x7fbce40c9780 2023-10-08T16:08:25.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce27fc700 1 -- 172.21.15.3:0/1284915709 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00ba50 con 0x7fbce40c9780 2023-10-08T16:08:25.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce27fc700 1 -- 172.21.15.3:0/1284915709 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0092e0 con 0x7fbce40c9780 2023-10-08T16:08:25.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 -- 172.21.15.3:0/1284915709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c9780 msgr2=0x7fbce40c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:25.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 --2- 172.21.15.3:0/1284915709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c9780 0x7fbce40c80a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbce415ab10 tx=0x7fbcdc009840 comp rx=0 tx=0).stop 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 -- 172.21.15.3:0/1284915709 shutdown_connections 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 --2- 172.21.15.3:0/1284915709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c9780 0x7fbce40c80a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 --2- 172.21.15.3:0/1284915709 >> v2:172.21.15.27:3300/0 conn(0x7fbce40c92e0 0x7fbce40c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.213+0000 7fbce944f700 1 -- 172.21.15.3:0/1284915709 >> 172.21.15.3:0/1284915709 conn(0x7fbce406b660 msgr2=0x7fbce406ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.217+0000 7fbce944f700 1 -- 172.21.15.3:0/1284915709 shutdown_connections 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.217+0000 7fbce944f700 1 -- 172.21.15.3:0/1284915709 wait complete. 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.217+0000 7fbce944f700 1 Processor -- start 2023-10-08T16:08:25.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.217+0000 7fbce944f700 1 -- start start 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 0x7fbce41453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbce40c9780 0x7fbce40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce4157a80 0x7fbce40c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4145c00 con 0x7fbce40c92e0 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4146780 con 0x7fbce4157a80 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c5e60 con 0x7fbce40c9780 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 0x7fbce41453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 0x7fbce41453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59216/0 (socket says 172.21.15.3:59216) 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce4157a80 0x7fbce40c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbcda7fc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbce40c9780 0x7fbce40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 -- 172.21.15.3:0/2057986685 learned_addr learned my addr 172.21.15.3:0/2057986685 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:25.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 -- 172.21.15.3:0/2057986685 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbce40c9780 msgr2=0x7fbce40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:25.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbce40c9780 0x7fbce40c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 -- 172.21.15.3:0/2057986685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce4157a80 msgr2=0x7fbce40c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:25.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce4157a80 0x7fbce40c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:25.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 -- 172.21.15.3:0/2057986685 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009ae0 con 0x7fbce40c92e0 2023-10-08T16:08:25.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce2ffd700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 0x7fbce41453f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c5c0 tx=0x7fbcd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011590 con 0x7fbce40c92e0 2023-10-08T16:08:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4011710 con 0x7fbce40c92e0 2023-10-08T16:08:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce4145e50 con 0x7fbce40c92e0 2023-10-08T16:08:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011ad0 con 0x7fbce40c92e0 2023-10-08T16:08:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce4146410 con 0x7fbce40c92e0 2023-10-08T16:08:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.221+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce40c7680 con 0x7fbce40c92e0 2023-10-08T16:08:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.225+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbcd401b3b0 con 0x7fbce40c92e0 2023-10-08T16:08:25.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.225+0000 7fbcdb7fe700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbcc4060550 0x7fbcc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:25.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.225+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbcd407bcc0 con 0x7fbce40c92e0 2023-10-08T16:08:25.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.225+0000 7fbcda7fc700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbcc4060550 0x7fbcc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:25.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.225+0000 7fbcda7fc700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbcc4060550 0x7fbcc4062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbce40c6f70 tx=0x7fbccc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:25.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.233+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbce40c7680 con 0x7fbce40c92e0 2023-10-08T16:08:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:25.397+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbce40c7680 con 0x7fbce40c92e0 2023-10-08T16:08:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.281+0000 7fbcdb7fe700 1 -- 172.21.15.3:0/2057986685 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbce40c7680 con 0x7fbce40c92e0 2023-10-08T16:08:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbcc4060550 msgr2=0x7fbcc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbcc4060550 0x7fbcc4062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbce40c6f70 tx=0x7fbccc008040 comp rx=0 tx=0).stop 2023-10-08T16:08:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 msgr2=0x7fbce41453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 0x7fbce41453f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c5c0 tx=0x7fbcd400c8d0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 shutdown_connections 2023-10-08T16:08:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbcc4060550 0x7fbcc4062a00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce4157a80 0x7fbce40c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbce40c9780 0x7fbce40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 --2- 172.21.15.3:0/2057986685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbce40c92e0 0x7fbce41453f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 >> 172.21.15.3:0/2057986685 conn(0x7fbce406b660 msgr2=0x7fbce40c2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 shutdown_connections 2023-10-08T16:08:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.289+0000 7fbce944f700 1 -- 172.21.15.3:0/2057986685 wait complete. 2023-10-08T16:08:26.296 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:08:26.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:08:26.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.413+0000 7fe7d49f4700 1 Processor -- start 2023-10-08T16:08:26.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.413+0000 7fe7d49f4700 1 -- start start 2023-10-08T16:08:26.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe7d00abbc0 0x7fe7d00cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:26.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00caf10 0x7fe7d00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d00c7d10 con 0x7fe7d00abf90 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d0157130 con 0x7fe7d00abbc0 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00cbfb0 con 0x7fe7d00caf10 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe7d00abbc0 0x7fe7d00cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe7d00abbc0 0x7fe7d00cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59220/0 (socket says 172.21.15.3:59220) 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 -- 172.21.15.3:0/1410013894 learned_addr learned my addr 172.21.15.3:0/1410013894 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7c659c700 1 --2- 172.21.15.3:0/1410013894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00caf10 0x7fe7d00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 -- 172.21.15.3:0/1410013894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00caf10 msgr2=0x7fe7d00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 --2- 172.21.15.3:0/1410013894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00caf10 0x7fe7d00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 -- 172.21.15.3:0/1410013894 >> v1:172.21.15.27:6789/0 conn(0x7fe7d00abf90 legacy=0x7fe7d006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:26.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 -- 172.21.15.3:0/1410013894 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00cb3a0 con 0x7fe7d00abbc0 2023-10-08T16:08:26.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ced9d700 1 --2- 172.21.15.3:0/1410013894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abbc0 0x7fe7d00cc440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb3cb5eab0ac8a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ce59c700 1 -- 172.21.15.3:0/1410013894 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000b860 con 0x7fe7d00abbc0 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ce59c700 1 -- 172.21.15.3:0/1410013894 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000b9c0 con 0x7fe7d00abbc0 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7ce59c700 1 -- 172.21.15.3:0/1410013894 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000bd60 con 0x7fe7d00abbc0 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- 172.21.15.3:0/1410013894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abbc0 msgr2=0x7fe7d00cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/1410013894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abbc0 0x7fe7d00cc440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0009250 comp rx=0 tx=0).stop 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- 172.21.15.3:0/1410013894 shutdown_connections 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/1410013894 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00caf10 0x7fe7d00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/1410013894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abbc0 0x7fe7d00cc440 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- 172.21.15.3:0/1410013894 >> 172.21.15.3:0/1410013894 conn(0x7fe7d006b4a0 msgr2=0x7fe7d006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:26.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.417+0000 7fe7d49f4700 1 -- 172.21.15.3:0/1410013894 shutdown_connections 2023-10-08T16:08:26.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.421+0000 7fe7d49f4700 1 -- 172.21.15.3:0/1410013894 wait complete. 2023-10-08T16:08:26.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.421+0000 7fe7d49f4700 1 Processor -- start 2023-10-08T16:08:26.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.421+0000 7fe7d49f4700 1 -- start start 2023-10-08T16:08:26.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00abbc0 0x7fe7d0167190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 0x7fe7d00b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7d00caf10 0x7fe7d01534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00b11a0 con 0x7fe7d00abf90 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00b1440 con 0x7fe7d00caf10 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00b1720 con 0x7fe7d00abbc0 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 0x7fe7d00b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 0x7fe7d00b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59230/0 (socket says 172.21.15.3:59230) 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 -- 172.21.15.3:0/2355508077 learned_addr learned my addr 172.21.15.3:0/2355508077 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7cf59e700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7d00caf10 0x7fe7d01534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:26.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7ced9d700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00abbc0 0x7fe7d0167190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 -- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00abbc0 msgr2=0x7fe7d0167190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00abbc0 0x7fe7d0167190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 -- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7d00caf10 msgr2=0x7fe7d01534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7d00caf10 0x7fe7d01534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 -- 172.21.15.3:0/2355508077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00094f0 con 0x7fe7d00abf90 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c659c700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 0x7fe7d00b1cc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800d890 tx=0x7fe7b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80125f0 con 0x7fe7d00abf90 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8012770 con 0x7fe7d00abf90 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d00b1a00 con 0x7fe7d00abf90 2023-10-08T16:08:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8012b30 con 0x7fe7d00abf90 2023-10-08T16:08:26.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d00b2200 con 0x7fe7d00abf90 2023-10-08T16:08:26.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.425+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d0070450 con 0x7fe7d00abf90 2023-10-08T16:08:26.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.429+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe7b801e460 con 0x7fe7d00abf90 2023-10-08T16:08:26.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.429+0000 7fe7c77fe700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe7b0060550 0x7fe7b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:26.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.429+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe7b807cc50 con 0x7fe7d00abf90 2023-10-08T16:08:26.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.429+0000 7fe7ced9d700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe7b0060550 0x7fe7b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:26.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.429+0000 7fe7ced9d700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe7b0060550 0x7fe7b0062a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:26.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.437+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe7d0070450 con 0x7fe7d00abf90 2023-10-08T16:08:26.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:26.605+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7d0070450 con 0x7fe7d00abf90 2023-10-08T16:08:27.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.429+0000 7fe7c77fe700 1 -- 172.21.15.3:0/2355508077 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe7d0070450 con 0x7fe7d00abf90 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe7b0060550 msgr2=0x7fe7b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe7b0060550 0x7fe7b0062a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0017000 comp rx=0 tx=0).stop 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 msgr2=0x7fe7d00b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 0x7fe7d00b1cc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800d890 tx=0x7fe7b8008040 comp rx=0 tx=0).stop 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 shutdown_connections 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe7b0060550 0x7fe7b0062a00 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0017000 comp rx=0 tx=0).stop 2023-10-08T16:08:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7d00caf10 0x7fe7d01534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe7d00abf90 0x7fe7d00b1cc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 --2- 172.21.15.3:0/2355508077 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe7d00abbc0 0x7fe7d0167190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 >> 172.21.15.3:0/2355508077 conn(0x7fe7d006b4a0 msgr2=0x7fe7d0067d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:27.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.437+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 shutdown_connections 2023-10-08T16:08:27.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.441+0000 7fe7d49f4700 1 -- 172.21.15.3:0/2355508077 wait complete. 2023-10-08T16:08:27.449 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T16:08:27.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_cap_acquisition_throttle 2023-10-08T16:08:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.565+0000 7f6c92e24700 1 Processor -- start 2023-10-08T16:08:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.565+0000 7f6c92e24700 1 -- start start 2023-10-08T16:08:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c92e24700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c92e24700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0b1cc0 con 0x7f6c8c068990 2023-10-08T16:08:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c92e24700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0c8e20 con 0x7f6c8c156d70 2023-10-08T16:08:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c92e24700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c93e0 con 0x7f6c8c0cbd00 2023-10-08T16:08:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c913c1700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6c8c068990 0x7f6c8c0af120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33868/0 (socket says 172.21.15.3:33868) 2023-10-08T16:08:27.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c913c1700 1 -- 172.21.15.3:0/2013323393 learned_addr learned my addr 172.21.15.3:0/2013323393 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8bfff700 1 --2- 172.21.15.3:0/2013323393 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225360524 0 0) 0x7f6c84001490 con 0x7f6c8c068990 2023-10-08T16:08:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c003570 con 0x7f6c8c068990 2023-10-08T16:08:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471442409 0 0) 0x7f6c8c0c8e20 con 0x7f6c8c156d70 2023-10-08T16:08:27.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c84001490 con 0x7f6c8c156d70 2023-10-08T16:08:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8bfff700 1 -- 172.21.15.3:0/2013323393 >> v1:172.21.15.27:6789/0 conn(0x7f6c8c156d70 legacy=0x7f6c8c068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8bfff700 1 -- 172.21.15.3:0/2013323393 >> v1:172.21.15.3:6789/0 conn(0x7f6c8c068990 legacy=0x7f6c8c0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8bfff700 1 -- 172.21.15.3:0/2013323393 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0c9100 con 0x7f6c8c0cbd00 2023-10-08T16:08:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8bfff700 1 --2- 172.21.15.3:0/2013323393 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c0b1780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009910 tx=0x7f6c780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1670de903eb0383 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:27.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78011630 con 0x7f6c8c0cbd00 2023-10-08T16:08:27.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c78011790 con 0x7f6c8c0cbd00 2023-10-08T16:08:27.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.569+0000 7f6c8b7fe700 1 -- 172.21.15.3:0/2013323393 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78011b30 con 0x7f6c8c0cbd00 2023-10-08T16:08:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 -- 172.21.15.3:0/2013323393 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 msgr2=0x7f6c8c0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 --2- 172.21.15.3:0/2013323393 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c0b1780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009910 tx=0x7f6c780091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 -- 172.21.15.3:0/2013323393 shutdown_connections 2023-10-08T16:08:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 --2- 172.21.15.3:0/2013323393 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c0b1780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 -- 172.21.15.3:0/2013323393 >> 172.21.15.3:0/2013323393 conn(0x7f6c8c06ae00 msgr2=0x7f6c8c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 -- 172.21.15.3:0/2013323393 shutdown_connections 2023-10-08T16:08:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 -- 172.21.15.3:0/2013323393 wait complete. 2023-10-08T16:08:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.573+0000 7f6c92e24700 1 Processor -- start 2023-10-08T16:08:27.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 -- start start 2023-10-08T16:08:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c8c068990 0x7f6c8c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 0x7f6c8c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c1532a0 con 0x7f6c8c156d70 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c153580 con 0x7f6c8c068990 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c153860 con 0x7f6c8c0cbd00 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 0x7f6c8c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 0x7f6c8c1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59246/0 (socket says 172.21.15.3:59246) 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 -- 172.21.15.3:0/3237553578 learned_addr learned my addr 172.21.15.3:0/3237553578 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c90bc0700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c8c068990 0x7f6c8c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c8bfff700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 -- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 msgr2=0x7f6c8c169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 -- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c8c068990 msgr2=0x7f6c8c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c8c068990 0x7f6c8c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 -- 172.21.15.3:0/3237553578 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78009420 con 0x7f6c8c156d70 2023-10-08T16:08:27.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c913c1700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 0x7f6c8c1559a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6c84001460 tx=0x7f6c84001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:27.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400aa90 con 0x7f6c8c156d70 2023-10-08T16:08:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400abf0 con 0x7f6c8c156d70 2023-10-08T16:08:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c153b40 con 0x7f6c8c156d70 2023-10-08T16:08:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c840070f0 con 0x7f6c8c156d70 2023-10-08T16:08:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.577+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c169e80 con 0x7f6c8c156d70 2023-10-08T16:08:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.581+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c154040 con 0x7f6c8c156d70 2023-10-08T16:08:27.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.581+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c84007520 con 0x7f6c8c156d70 2023-10-08T16:08:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.581+0000 7f6c88ff9700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c70060550 0x7f6c70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.581+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6c8407c760 con 0x7f6c8c156d70 2023-10-08T16:08:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.581+0000 7f6c90bc0700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c70060550 0x7f6c70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.581+0000 7f6c90bc0700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c70060550 0x7f6c70062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007fd0 tx=0x7f6c80007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:27.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.585+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6c8404d030 con 0x7f6c8c156d70 2023-10-08T16:08:27.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.765+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"} v 0) v1 -- 0x7f6c8c0b1cc0 con 0x7f6c8c156d70 2023-10-08T16:08:27.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c88ff9700 1 -- 172.21.15.3:0/3237553578 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"}]=0 v13) v1 ==== 119+0+0 (secure 0 0 0) 0x7f6c8c0b1cc0 con 0x7f6c8c156d70 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c70060550 msgr2=0x7f6c70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c70060550 0x7f6c70062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007fd0 tx=0x7f6c80007d30 comp rx=0 tx=0).stop 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 msgr2=0x7f6c8c1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 0x7f6c8c1559a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6c84001460 tx=0x7f6c84001bb0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 shutdown_connections 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6c70060550 0x7f6c70062a00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c8c156d70 0x7f6c8c1559a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6c8c0cbd00 0x7f6c8c169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 --2- 172.21.15.3:0/3237553578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c8c068990 0x7f6c8c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 >> 172.21.15.3:0/3237553578 conn(0x7f6c8c06ae00 msgr2=0x7f6c8c0abd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:27.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.773+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 shutdown_connections 2023-10-08T16:08:27.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.777+0000 7f6c92e24700 1 -- 172.21.15.3:0/3237553578 wait complete. 2023-10-08T16:08:27.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:08:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 Processor -- start 2023-10-08T16:08:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 -- start start 2023-10-08T16:08:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6278155d80 0x7f62780b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62780b14c0 0x7f62780af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627806d5f0 con 0x7f62780af000 2023-10-08T16:08:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627806e190 con 0x7f6278155d80 2023-10-08T16:08:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d88e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627806c700 con 0x7f62780b14c0 2023-10-08T16:08:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627c88c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f62780af000 0x7f627806da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:33874/0 (socket says 172.21.15.3:33874) 2023-10-08T16:08:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627c88c700 1 -- 172.21.15.3:0/1098554908 learned_addr learned my addr 172.21.15.3:0/1098554908 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f6277fff700 1 --2- 172.21.15.3:0/1098554908 >> v2:172.21.15.3:3300/0 conn(0x7f6278155d80 0x7f62780b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f627d08d700 1 --2- 172.21.15.3:0/1098554908 >> v2:172.21.15.27:3300/0 conn(0x7f62780b14c0 0x7f62780af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f62777fe700 1 -- 172.21.15.3:0/1098554908 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120311891 0 0) 0x7f627806d5f0 con 0x7f62780af000 2023-10-08T16:08:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f62777fe700 1 -- 172.21.15.3:0/1098554908 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6260003570 con 0x7f62780af000 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.893+0000 7f62777fe700 1 -- 172.21.15.3:0/1098554908 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388953368 0 0) 0x7f6260003570 con 0x7f62780af000 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f6277fff700 1 -- 172.21.15.3:0/1098554908 >> v2:172.21.15.27:3300/0 conn(0x7f62780b14c0 msgr2=0x7f62780af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f6277fff700 1 --2- 172.21.15.3:0/1098554908 >> v2:172.21.15.27:3300/0 conn(0x7f62780b14c0 0x7f62780af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f6277fff700 1 -- 172.21.15.3:0/1098554908 >> v1:172.21.15.3:6789/0 conn(0x7f62780af000 legacy=0x7f627806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f6277fff700 1 -- 172.21.15.3:0/1098554908 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627806c9e0 con 0x7f6278155d80 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d08d700 1 --2- 172.21.15.3:0/1098554908 >> v2:172.21.15.27:3300/0 conn(0x7f62780b14c0 0x7f62780af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f6277fff700 1 --2- 172.21.15.3:0/1098554908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6278155d80 0x7f62780b0f80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f62780ae980 tx=0x7f626c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181c64607f92bfc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f62777fe700 1 -- 172.21.15.3:0/1098554908 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62680017f0 con 0x7f6278155d80 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f62777fe700 1 -- 172.21.15.3:0/1098554908 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c011420 con 0x7f6278155d80 2023-10-08T16:08:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f62777fe700 1 -- 172.21.15.3:0/1098554908 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0117c0 con 0x7f6278155d80 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 -- 172.21.15.3:0/1098554908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6278155d80 msgr2=0x7f62780b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 --2- 172.21.15.3:0/1098554908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6278155d80 0x7f62780b0f80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f62780ae980 tx=0x7f626c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 -- 172.21.15.3:0/1098554908 shutdown_connections 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 --2- 172.21.15.3:0/1098554908 >> v2:172.21.15.27:3300/0 conn(0x7f62780b14c0 0x7f62780af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 --2- 172.21.15.3:0/1098554908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6278155d80 0x7f62780b0f80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 -- 172.21.15.3:0/1098554908 >> 172.21.15.3:0/1098554908 conn(0x7f6278067b30 msgr2=0x7f62780adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 -- 172.21.15.3:0/1098554908 shutdown_connections 2023-10-08T16:08:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 -- 172.21.15.3:0/1098554908 wait complete. 2023-10-08T16:08:27.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 Processor -- start 2023-10-08T16:08:27.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.897+0000 7f627d88e700 1 -- start start 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62780af000 0x7f6278166850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62780b14c0 0x7f6278169660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 0x7f62780ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278166d90 con 0x7f627814f250 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62781502f0 con 0x7f62780af000 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6278169ba0 con 0x7f62780b14c0 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 0x7f62780ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 0x7f62780ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59270/0 (socket says 172.21.15.3:59270) 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627c88c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62780af000 0x7f6278166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 -- 172.21.15.3:0/1472818551 learned_addr learned my addr 172.21.15.3:0/1472818551 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f6277fff700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62780b14c0 0x7f6278169660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 -- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62780b14c0 msgr2=0x7f6278169660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62780b14c0 0x7f6278169660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 -- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62780af000 msgr2=0x7f6278166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62780af000 0x7f6278166850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 -- 172.21.15.3:0/1472818551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009420 con 0x7f627814f250 2023-10-08T16:08:27.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d08d700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 0x7f62780ac370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f627000d860 tx=0x7f6270008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:27.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700125f0 con 0x7f627814f250 2023-10-08T16:08:27.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270012750 con 0x7f627814f250 2023-10-08T16:08:27.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627814f6e0 con 0x7f627814f250 2023-10-08T16:08:27.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012ad0 con 0x7f627814f250 2023-10-08T16:08:27.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.901+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627814fca0 con 0x7f627814f250 2023-10-08T16:08:27.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.905+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278150460 con 0x7f627814f250 2023-10-08T16:08:27.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.905+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6270013480 con 0x7f627814f250 2023-10-08T16:08:27.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.905+0000 7f6274ff9700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6264060550 0x7f6264062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:27.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.905+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f627007c6d0 con 0x7f627814f250 2023-10-08T16:08:27.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.905+0000 7f627c88c700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6264060550 0x7f6264062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:27.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.905+0000 7f627c88c700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6264060550 0x7f6264062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6268001560 tx=0x7f6268001640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:27.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:27.913+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f62700509b0 con 0x7f627814f250 2023-10-08T16:08:28.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.073+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f627804be40 con 0x7f627814f250 2023-10-08T16:08:28.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f6274ff9700 1 -- 172.21.15.3:0/1472818551 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6270050540 con 0x7f627814f250 2023-10-08T16:08:28.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6264060550 msgr2=0x7f6264062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6264060550 0x7f6264062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6268001560 tx=0x7f6268001640 comp rx=0 tx=0).stop 2023-10-08T16:08:28.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 msgr2=0x7f62780ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 0x7f62780ac370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f627000d860 tx=0x7f6270008040 comp rx=0 tx=0).stop 2023-10-08T16:08:28.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 shutdown_connections 2023-10-08T16:08:28.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6264060550 0x7f6264062a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f627814f250 0x7f62780ac370 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f62780b14c0 0x7f6278169660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 --2- 172.21.15.3:0/1472818551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62780af000 0x7f6278166850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 >> 172.21.15.3:0/1472818551 conn(0x7f6278067b30 msgr2=0x7f62780c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 shutdown_connections 2023-10-08T16:08:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.085+0000 7f627d88e700 1 -- 172.21.15.3:0/1472818551 wait complete. 2023-10-08T16:08:28.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2023-10-08T16:08:28.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 Processor -- start 2023-10-08T16:08:28.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 -- start start 2023-10-08T16:08:28.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48c80c6e00 0x7f48c80ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c806d640 con 0x7f48c815b180 2023-10-08T16:08:28.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c806e010 con 0x7f48c80c6e00 2023-10-08T16:08:28.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8157010 con 0x7f48c80adb20 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c6ffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48c80c6e00 0x7f48c80ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c67fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f48c815b180 0x7f48c80c66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:37390/0 (socket says 172.21.15.3:37390) 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c67fc700 1 -- 172.21.15.3:0/2656348220 learned_addr learned my addr 172.21.15.3:0/2656348220 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c5ffb700 1 -- 172.21.15.3:0/2656348220 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464471922 0 0) 0x7f48c806d640 con 0x7f48c815b180 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c5ffb700 1 -- 172.21.15.3:0/2656348220 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b0003570 con 0x7f48c815b180 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c6ffd700 1 -- 172.21.15.3:0/2656348220 >> v2:172.21.15.27:3300/0 conn(0x7f48c80c6e00 msgr2=0x7f48c80ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c6ffd700 1 --2- 172.21.15.3:0/2656348220 >> v2:172.21.15.27:3300/0 conn(0x7f48c80c6e00 0x7f48c80ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c6ffd700 1 -- 172.21.15.3:0/2656348220 >> v1:172.21.15.27:6789/0 conn(0x7f48c815b180 legacy=0x7f48c80c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c6ffd700 1 -- 172.21.15.3:0/2656348220 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c806ca30 con 0x7f48c80adb20 2023-10-08T16:08:28.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c77fe700 1 --2- 172.21.15.3:0/2656348220 >> v2:172.21.15.27:3300/0 conn(0x7f48c80c6e00 0x7f48c80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c6ffd700 1 --2- 172.21.15.3:0/2656348220 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c806dad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48b80098d0 tx=0x7f48b8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f465887c9b93c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c5ffb700 1 -- 172.21.15.3:0/2656348220 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8005c10 con 0x7f48c80adb20 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c5ffb700 1 -- 172.21.15.3:0/2656348220 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8005d70 con 0x7f48c80adb20 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c5ffb700 1 -- 172.21.15.3:0/2656348220 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8006260 con 0x7f48c80adb20 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 -- 172.21.15.3:0/2656348220 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 msgr2=0x7f48c806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.221+0000 7f48c7fff700 1 --2- 172.21.15.3:0/2656348220 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c806dad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48b80098d0 tx=0x7f48b8009120 comp rx=0 tx=0).stop 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- 172.21.15.3:0/2656348220 shutdown_connections 2023-10-08T16:08:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 --2- 172.21.15.3:0/2656348220 >> v2:172.21.15.27:3300/0 conn(0x7f48c80c6e00 0x7f48c80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 --2- 172.21.15.3:0/2656348220 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c806dad0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- 172.21.15.3:0/2656348220 >> 172.21.15.3:0/2656348220 conn(0x7f48c80c83b0 msgr2=0x7f48c80c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- 172.21.15.3:0/2656348220 shutdown_connections 2023-10-08T16:08:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- 172.21.15.3:0/2656348220 wait complete. 2023-10-08T16:08:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 Processor -- start 2023-10-08T16:08:28.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- start start 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 0x7f48c816b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c815b180 0x7f48c80c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80b0c30 con 0x7f48c80c6e00 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80c5670 con 0x7f48c815b180 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c7fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c816b590 con 0x7f48c80adb20 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 0x7f48c816b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 0x7f48c816b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59274/0 (socket says 172.21.15.3:59274) 2023-10-08T16:08:28.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c6ffd700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c67fc700 1 -- 172.21.15.3:0/170187624 learned_addr learned my addr 172.21.15.3:0/170187624 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:28.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.225+0000 7f48c77fe700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c815b180 0x7f48c80c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c6ffd700 1 -- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c815b180 msgr2=0x7f48c80c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c6ffd700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c815b180 0x7f48c80c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c6ffd700 1 -- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 msgr2=0x7f48c816b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c6ffd700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 0x7f48c816b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c6ffd700 1 -- 172.21.15.3:0/170187624 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0009a20 con 0x7f48c80adb20 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c67fc700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 0x7f48c816b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c6ffd700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c80b10c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48c8070420 tx=0x7f48b8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:28.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b801d6b0 con 0x7f48c80adb20 2023-10-08T16:08:28.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b80093c0 con 0x7f48c80adb20 2023-10-08T16:08:28.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b801d810 con 0x7f48c80adb20 2023-10-08T16:08:28.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c80b0300 con 0x7f48c80adb20 2023-10-08T16:08:28.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b801dbd0 con 0x7f48c80adb20 2023-10-08T16:08:28.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c804be40 con 0x7f48c80adb20 2023-10-08T16:08:28.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.229+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f48b801b690 con 0x7f48c80adb20 2023-10-08T16:08:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.233+0000 7f48aeffd700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f48b4060550 0x7f48b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.233+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f48b807e890 con 0x7f48c80adb20 2023-10-08T16:08:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.233+0000 7f48c67fc700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f48b4060550 0x7f48b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.233+0000 7f48c67fc700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f48b4060550 0x7f48b4062a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48c80c90c0 tx=0x7f48bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:28.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.241+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f48b804f180 con 0x7f48c80adb20 2023-10-08T16:08:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.405+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) v1 -- 0x7f48c806f230 con 0x7f48c80adb20 2023-10-08T16:08:28.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.417+0000 7f48aeffd700 1 -- 172.21.15.3:0/170187624 <== mon.2 v2:172.21.15.27:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v15) v1 ==== 106+0+0 (secure 0 0 0) 0x7f48b80527a0 con 0x7f48c80adb20 2023-10-08T16:08:28.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f48b4060550 msgr2=0x7f48b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f48b4060550 0x7f48b4062a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48c80c90c0 tx=0x7f48bc009040 comp rx=0 tx=0).stop 2023-10-08T16:08:28.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 msgr2=0x7f48c80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c80b10c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48c8070420 tx=0x7f48b8016000 comp rx=0 tx=0).stop 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 shutdown_connections 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f48b4060550 0x7f48b4062a00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c815b180 0x7f48c80c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48c80c6e00 0x7f48c816b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 --2- 172.21.15.3:0/170187624 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48c80adb20 0x7f48c80b10c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 >> 172.21.15.3:0/170187624 conn(0x7f48c80c83b0 msgr2=0x7f48c80ab4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 shutdown_connections 2023-10-08T16:08:28.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.421+0000 7f48c7fff700 1 -- 172.21.15.3:0/170187624 wait complete. 2023-10-08T16:08:28.443 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2023-10-08T16:08:28.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 Processor -- start 2023-10-08T16:08:28.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 -- start start 2023-10-08T16:08:28.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406aeb0 0x7f68940ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f689406d900 0x7f689415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689406c3a0 con 0x7f68940ca070 2023-10-08T16:08:28.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689406c8a0 con 0x7f689406d900 2023-10-08T16:08:28.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689ad7a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689406cb40 con 0x7f689406aeb0 2023-10-08T16:08:28.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f689406d900 0x7f689415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f689406d900 0x7f689415ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59286/0 (socket says 172.21.15.3:59286) 2023-10-08T16:08:28.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 -- 172.21.15.3:0/2784692916 learned_addr learned my addr 172.21.15.3:0/2784692916 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:28.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f6899577700 1 --2- 172.21.15.3:0/2784692916 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406aeb0 0x7f68940ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 -- 172.21.15.3:0/2784692916 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406aeb0 msgr2=0x7f68940ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 --2- 172.21.15.3:0/2784692916 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406aeb0 0x7f68940ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 -- 172.21.15.3:0/2784692916 >> v1:172.21.15.27:6789/0 conn(0x7f68940ca070 legacy=0x7f689406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 -- 172.21.15.3:0/2784692916 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689406ce20 con 0x7f689406d900 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f689a579700 1 --2- 172.21.15.3:0/2784692916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689406d900 0x7f689415ce90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f688c0099b0 tx=0x7f688c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1819e4883a18e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f6898d76700 1 -- 172.21.15.3:0/2784692916 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c00b860 con 0x7f689406d900 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f6898d76700 1 -- 172.21.15.3:0/2784692916 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c00b9c0 con 0x7f689406d900 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.541+0000 7f6898d76700 1 -- 172.21.15.3:0/2784692916 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c00bd60 con 0x7f689406d900 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 -- 172.21.15.3:0/2784692916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689406d900 msgr2=0x7f689415ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2784692916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689406d900 0x7f689415ce90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f688c0099b0 tx=0x7f688c009250 comp rx=0 tx=0).stop 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 -- 172.21.15.3:0/2784692916 shutdown_connections 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2784692916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689406d900 0x7f689415ce90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2784692916 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406aeb0 0x7f68940ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 -- 172.21.15.3:0/2784692916 >> 172.21.15.3:0/2784692916 conn(0x7f68940c83d0 msgr2=0x7f68940c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 -- 172.21.15.3:0/2784692916 shutdown_connections 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 -- 172.21.15.3:0/2784692916 wait complete. 2023-10-08T16:08:28.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 Processor -- start 2023-10-08T16:08:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 -- start start 2023-10-08T16:08:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406d900 0x7f6894156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940ca070 0x7f689414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.545+0000 7f689ad7a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 0x7f6894170dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689ad7a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894156670 con 0x7f689414d350 2023-10-08T16:08:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689ad7a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b16a0 con 0x7f68940ca070 2023-10-08T16:08:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689ad7a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b06b0 con 0x7f689406d900 2023-10-08T16:08:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 0x7f6894170dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 0x7f6894170dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59294/0 (socket says 172.21.15.3:59294) 2023-10-08T16:08:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 -- 172.21.15.3:0/2021088629 learned_addr learned my addr 172.21.15.3:0/2021088629 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f6899577700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940ca070 0x7f689414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f6899d78700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406d900 0x7f6894156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 -- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406d900 msgr2=0x7f6894156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406d900 0x7f6894156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 -- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940ca070 msgr2=0x7f689414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940ca070 0x7f689414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 -- 172.21.15.3:0/2021088629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0094f0 con 0x7f689414d350 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689a579700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 0x7f6894170dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6894069b80 tx=0x7f688c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c00b860 con 0x7f689414d350 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c01a630 con 0x7f689414d350 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68940afdc0 con 0x7f689414d350 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c01aa10 con 0x7f689414d350 2023-10-08T16:08:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68940b00e0 con 0x7f689414d350 2023-10-08T16:08:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.549+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68940b0860 con 0x7f689414d350 2023-10-08T16:08:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.553+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f688c02d440 con 0x7f689414d350 2023-10-08T16:08:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.553+0000 7f6889ffb700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6880060580 0x7f6880062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.553+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f688c07dee0 con 0x7f689414d350 2023-10-08T16:08:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.553+0000 7f6899d78700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6880060580 0x7f6880062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.553+0000 7f6899d78700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6880060580 0x7f6880062a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f68840039e0 tx=0x7f6884007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.561+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f68940b0860 con 0x7f689414d350 2023-10-08T16:08:28.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:28.777+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) v1 -- 0x7f68940b0460 con 0x7f689414d350 2023-10-08T16:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.433+0000 7f6889ffb700 1 -- 172.21.15.3:0/2021088629 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v108) v1 ==== 165+0+0 (secure 0 0 0) 0x7f688c052260 con 0x7f689414d350 2023-10-08T16:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6880060580 msgr2=0x7f6880062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6880060580 0x7f6880062a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f68840039e0 tx=0x7f6884007ec0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 msgr2=0x7f6894170dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 0x7f6894170dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6894069b80 tx=0x7f688c017000 comp rx=0 tx=0).stop 2023-10-08T16:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 shutdown_connections 2023-10-08T16:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6880060580 0x7f6880062a30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f689414d350 0x7f6894170dc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940ca070 0x7f689414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 --2- 172.21.15.3:0/2021088629 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f689406d900 0x7f6894156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 >> 172.21.15.3:0/2021088629 conn(0x7f68940c83d0 msgr2=0x7f689406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:29.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 shutdown_connections 2023-10-08T16:08:29.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.437+0000 7f689ad7a700 1 -- 172.21.15.3:0/2021088629 wait complete. 2023-10-08T16:08:29.459 INFO:tasks.cephfs_test_runner:Mostly readdir acquires caps faster than the mds recalls, so the cap ... ok 2023-10-08T16:08:29.459 INFO:tasks.cephfs_test_runner:Starting test: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) that a client is blocklisted when its encoded session metadata exceeds the 2023-10-08T16:08:29.459 INFO:tasks.cephfs_test_runner:test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-10-08T16:08:29.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2023-10-08T16:08:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.573+0000 7f48a5489700 1 Processor -- start 2023-10-08T16:08:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.573+0000 7f48a5489700 1 -- start start 2023-10-08T16:08:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a0068640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48a0068b80 0x7f48a006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48a0159290 0x7f48a006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a0067350 con 0x7f48a0068b80 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a00681b0 con 0x7f48a0159290 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00675a0 con 0x7f48a0158ec0 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48a0068b80 0x7f48a006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48a0068b80 0x7f48a006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59296/0 (socket says 172.21.15.3:59296) 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 -- 172.21.15.3:0/3545903718 learned_addr learned my addr 172.21.15.3:0/3545903718 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f489ffff700 1 --2- 172.21.15.3:0/3545903718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a0068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a4c88700 1 --2- 172.21.15.3:0/3545903718 >> v2:172.21.15.27:3300/0 conn(0x7f48a0159290 0x7f48a006dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 -- 172.21.15.3:0/3545903718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 msgr2=0x7f48a0068640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 --2- 172.21.15.3:0/3545903718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a0068640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 -- 172.21.15.3:0/3545903718 >> v2:172.21.15.27:3300/0 conn(0x7f48a0159290 msgr2=0x7f48a006dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 --2- 172.21.15.3:0/3545903718 >> v2:172.21.15.27:3300/0 conn(0x7f48a0159290 0x7f48a006dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 -- 172.21.15.3:0/3545903718 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0067880 con 0x7f48a0068b80 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48977fe700 1 --2- 172.21.15.3:0/3545903718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a006d770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f48a0070850 tx=0x7f4888009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c5a48e5a59e668 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f489f7fe700 1 -- 172.21.15.3:0/3545903718 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800b640 con 0x7f48a0068b80 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f489f7fe700 1 -- 172.21.15.3:0/3545903718 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800b7a0 con 0x7f48a0068b80 2023-10-08T16:08:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f489f7fe700 1 -- 172.21.15.3:0/3545903718 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800bb60 con 0x7f48a0068b80 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- 172.21.15.3:0/3545903718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 msgr2=0x7f48a006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- 172.21.15.3:0/3545903718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a006d770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f48a0070850 tx=0x7f4888009250 comp rx=0 tx=0).stop 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- 172.21.15.3:0/3545903718 shutdown_connections 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- 172.21.15.3:0/3545903718 >> v2:172.21.15.27:3300/0 conn(0x7f48a0159290 0x7f48a006dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- 172.21.15.3:0/3545903718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a006d770 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 --2- 172.21.15.3:0/3545903718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a0068640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- 172.21.15.3:0/3545903718 >> 172.21.15.3:0/3545903718 conn(0x7f48a00ca600 msgr2=0x7f48a00caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- 172.21.15.3:0/3545903718 shutdown_connections 2023-10-08T16:08:29.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.577+0000 7f48a5489700 1 -- 172.21.15.3:0/3545903718 wait complete. 2023-10-08T16:08:29.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 Processor -- start 2023-10-08T16:08:29.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 -- start start 2023-10-08T16:08:29.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a00c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a00c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48a0159290 0x7f48a00c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c38b0 con 0x7f48a0068b80 2023-10-08T16:08:29.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c2ca0 con 0x7f48a0159290 2023-10-08T16:08:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c2f80 con 0x7f48a0158ec0 2023-10-08T16:08:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a00c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a00c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59306/0 (socket says 172.21.15.3:59306) 2023-10-08T16:08:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 -- 172.21.15.3:0/2769255226 learned_addr learned my addr 172.21.15.3:0/2769255226 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48977fe700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a00c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a4c88700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48a0159290 0x7f48a00c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 -- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 msgr2=0x7f48a00c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a00c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 -- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48a0159290 msgr2=0x7f48a00c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48a0159290 0x7f48a00c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:29.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 -- 172.21.15.3:0/2769255226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880094f0 con 0x7f48a0068b80 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489ffff700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a00c3d40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f489000ec80 tx=0x7f48900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489000c850 con 0x7f48a0068b80 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489000c9d0 con 0x7f48a0068b80 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.581+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a00c3260 con 0x7f48a0068b80 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489000cd90 con 0x7f48a0068b80 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a00c2930 con 0x7f48a0068b80 2023-10-08T16:08:29.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a004be40 con 0x7f48a0068b80 2023-10-08T16:08:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4890013680 con 0x7f48a0068b80 2023-10-08T16:08:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f489cff9700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4880060550 0x7f4880062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f489007c7b0 con 0x7f48a0068b80 2023-10-08T16:08:29.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f48977fe700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4880060550 0x7f4880062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:29.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.585+0000 7f48977fe700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4880060550 0x7f4880062a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48a0070850 tx=0x7f4888017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.593+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f489004d0a0 con 0x7f48a0068b80 2023-10-08T16:08:29.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:29.813+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) v1 -- 0x7f48a0067b60 con 0x7f48a0068b80 2023-10-08T16:08:30.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.441+0000 7f489cff9700 1 -- 172.21.15.3:0/2769255226 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v109) v1 ==== 165+0+0 (secure 0 0 0) 0x7f48900506c0 con 0x7f48a0068b80 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4880060550 msgr2=0x7f4880062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4880060550 0x7f4880062a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48a0070850 tx=0x7f4888017000 comp rx=0 tx=0).stop 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 msgr2=0x7f48a00c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a00c3d40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f489000ec80 tx=0x7f48900091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 shutdown_connections 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4880060550 0x7f4880062a00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48a0159290 0x7f48a00c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f48a0158ec0 0x7f48a00c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 --2- 172.21.15.3:0/2769255226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48a0068b80 0x7f48a00c3d40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 >> 172.21.15.3:0/2769255226 conn(0x7f48a00ca600 msgr2=0x7f48a0157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 shutdown_connections 2023-10-08T16:08:30.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.445+0000 7f48a5489700 1 -- 172.21.15.3:0/2769255226 wait complete. 2023-10-08T16:08:30.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:08:30.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f403ee8a700 1 Processor -- start 2023-10-08T16:08:30.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f403ee8a700 1 -- start start 2023-10-08T16:08:30.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f403ee8a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4038159410 0x7f40380ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f403ee8a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40380cb380 con 0x7f40380cd420 2023-10-08T16:08:30.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f403ee8a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403806b5e0 con 0x7f4038159040 2023-10-08T16:08:30.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f403ee8a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40380caa90 con 0x7f4038159410 2023-10-08T16:08:30.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.585+0000 7f4037fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f40380cd420 0x7f403806aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54006/0 (socket says 172.21.15.3:54006) 2023-10-08T16:08:30.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f4037fff700 1 -- 172.21.15.3:0/2338981921 learned_addr learned my addr 172.21.15.3:0/2338981921 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:30.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4038159410 0x7f40380ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000896094 0 0) 0x7f40380cb380 con 0x7f40380cd420 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4024003570 con 0x7f40380cd420 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803398005 0 0) 0x7f4024003570 con 0x7f40380cd420 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4038159410 msgr2=0x7f40380ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4038159410 0x7f40380ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 >> v1:172.21.15.27:6789/0 conn(0x7f4038159040 legacy=0x7f40380b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403806b850 con 0x7f40380cd420 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f4028001470 con 0x7f40380cd420 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 >> v1:172.21.15.3:6789/0 conn(0x7f40380cd420 legacy=0x7f403806aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4024003a90 0x7f4024003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40240043a0 0x7f4024004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4024005020 0x7f402400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40380caa90 con 0x7f4024005020 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402400bfa0 con 0x7f40240043a0 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402400c0e0 con 0x7f4024003a90 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4024005020 0x7f402400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f4037fff700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40240043a0 0x7f4024004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403cc26700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4024003a90 0x7f4024003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 -- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4024003a90 msgr2=0x7f4024003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4024003a90 0x7f4024003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 -- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40240043a0 msgr2=0x7f4024004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:30.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40240043a0 0x7f4024004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 -- 172.21.15.3:0/2338981921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024003570 con 0x7f4024005020 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403cc26700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4024003a90 0x7f4024003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4024005020 0x7f402400ba60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f403000e210 tx=0x7f403000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11098f08d11f96c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000eac0 con 0x7f4024005020 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403000f040 con 0x7f4024005020 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f40377fe700 1 -- 172.21.15.3:0/2338981921 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000ee70 con 0x7f4024005020 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403ee8a700 1 -- 172.21.15.3:0/2338981921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4024005020 msgr2=0x7f402400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403ee8a700 1 --2- 172.21.15.3:0/2338981921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4024005020 0x7f402400ba60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f403000e210 tx=0x7f403000b040 comp rx=0 tx=0).stop 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403d427700 1 -- 172.21.15.3:0/2338981921 reap_dead start 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403ee8a700 1 -- 172.21.15.3:0/2338981921 shutdown_connections 2023-10-08T16:08:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403ee8a700 1 -- 172.21.15.3:0/2338981921 >> 172.21.15.3:0/2338981921 conn(0x7f40380d0920 msgr2=0x7f40380cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403ee8a700 1 -- 172.21.15.3:0/2338981921 shutdown_connections 2023-10-08T16:08:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.589+0000 7f403ee8a700 1 -- 172.21.15.3:0/2338981921 wait complete. 2023-10-08T16:08:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 Processor -- start 2023-10-08T16:08:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 -- start start 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f40381406c0 0x7f4038157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40380c9b40 0x7f40381575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 0x7f403814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40380c8aa0 con 0x7f4038140a90 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40380c8d80 con 0x7f40380c9b40 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40380c9060 con 0x7f40381406c0 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 0x7f403814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 0x7f403814c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55186/0 (socket says 172.21.15.3:55186) 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 -- 172.21.15.3:0/3776879974 learned_addr learned my addr 172.21.15.3:0/3776879974 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403cc26700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f40381406c0 0x7f4038157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f4037fff700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40380c9b40 0x7f40381575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 -- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f40381406c0 msgr2=0x7f4038157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f40381406c0 0x7f4038157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 -- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40380c9b40 msgr2=0x7f40381575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40380c9b40 0x7f40381575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 -- 172.21.15.3:0/3776879974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40380c9340 con 0x7f4038140a90 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403d427700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 0x7f403814c3d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f403000afd0 tx=0x7f403001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000eec0 con 0x7f4038140a90 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030022070 con 0x7f4038140a90 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403001e870 con 0x7f4038140a90 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40380c9620 con 0x7f4038140a90 2023-10-08T16:08:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.593+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403814cb30 con 0x7f4038140a90 2023-10-08T16:08:30.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.597+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40380c9810 con 0x7f4038140a90 2023-10-08T16:08:30.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.597+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4030003040 con 0x7f4038140a90 2023-10-08T16:08:30.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.597+0000 7f4034ff9700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4018060550 0x7f4018062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.597+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4030024070 con 0x7f4038140a90 2023-10-08T16:08:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.597+0000 7f403cc26700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4018060550 0x7f4018062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.597+0000 7f403cc26700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4018060550 0x7f4018062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4020007ba0 tx=0x7f4020009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.605+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f403004eaa0 con 0x7f4038140a90 2023-10-08T16:08:30.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.765+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4038071180 con 0x7f4038140a90 2023-10-08T16:08:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.773+0000 7f4034ff9700 1 -- 172.21.15.3:0/3776879974 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f40300520c0 con 0x7f4038140a90 2023-10-08T16:08:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4018060550 msgr2=0x7f4018062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4018060550 0x7f4018062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4020007ba0 tx=0x7f4020009040 comp rx=0 tx=0).stop 2023-10-08T16:08:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 msgr2=0x7f403814c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 0x7f403814c3d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f403000afd0 tx=0x7f403001a000 comp rx=0 tx=0).stop 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 shutdown_connections 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4018060550 0x7f4018062a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4038140a90 0x7f403814c3d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40380c9b40 0x7f40381575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 --2- 172.21.15.3:0/3776879974 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f40381406c0 0x7f4038157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 >> 172.21.15.3:0/3776879974 conn(0x7f40380d0920 msgr2=0x7f40380cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 shutdown_connections 2023-10-08T16:08:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.777+0000 7f403ee8a700 1 -- 172.21.15.3:0/3776879974 wait complete. 2023-10-08T16:08:30.797 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:08:30.797 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:30.812 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:30.834 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:08:30.834 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:08:30.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:30.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.941+0000 7f01cad8a700 1 Processor -- start 2023-10-08T16:08:30.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.941+0000 7f01cad8a700 1 -- start start 2023-10-08T16:08:30.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f01c4156d70 0x7f01c406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f01c415ab80 0x7f01c4068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c40c6be0 con 0x7f01c40687c0 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c406dad0 con 0x7f01c415ab80 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c4068be0 con 0x7f01c4156d70 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f01c415ab80 0x7f01c4068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f01c415ab80 0x7f01c4068280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55200/0 (socket says 172.21.15.3:55200) 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 -- 172.21.15.3:0/3813449355 learned_addr learned my addr 172.21.15.3:0/3813449355 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c8b26700 1 --2- 172.21.15.3:0/3813449355 >> v2:172.21.15.27:3300/0 conn(0x7f01c4156d70 0x7f01c406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 -- 172.21.15.3:0/3813449355 >> v2:172.21.15.27:3300/0 conn(0x7f01c4156d70 msgr2=0x7f01c406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 --2- 172.21.15.3:0/3813449355 >> v2:172.21.15.27:3300/0 conn(0x7f01c4156d70 0x7f01c406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 -- 172.21.15.3:0/3813449355 >> v1:172.21.15.27:6789/0 conn(0x7f01c40687c0 legacy=0x7f01c40c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 -- 172.21.15.3:0/3813449355 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c415b340 con 0x7f01c415ab80 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c3fff700 1 --2- 172.21.15.3:0/3813449355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c4068280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01c40cc2b0 tx=0x7f01b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37138e9ceda24c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c37fe700 1 -- 172.21.15.3:0/3813449355 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0009e70 con 0x7f01c415ab80 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c37fe700 1 -- 172.21.15.3:0/3813449355 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b000b860 con 0x7f01c415ab80 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01c37fe700 1 -- 172.21.15.3:0/3813449355 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000bc00 con 0x7f01c415ab80 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- 172.21.15.3:0/3813449355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 msgr2=0x7f01c4068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 --2- 172.21.15.3:0/3813449355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c4068280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01c40cc2b0 tx=0x7f01b0009250 comp rx=0 tx=0).stop 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- 172.21.15.3:0/3813449355 shutdown_connections 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 --2- 172.21.15.3:0/3813449355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c4068280 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 --2- 172.21.15.3:0/3813449355 >> v2:172.21.15.27:3300/0 conn(0x7f01c4156d70 0x7f01c406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- 172.21.15.3:0/3813449355 >> 172.21.15.3:0/3813449355 conn(0x7f01c40c8de0 msgr2=0x7f01c40c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- 172.21.15.3:0/3813449355 shutdown_connections 2023-10-08T16:08:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.945+0000 7f01cad8a700 1 -- 172.21.15.3:0/3813449355 wait complete. 2023-10-08T16:08:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 Processor -- start 2023-10-08T16:08:30.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 -- start start 2023-10-08T16:08:30.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01c40687c0 0x7f01c40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01c4156d70 0x7f01c4167a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c40aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40c41d0 con 0x7f01c415ab80 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40c35c0 con 0x7f01c40687c0 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40c38a0 con 0x7f01c4156d70 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c40aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c40aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55214/0 (socket says 172.21.15.3:55214) 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 -- 172.21.15.3:0/2679110621 learned_addr learned my addr 172.21.15.3:0/2679110621 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c8b26700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01c40687c0 0x7f01c40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c3fff700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01c4156d70 0x7f01c4167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 -- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01c4156d70 msgr2=0x7f01c4167a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01c4156d70 0x7f01c4167a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 -- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01c40687c0 msgr2=0x7f01c40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01c40687c0 0x7f01c40b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 -- 172.21.15.3:0/2679110621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b00094f0 con 0x7f01c415ab80 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c9327700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c40aab20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00c910 tx=0x7f01bc0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012630 con 0x7f01c415ab80 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0127b0 con 0x7f01c415ab80 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c40c3b80 con 0x7f01c415ab80 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012b70 con 0x7f01c415ab80 2023-10-08T16:08:30.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.949+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c40b1250 con 0x7f01c415ab80 2023-10-08T16:08:30.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.953+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c40abd20 con 0x7f01c415ab80 2023-10-08T16:08:30.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.953+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01bc003030 con 0x7f01c415ab80 2023-10-08T16:08:30.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.953+0000 7f01c0ff9700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01a8060550 0x7f01a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:30.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.953+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f01bc07c380 con 0x7f01c415ab80 2023-10-08T16:08:30.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.953+0000 7f01c8b26700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01a8060550 0x7f01a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:30.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.953+0000 7f01c8b26700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01a8060550 0x7f01a8062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009db0 tx=0x7f01b80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:30.961+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01c40abd20 con 0x7f01c415ab80 2023-10-08T16:08:31.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.157+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01c40c4380 con 0x7f01c415ab80 2023-10-08T16:08:31.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.157+0000 7f01c0ff9700 1 -- 172.21.15.3:0/2679110621 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f01c40c4380 con 0x7f01c415ab80 2023-10-08T16:08:31.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:31.164 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3001684909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3001684909},{"type":"v1","addr":"172.21.15.27:6835","nonce":3001684909}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/225949238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":225949238},{"type":"v1","addr":"172.21.15.3:6837","nonce":225949238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/4214007042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":4214007042},{"type":"v1","addr":"172.21.15.27:6834","nonce":4214007042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/3962353327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":3962353327},{"type":"v1","addr":"172.21.15.3:6835","nonce":3962353327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[]} 2023-10-08T16:08:31.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01a8060550 msgr2=0x7f01a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01a8060550 0x7f01a8062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009db0 tx=0x7f01b80091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 msgr2=0x7f01c40aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c40aab20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00c910 tx=0x7f01bc0016d0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 shutdown_connections 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f01a8060550 0x7f01a8062a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01c415ab80 0x7f01c40aab20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f01c4156d70 0x7f01c4167a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 --2- 172.21.15.3:0/2679110621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01c40687c0 0x7f01c40b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 >> 172.21.15.3:0/2679110621 conn(0x7f01c40c8de0 msgr2=0x7f01c41588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 shutdown_connections 2023-10-08T16:08:31.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.161+0000 7f01cad8a700 1 -- 172.21.15.3:0/2679110621 wait complete. 2023-10-08T16:08:31.168 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2023-10-08T16:08:31.178 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:08:31.178 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:08:31.178 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:08:31.179 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:31.179 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:08:31.179 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:08:31.179 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:08:31.179 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:31.179 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:08:31.180 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:08:31.180 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:08:31.180 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:31.180 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:08:31.180 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:08:31.181 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:08:31.181 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:31.190 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:08:31.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:08:31.192 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:08:31.192 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:08:31.193 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:08:31.193 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:31.195 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:08:31.195 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:31.196 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:08:31.196 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:08:31.197 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:08:31.198 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:08:31.199 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:08:31.199 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:31.200 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:08:31.200 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:31.200 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:08:31.262 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T16:08:31.276 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-10-08T16:08:31.285 INFO:tasks.ceph.mds.b.smithi027.stdout:starting mds.b at 2023-10-08T16:08:31.295 INFO:tasks.ceph.mds.d.smithi027.stdout:starting mds.d at 2023-10-08T16:08:31.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931c5a2700 1 Processor -- start 2023-10-08T16:08:31.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931c5a2700 1 -- start start 2023-10-08T16:08:31.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931c5a2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 0x7f931415b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931c5a2700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93140ac220 con 0x7f9314156bc0 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931c5a2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93140ab8f0 con 0x7f93140c8b60 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931c5a2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93140abbd0 con 0x7f9314156f90 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931a33e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9314156bc0 0x7f93140c8450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54012/0 (socket says 172.21.15.3:54012) 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931a33e700 1 -- 172.21.15.3:0/3356308408 learned_addr learned my addr 172.21.15.3:0/3356308408 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.313+0000 7f931ab3f700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 0x7f931415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389877928 0 0) 0x7f93140ac220 con 0x7f9314156bc0 2023-10-08T16:08:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9300003570 con 0x7f9314156bc0 2023-10-08T16:08:31.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748180988 0 0) 0x7f93140ab8f0 con 0x7f93140c8b60 2023-10-08T16:08:31.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93140ac220 con 0x7f93140c8b60 2023-10-08T16:08:31.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180215137 0 0) 0x7f9300003570 con 0x7f9314156bc0 2023-10-08T16:08:31.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 msgr2=0x7f931415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:31.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 0x7f931415b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 >> v1:172.21.15.27:6789/0 conn(0x7f93140c8b60 legacy=0x7f931406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140abeb0 con 0x7f9314156bc0 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f930c0017f0 con 0x7f9314156bc0 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 >> v1:172.21.15.3:6789/0 conn(0x7f9314156bc0 legacy=0x7f93140c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 0x7f9300003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9300004180 0x7f9300004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9300004d50 0x7f93000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140abbd0 con 0x7f9300004d50 2023-10-08T16:08:31.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930000bba0 con 0x7f9300004180 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930000bd60 con 0x7f9314156f90 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9300004d50 0x7f93000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931a33e700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 0x7f9300003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f9319b3d700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9300004180 0x7f9300004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 -- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 msgr2=0x7f9300003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9314156f90 0x7f9300003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 -- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9300004180 msgr2=0x7f9300004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9300004180 0x7f9300004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 -- 172.21.15.3:0/3356308408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300003570 con 0x7f9300004d50 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9300004d50 0x7f93000051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f931415b8c0 tx=0x7f93100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c687af6ad204f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000e710 con 0x7f9300004d50 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931000e870 con 0x7f9300004d50 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931933c700 1 -- 172.21.15.3:0/3356308408 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000ec30 con 0x7f9300004d50 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 -- 172.21.15.3:0/3356308408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9300004d50 msgr2=0x7f93000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 --2- 172.21.15.3:0/3356308408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9300004d50 0x7f93000051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f931415b8c0 tx=0x7f93100091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931ab3f700 1 -- 172.21.15.3:0/3356308408 reap_dead start 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 -- 172.21.15.3:0/3356308408 shutdown_connections 2023-10-08T16:08:31.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 -- 172.21.15.3:0/3356308408 >> 172.21.15.3:0/3356308408 conn(0x7f9314067060 msgr2=0x7f9314067460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:31.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 -- 172.21.15.3:0/3356308408 shutdown_connections 2023-10-08T16:08:31.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 -- 172.21.15.3:0/3356308408 wait complete. 2023-10-08T16:08:31.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.317+0000 7f931c5a2700 1 Processor -- start 2023-10-08T16:08:31.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 -- start start 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9300004d50 0x7f93141560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 0x7f93140c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93141578e0 0x7f93140c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314158a60 con 0x7f9314157470 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314158ef0 con 0x7f93141578e0 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93141565e0 con 0x7f9300004d50 2023-10-08T16:08:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 0x7f93140c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 0x7f93140c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55252/0 (socket says 172.21.15.3:55252) 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 -- 172.21.15.3:0/1505558898 learned_addr learned my addr 172.21.15.3:0/1505558898 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931ab3f700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93141578e0 0x7f93140c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931a33e700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9300004d50 0x7f93141560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 -- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9300004d50 msgr2=0x7f93141560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9300004d50 0x7f93141560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 -- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93141578e0 msgr2=0x7f93140c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93141578e0 0x7f93140c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:31.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 -- 172.21.15.3:0/1505558898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314157e50 con 0x7f9314157470 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f9319b3d700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 0x7f93140c4450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9304002a80 tx=0x7f9304007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304002e60 con 0x7f9314157470 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304006a30 con 0x7f9314157470 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9314158130 con 0x7f9314157470 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304006df0 con 0x7f9314157470 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.321+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93141586f0 con 0x7f9314157470 2023-10-08T16:08:31.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.325+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314158c10 con 0x7f9314157470 2023-10-08T16:08:31.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.325+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9304007260 con 0x7f9314157470 2023-10-08T16:08:31.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.325+0000 7f930a7fc700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f92f8060580 0x7f92f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:31.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.329+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f930407c5b0 con 0x7f9314157470 2023-10-08T16:08:31.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.329+0000 7f931a33e700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f92f8060580 0x7f92f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:31.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.329+0000 7f931a33e700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f92f8060580 0x7f92f8062a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f930c00a0e0 tx=0x7f930c006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:31.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.333+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9314158c10 con 0x7f9314157470 2023-10-08T16:08:31.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:31.509+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f931404be40 con 0x7f9314157470 2023-10-08T16:08:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.469+0000 7f930a7fc700 1 -- 172.21.15.3:0/1505558898 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7f930404cea0 con 0x7f9314157470 2023-10-08T16:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f92f8060580 msgr2=0x7f92f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f92f8060580 0x7f92f8062a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f930c00a0e0 tx=0x7f930c006040 comp rx=0 tx=0).stop 2023-10-08T16:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 msgr2=0x7f93140c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 0x7f93140c4450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9304002a80 tx=0x7f9304007d30 comp rx=0 tx=0).stop 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 shutdown_connections 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f92f8060580 0x7f92f8062a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93141578e0 0x7f93140c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9314157470 0x7f93140c4450 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 --2- 172.21.15.3:0/1505558898 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9300004d50 0x7f93141560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 >> 172.21.15.3:0/1505558898 conn(0x7f9314067060 msgr2=0x7f931406c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 shutdown_connections 2023-10-08T16:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.473+0000 7f931c5a2700 1 -- 172.21.15.3:0/1505558898 wait complete. 2023-10-08T16:08:32.482 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T16:08:32.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:08:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.601+0000 7f8cf0d68700 1 Processor -- start 2023-10-08T16:08:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.601+0000 7f8cf0d68700 1 -- start start 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cec0cc0b0 0x7f8cec0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8cec156e20 0x7f8cec155780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec156990 con 0x7f8cec0c3560 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec1572a0 con 0x7f8cec0cc0b0 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec0c8e70 con 0x7f8cec156e20 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cec0cc0b0 0x7f8cec0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cec0cc0b0 0x7f8cec0cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55262/0 (socket says 172.21.15.3:55262) 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 -- 172.21.15.3:0/1612113493 learned_addr learned my addr 172.21.15.3:0/1612113493 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:32.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cebfff700 1 --2- 172.21.15.3:0/1612113493 >> v2:172.21.15.27:3300/0 conn(0x7f8cec156e20 0x7f8cec155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cea7fc700 1 -- 172.21.15.3:0/1612113493 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016182183 0 0) 0x7f8cec156990 con 0x7f8cec0c3560 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 -- 172.21.15.3:0/1612113493 >> v2:172.21.15.27:3300/0 conn(0x7f8cec156e20 msgr2=0x7f8cec155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 --2- 172.21.15.3:0/1612113493 >> v2:172.21.15.27:3300/0 conn(0x7f8cec156e20 0x7f8cec155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 -- 172.21.15.3:0/1612113493 >> v1:172.21.15.27:6789/0 conn(0x7f8cec0c3560 legacy=0x7f8cec0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 -- 172.21.15.3:0/1612113493 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0c9150 con 0x7f8cec0cc0b0 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8ceb7fe700 1 --2- 172.21.15.3:0/1612113493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec0cc480 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8cec156900 tx=0x7f8cdc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce9db5906d85209 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cea7fc700 1 -- 172.21.15.3:0/1612113493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00dba0 con 0x7f8cec0cc0b0 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cea7fc700 1 -- 172.21.15.3:0/1612113493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00dd00 con 0x7f8cec0cc0b0 2023-10-08T16:08:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cea7fc700 1 -- 172.21.15.3:0/1612113493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0196d0 con 0x7f8cec0cc0b0 2023-10-08T16:08:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- 172.21.15.3:0/1612113493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec0cc0b0 msgr2=0x7f8cec0cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/1612113493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec0cc480 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8cec156900 tx=0x7f8cdc00b4f0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- 172.21.15.3:0/1612113493 shutdown_connections 2023-10-08T16:08:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/1612113493 >> v2:172.21.15.27:3300/0 conn(0x7f8cec156e20 0x7f8cec155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/1612113493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec0cc480 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- 172.21.15.3:0/1612113493 >> 172.21.15.3:0/1612113493 conn(0x7f8cec06b5b0 msgr2=0x7f8cec06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- 172.21.15.3:0/1612113493 shutdown_connections 2023-10-08T16:08:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.605+0000 7f8cf0d68700 1 -- 172.21.15.3:0/1612113493 wait complete. 2023-10-08T16:08:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 Processor -- start 2023-10-08T16:08:32.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 -- start start 2023-10-08T16:08:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8cec0c3560 0x7f8cec166040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec1658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 0x7f8cec153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec165e30 con 0x7f8cec156e20 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0a54b0 con 0x7f8cec0cc0b0 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0a48a0 con 0x7f8cec0c3560 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 0x7f8cec153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 0x7f8cec153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55266/0 (socket says 172.21.15.3:55266) 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 -- 172.21.15.3:0/2156048217 learned_addr learned my addr 172.21.15.3:0/2156048217 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8ceb7fe700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8cec0c3560 0x7f8cec166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8ceaffd700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec1658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 -- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8cec0c3560 msgr2=0x7f8cec166040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8cec0c3560 0x7f8cec166040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 -- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cec0cc0b0 msgr2=0x7f8cec1658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec1658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 -- 172.21.15.3:0/2156048217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc00b790 con 0x7f8cec156e20 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cebfff700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 0x7f8cec153160 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009e90 tx=0x7f8ce400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400cc20 con 0x7f8cec156e20 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400f040 con 0x7f8cec156e20 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec0a4b80 con 0x7f8cec156e20 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4014480 con 0x7f8cec156e20 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.609+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec0a5140 con 0x7f8cec156e20 2023-10-08T16:08:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.613+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec0c7600 con 0x7f8cec156e20 2023-10-08T16:08:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.613+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8ce4014830 con 0x7f8cec156e20 2023-10-08T16:08:32.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.613+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8ccc060580 0x7f8ccc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.613+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8ce407ce20 con 0x7f8cec156e20 2023-10-08T16:08:32.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.613+0000 7f8ceb7fe700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8ccc060580 0x7f8ccc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.617+0000 7f8ceb7fe700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8ccc060580 0x7f8ccc062a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8cec156900 tx=0x7f8cdc01b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:32.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.621+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8cec0c7600 con 0x7f8cec156e20 2023-10-08T16:08:32.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.841+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8cec0c7600 con 0x7f8cec156e20 2023-10-08T16:08:32.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.841+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2156048217 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8cec0c7600 con 0x7f8cec156e20 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl1/8ILhAAyKLwO7/Ctogmlzw9Nlh2EQ==", 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.847 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJlCvCjNBAAfhsbLyOg/EVp1XW4Jr9LJQ==", 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.c", 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJlP70ZMRAAh+ahn+CKXBXJJV57hLmsbg==", 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:08:32.849 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.d", 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl9Z7hNxAAcAN+TJ5pxlpl9HjSannwCA==", 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.850 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBZ0yJlgfzEKhAAwDxiw16aqOzNkcJbCI4ncQ==", 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.851 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBd0yJlPl4WARAAhXD6n5SOm0mEbZzn4cToYw==", 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBg0yJlNSseBBAA/Xzx+O6bgrc4W0BhSzhumw==", 2023-10-08T16:08:32.852 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBj0yJlskmsCRAAOmjrOSwgaxuwXWy93JU8OQ==", 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.853 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBo0yJl/HqaMhAAHDfaHSmtumyI9YZILWACkw==", 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBs0yJlsxHeCRAA00mNdz2Cs7DmNX6QTIDZZA==", 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T16:08:32.855 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBv0yJlRzR5DBAASd+vxCwHW4+cqcY7han+6g==", 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBy0yJlwAt6ERAAy9CTIOqeZgW7mx0SPn6w4g==", 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlZDIHAhAAzDCJhj1kSsHWF6uzqAZX+A==", 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow r", 2023-10-08T16:08:32.857 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlI3TABxAA3Q9fhC7mcsEG6gTgZf++7g==", 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlOeq5BBAAHe7rJQfMMjJdT9T25nAvXQ==", 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.859 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.3", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBX0yJlGXuSChAA8kVCX/d1wfYqXJmwS2nfUA==", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl7GP9HxAAk8e6OU1qzs8bZSQCHUHe0A==", 2023-10-08T16:08:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJltBo5KxAAiIBcjJ0B063R9P6Xu6cOHQ==", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T16:08:32.861 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQBW0yJl7/U/KBAAQmD+MsjUF24AqK2YG+MMMg==", 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.862 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:32.863 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T16:08:32.863 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8ccc060580 msgr2=0x7f8ccc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8ccc060580 0x7f8ccc062a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8cec156900 tx=0x7f8cdc01b000 comp rx=0 tx=0).stop 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 msgr2=0x7f8cec153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 0x7f8cec153160 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009e90 tx=0x7f8ce400b040 comp rx=0 tx=0).stop 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 shutdown_connections 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8ccc060580 0x7f8ccc062a30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cec156e20 0x7f8cec153160 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cec0cc0b0 0x7f8cec1658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 --2- 172.21.15.3:0/2156048217 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8cec0c3560 0x7f8cec166040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 >> 172.21.15.3:0/2156048217 conn(0x7f8cec06b5b0 msgr2=0x7f8cec06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:32.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 shutdown_connections 2023-10-08T16:08:32.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.845+0000 7f8cf0d68700 1 -- 172.21.15.3:0/2156048217 wait complete. 2023-10-08T16:08:32.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:32.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 Processor -- start 2023-10-08T16:08:32.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 -- start start 2023-10-08T16:08:32.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2358154f80 0x7f23580c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f23580c7030 0x7f235806c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235806aba0 con 0x7f2358154bb0 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235806b720 con 0x7f23580c7030 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235ed80700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235806c2c0 con 0x7f2358154f80 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f23580c7030 0x7f235806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f23580c7030 0x7f235806c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55270/0 (socket says 172.21.15.3:55270) 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 -- 172.21.15.3:0/1989199864 learned_addr learned my addr 172.21.15.3:0/1989199864 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f2357fff700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2358154f80 0x7f23580c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 -- 172.21.15.3:0/1989199864 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2358154f80 msgr2=0x7f23580c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2358154f80 0x7f23580c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 -- 172.21.15.3:0/1989199864 >> v1:172.21.15.27:6789/0 conn(0x7f2358154bb0 legacy=0x7f235806bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 -- 172.21.15.3:0/1989199864 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580c7470 con 0x7f23580c7030 2023-10-08T16:08:32.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f2357fff700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2358154f80 0x7f23580c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f235d31d700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23580c7030 0x7f235806c700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f23500099b0 tx=0x7f2350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a1495c072ca6e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f23577fe700 1 -- 172.21.15.3:0/1989199864 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000b860 con 0x7f23580c7030 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f23577fe700 1 -- 172.21.15.3:0/1989199864 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000b9c0 con 0x7f23580c7030 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.969+0000 7f23577fe700 1 -- 172.21.15.3:0/1989199864 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000bd60 con 0x7f23580c7030 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 -- 172.21.15.3:0/1989199864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23580c7030 msgr2=0x7f235806c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23580c7030 0x7f235806c700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f23500099b0 tx=0x7f2350009250 comp rx=0 tx=0).stop 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 -- 172.21.15.3:0/1989199864 shutdown_connections 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23580c7030 0x7f235806c700 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 --2- 172.21.15.3:0/1989199864 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2358154f80 0x7f23580c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 -- 172.21.15.3:0/1989199864 >> 172.21.15.3:0/1989199864 conn(0x7f23580cc5d0 msgr2=0x7f23580c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 -- 172.21.15.3:0/1989199864 shutdown_connections 2023-10-08T16:08:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 -- 172.21.15.3:0/1989199864 wait complete. 2023-10-08T16:08:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 Processor -- start 2023-10-08T16:08:32.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.973+0000 7f235ed80700 1 -- start start 2023-10-08T16:08:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23580c7030 0x7f23580c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 0x7f23580c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2358154f80 0x7f23580c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c5f30 con 0x7f2358154bb0 2023-10-08T16:08:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2358142fd0 con 0x7f2358154f80 2023-10-08T16:08:32.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c5970 con 0x7f23580c7030 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 0x7f23580c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 0x7f23580c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55286/0 (socket says 172.21.15.3:55286) 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 -- 172.21.15.3:0/3370608234 learned_addr learned my addr 172.21.15.3:0/3370608234 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235cb1c700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23580c7030 0x7f23580c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235d31d700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2358154f80 0x7f23580c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 -- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23580c7030 msgr2=0x7f23580c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23580c7030 0x7f23580c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 -- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2358154f80 msgr2=0x7f23580c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2358154f80 0x7f23580c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 -- 172.21.15.3:0/3370608234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500094f0 con 0x7f2358154bb0 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2357fff700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 0x7f23580c4dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f234000d1d0 tx=0x7f23400099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:32.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000dd60 con 0x7f2358154bb0 2023-10-08T16:08:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234000f040 con 0x7f2358154bb0 2023-10-08T16:08:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23580c5c50 con 0x7f2358154bb0 2023-10-08T16:08:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340015670 con 0x7f2358154bb0 2023-10-08T16:08:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23580c9b50 con 0x7f2358154bb0 2023-10-08T16:08:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235804be40 con 0x7f2358154bb0 2023-10-08T16:08:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.977+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2340015a60 con 0x7f2358154bb0 2023-10-08T16:08:32.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.981+0000 7f2354ff9700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2338060550 0x7f2338062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:32.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.981+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f234007c800 con 0x7f2358154bb0 2023-10-08T16:08:32.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.981+0000 7f235cb1c700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2338060550 0x7f2338062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.981+0000 7f235cb1c700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2338060550 0x7f2338062a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2348003a80 tx=0x7f2348007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:32.989+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f234004d1f0 con 0x7f2358154bb0 2023-10-08T16:08:33.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.145+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f235806a6c0 con 0x7f2358154bb0 2023-10-08T16:08:33.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.145+0000 7f2354ff9700 1 -- 172.21.15.3:0/3370608234 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12038 (secure 0 0 0) 0x7f2340050810 con 0x7f2358154bb0 2023-10-08T16:08:33.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:33.153 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":40,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:08:32.467755+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2338060550 msgr2=0x7f2338062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2338060550 0x7f2338062a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2348003a80 tx=0x7f2348007ec0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 msgr2=0x7f23580c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 0x7f23580c4dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f234000d1d0 tx=0x7f23400099d0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 shutdown_connections 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2338060550 0x7f2338062a00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2358154f80 0x7f23580c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2358154bb0 0x7f23580c4dd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 --2- 172.21.15.3:0/3370608234 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23580c7030 0x7f23580c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 >> 172.21.15.3:0/3370608234 conn(0x7f23580cc5d0 msgr2=0x7f23580ac280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:33.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 shutdown_connections 2023-10-08T16:08:33.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.149+0000 7f235ed80700 1 -- 172.21.15.3:0/3370608234 wait complete. 2023-10-08T16:08:33.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:08:33.167 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:08:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 Processor -- start 2023-10-08T16:08:33.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 -- start start 2023-10-08T16:08:33.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd144158c80 0x7fd14415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd14406db60 0x7fd14406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd1440b37c0 0x7fd1440b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440b4140 con 0x7fd144158c80 2023-10-08T16:08:33.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440b45a0 con 0x7fd1440b37c0 2023-10-08T16:08:33.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14af60700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14406a3a0 con 0x7fd14406db60 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd149f5e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd144158c80 0x7fd14415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd149f5e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd144158c80 0x7fd14415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55302/0 (socket says 172.21.15.3:55302) 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd149f5e700 1 -- 172.21.15.3:0/2490058212 learned_addr learned my addr 172.21.15.3:0/2490058212 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14975d700 1 --2- 172.21.15.3:0/2490058212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd14406db60 0x7fd14406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.273+0000 7fd14a75f700 1 --2- 172.21.15.3:0/2490058212 >> v2:172.21.15.27:3300/0 conn(0x7fd1440b37c0 0x7fd1440b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd149f5e700 1 -- 172.21.15.3:0/2490058212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd14406db60 msgr2=0x7fd14406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd149f5e700 1 --2- 172.21.15.3:0/2490058212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd14406db60 0x7fd14406b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd149f5e700 1 -- 172.21.15.3:0/2490058212 >> v2:172.21.15.27:3300/0 conn(0x7fd1440b37c0 msgr2=0x7fd1440b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd149f5e700 1 --2- 172.21.15.3:0/2490058212 >> v2:172.21.15.27:3300/0 conn(0x7fd1440b37c0 0x7fd1440b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd149f5e700 1 -- 172.21.15.3:0/2490058212 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14406a680 con 0x7fd144158c80 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd149f5e700 1 --2- 172.21.15.3:0/2490058212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415d4c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd1440b2990 tx=0x7fd138009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c04c713eb68d55 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd148f5c700 1 -- 172.21.15.3:0/2490058212 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800b640 con 0x7fd144158c80 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd148f5c700 1 -- 172.21.15.3:0/2490058212 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800b7a0 con 0x7fd144158c80 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd148f5c700 1 -- 172.21.15.3:0/2490058212 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800bb60 con 0x7fd144158c80 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 -- 172.21.15.3:0/2490058212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 msgr2=0x7fd14415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 --2- 172.21.15.3:0/2490058212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415d4c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd1440b2990 tx=0x7fd138009250 comp rx=0 tx=0).stop 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 -- 172.21.15.3:0/2490058212 shutdown_connections 2023-10-08T16:08:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 --2- 172.21.15.3:0/2490058212 >> v2:172.21.15.27:3300/0 conn(0x7fd1440b37c0 0x7fd1440b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 --2- 172.21.15.3:0/2490058212 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd14406db60 0x7fd14406b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 --2- 172.21.15.3:0/2490058212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415d4c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 -- 172.21.15.3:0/2490058212 >> 172.21.15.3:0/2490058212 conn(0x7fd1440d0820 msgr2=0x7fd1440b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 -- 172.21.15.3:0/2490058212 shutdown_connections 2023-10-08T16:08:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.277+0000 7fd14af60700 1 -- 172.21.15.3:0/2490058212 wait complete. 2023-10-08T16:08:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 Processor -- start 2023-10-08T16:08:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 -- start start 2023-10-08T16:08:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd14406db60 0x7fd1441477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1440b37c0 0x7fd14415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c4ca0 con 0x7fd144158c80 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c4f80 con 0x7fd14406db60 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c5260 con 0x7fd1440b37c0 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14975d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1440b37c0 0x7fd14415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55306/0 (socket says 172.21.15.3:55306) 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 -- 172.21.15.3:0/2686480164 learned_addr learned my addr 172.21.15.3:0/2686480164 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd149f5e700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd14406db60 0x7fd1441477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 -- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1440b37c0 msgr2=0x7fd14415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1440b37c0 0x7fd14415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 -- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd14406db60 msgr2=0x7fd1441477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd14406db60 0x7fd1441477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 -- 172.21.15.3:0/2686480164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380094f0 con 0x7fd144158c80 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14a75f700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415be80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009e90 tx=0x7fd13c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00cb70 con 0x7fd144158c80 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00f040 con 0x7fd144158c80 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440c5540 con 0x7fd144158c80 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c014480 con 0x7fd144158c80 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.281+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd144147cf0 con 0x7fd144158c80 2023-10-08T16:08:33.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.285+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1440c5a40 con 0x7fd144158c80 2023-10-08T16:08:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.285+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd13c014830 con 0x7fd144158c80 2023-10-08T16:08:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.285+0000 7fd135ffb700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd128060550 0x7fd128062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.285+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd13c07ce00 con 0x7fd144158c80 2023-10-08T16:08:33.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.285+0000 7fd149f5e700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd128060550 0x7fd128062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.285+0000 7fd149f5e700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd128060550 0x7fd128062a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1440b2990 tx=0x7fd138017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.293+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd13c04d740 con 0x7fd144158c80 2023-10-08T16:08:33.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.453+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd14404be40 con 0x7fd144158c80 2023-10-08T16:08:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.453+0000 7fd135ffb700 1 -- 172.21.15.3:0/2686480164 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd13c0180a0 con 0x7fd144158c80 2023-10-08T16:08:33.460 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:08:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd128060550 msgr2=0x7fd128062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd128060550 0x7fd128062a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1440b2990 tx=0x7fd138017000 comp rx=0 tx=0).stop 2023-10-08T16:08:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 msgr2=0x7fd14415be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415be80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009e90 tx=0x7fd13c00b040 comp rx=0 tx=0).stop 2023-10-08T16:08:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 shutdown_connections 2023-10-08T16:08:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd128060550 0x7fd128062a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd144158c80 0x7fd14415be80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1440b37c0 0x7fd14415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 --2- 172.21.15.3:0/2686480164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd14406db60 0x7fd1441477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 >> 172.21.15.3:0/2686480164 conn(0x7fd1440d0820 msgr2=0x7fd144153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 shutdown_connections 2023-10-08T16:08:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.457+0000 7fd14af60700 1 -- 172.21.15.3:0/2686480164 wait complete. 2023-10-08T16:08:33.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:08:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 Processor -- start 2023-10-08T16:08:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 -- start start 2023-10-08T16:08:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 0x7f463c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f463c0cb260 0x7f463c067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c0ca2d0 con 0x7f463c158b90 2023-10-08T16:08:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0ca890 con 0x7f463c0cb260 2023-10-08T16:08:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c159890 con 0x7f463c158f60 2023-10-08T16:08:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463a59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f463c158b90 0x7f463c06a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54026/0 (socket says 172.21.15.3:54026) 2023-10-08T16:08:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463a59c700 1 -- 172.21.15.3:0/4063646556 learned_addr learned my addr 172.21.15.3:0/4063646556 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f4639d9b700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 0x7f463c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463ad9d700 1 --2- 172.21.15.3:0/4063646556 >> v2:172.21.15.27:3300/0 conn(0x7f463c0cb260 0x7f463c067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872907959 0 0) 0x7f463c0ca2d0 con 0x7f463c158b90 2023-10-08T16:08:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4624003570 con 0x7f463c158b90 2023-10-08T16:08:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941351074 0 0) 0x7f4624003570 con 0x7f463c158b90 2023-10-08T16:08:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 msgr2=0x7f463c0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 0x7f463c0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 >> v2:172.21.15.27:3300/0 conn(0x7f463c0cb260 msgr2=0x7f463c067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 --2- 172.21.15.3:0/4063646556 >> v2:172.21.15.27:3300/0 conn(0x7f463c0cb260 0x7f463c067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c06aec0 con 0x7f463c158b90 2023-10-08T16:08:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f4630001470 con 0x7f463c158b90 2023-10-08T16:08:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 >> v1:172.21.15.3:6789/0 conn(0x7f463c158b90 legacy=0x7f463c06a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4624003a60 0x7f4624003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 0x7f4624004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4624004d50 0x7f46240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0ca890 con 0x7f4624004d50 2023-10-08T16:08:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c159890 con 0x7f4624003a60 2023-10-08T16:08:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462400ba60 con 0x7f463c158f60 2023-10-08T16:08:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463ad9d700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4624004d50 0x7f46240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f4639d9b700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 0x7f4624004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463a59c700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4624003a60 0x7f4624003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.573+0000 7f463ad9d700 1 -- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 msgr2=0x7f4624004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463ad9d700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c158f60 0x7f4624004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463ad9d700 1 -- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4624003a60 msgr2=0x7f4624003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463ad9d700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4624003a60 0x7f4624003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463ad9d700 1 -- 172.21.15.3:0/4063646556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624003570 con 0x7f4624004d50 2023-10-08T16:08:33.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463ad9d700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4624004d50 0x7f46240051c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4634009c00 tx=0x7f46340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af99b13c6821f24d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400e6b0 con 0x7f4624004d50 2023-10-08T16:08:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400e810 con 0x7f4624004d50 2023-10-08T16:08:33.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463959a700 1 -- 172.21.15.3:0/4063646556 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ebd0 con 0x7f4624004d50 2023-10-08T16:08:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463b59e700 1 -- 172.21.15.3:0/4063646556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4624004d50 msgr2=0x7f46240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463b59e700 1 --2- 172.21.15.3:0/4063646556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4624004d50 0x7f46240051c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4634009c00 tx=0x7f46340091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463ad9d700 1 -- 172.21.15.3:0/4063646556 reap_dead start 2023-10-08T16:08:33.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463b59e700 1 -- 172.21.15.3:0/4063646556 shutdown_connections 2023-10-08T16:08:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463b59e700 1 -- 172.21.15.3:0/4063646556 >> 172.21.15.3:0/4063646556 conn(0x7f463c0cfd30 msgr2=0x7f463c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463b59e700 1 -- 172.21.15.3:0/4063646556 shutdown_connections 2023-10-08T16:08:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.577+0000 7f463b59e700 1 -- 172.21.15.3:0/4063646556 wait complete. 2023-10-08T16:08:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 Processor -- start 2023-10-08T16:08:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 -- start start 2023-10-08T16:08:33.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 0x7f463c0a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c0a9880 0x7f463c16ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f463c16cf50 0x7f463c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c16d3f0 con 0x7f463c16cf50 2023-10-08T16:08:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0ab7a0 con 0x7f463c0a8f70 2023-10-08T16:08:33.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0aa700 con 0x7f463c0a9880 2023-10-08T16:08:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f463c16cf50 0x7f463c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 0x7f463c0a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 0x7f463c0a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:56718/0 (socket says 172.21.15.3:56718) 2023-10-08T16:08:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463a59c700 1 -- 172.21.15.3:0/308017842 learned_addr learned my addr 172.21.15.3:0/308017842 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f4639d9b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c0a9880 0x7f463c16ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.581+0000 7f463ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f463c16cf50 0x7f463c157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55320/0 (socket says 172.21.15.3:55320) 2023-10-08T16:08:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463a59c700 1 -- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c0a9880 msgr2=0x7f463c16ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463a59c700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c0a9880 0x7f463c16ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463a59c700 1 -- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f463c16cf50 msgr2=0x7f463c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463a59c700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f463c16cf50 0x7f463c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463a59c700 1 -- 172.21.15.3:0/308017842 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0aa9e0 con 0x7f463c0a8f70 2023-10-08T16:08:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463a59c700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 0x7f463c0a9340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f46300073f0 tx=0x7f4630001e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630018030 con 0x7f463c0a8f70 2023-10-08T16:08:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000f6c0 con 0x7f463c0a8f70 2023-10-08T16:08:33.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c0aacc0 con 0x7f463c0a8f70 2023-10-08T16:08:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000fa60 con 0x7f463c0a8f70 2023-10-08T16:08:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c0ab280 con 0x7f463c0a8f70 2023-10-08T16:08:33.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c0ab4d0 con 0x7f463c0a8f70 2023-10-08T16:08:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f463001b070 con 0x7f463c0a8f70 2023-10-08T16:08:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.585+0000 7f462a7fc700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f461c060580 0x7f461c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.589+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4630019070 con 0x7f463c0a8f70 2023-10-08T16:08:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.589+0000 7f4639d9b700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f461c060580 0x7f461c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.589+0000 7f4639d9b700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f461c060580 0x7f461c062a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f463c0b1d90 tx=0x7f462c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.597+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f463004cce0 con 0x7f463c0a8f70 2023-10-08T16:08:33.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.765+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f463c0a9c50 con 0x7f463c0a8f70 2023-10-08T16:08:33.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.769+0000 7f462a7fc700 1 -- 172.21.15.3:0/308017842 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4630050300 con 0x7f463c0a8f70 2023-10-08T16:08:33.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:33.774 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T16:08:33.774 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T16:08:33.774 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T16:08:33.774 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T16:08:33.774 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:33.774 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T16:08:33.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f461c060580 msgr2=0x7f461c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f461c060580 0x7f461c062a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f463c0b1d90 tx=0x7f462c00b040 comp rx=0 tx=0).stop 2023-10-08T16:08:33.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 msgr2=0x7f463c0a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 0x7f463c0a9340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f46300073f0 tx=0x7f4630001e90 comp rx=0 tx=0).stop 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 shutdown_connections 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f461c060580 0x7f461c062a30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f463c16cf50 0x7f463c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f463c0a9880 0x7f463c16ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 --2- 172.21.15.3:0/308017842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f463c0a8f70 0x7f463c0a9340 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 >> 172.21.15.3:0/308017842 conn(0x7f463c0cfd30 msgr2=0x7f463c0cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 shutdown_connections 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.773+0000 7f463b59e700 1 -- 172.21.15.3:0/308017842 wait complete. 2023-10-08T16:08:33.792 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:08:33.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:08:33.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 Processor -- start 2023-10-08T16:08:33.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 -- start start 2023-10-08T16:08:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff3441590c0 0x7ff3440cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff344159490 0x7ff3440674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34406d320 con 0x7ff3440679e0 2023-10-08T16:08:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3440c9af0 con 0x7ff3441590c0 2023-10-08T16:08:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34be71700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3440cc2e0 con 0x7ff344159490 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34a40e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff3440679e0 0x7ff34406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54030/0 (socket says 172.21.15.3:54030) 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.901+0000 7ff34a40e700 1 -- 172.21.15.3:0/489877148 learned_addr learned my addr 172.21.15.3:0/489877148 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff349c0d700 1 --2- 172.21.15.3:0/489877148 >> v2:172.21.15.3:3300/0 conn(0x7ff3441590c0 0x7ff3440cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 --2- 172.21.15.3:0/489877148 >> v2:172.21.15.27:3300/0 conn(0x7ff344159490 0x7ff3440674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110479492 0 0) 0x7ff34406d320 con 0x7ff3440679e0 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330003570 con 0x7ff3440679e0 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768581219 0 0) 0x7ff330003570 con 0x7ff3440679e0 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 >> v2:172.21.15.27:3300/0 conn(0x7ff344159490 msgr2=0x7ff3440674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 --2- 172.21.15.3:0/489877148 >> v2:172.21.15.27:3300/0 conn(0x7ff344159490 0x7ff3440674a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 >> v2:172.21.15.3:3300/0 conn(0x7ff3441590c0 msgr2=0x7ff3440cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 --2- 172.21.15.3:0/489877148 >> v2:172.21.15.3:3300/0 conn(0x7ff3441590c0 0x7ff3440cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440cc550 con 0x7ff3440679e0 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7ff33c0017f0 con 0x7ff3440679e0 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 >> v1:172.21.15.3:6789/0 conn(0x7ff3440679e0 legacy=0x7ff34406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff330003a60 0x7ff330003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff330004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3300051c0 0x7ff33000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440cc2e0 con 0x7ff330004810 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33000bfa0 con 0x7ff3300051c0 2023-10-08T16:08:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33000c110 con 0x7ff330003a60 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff349c0d700 1 --2- 172.21.15.3:0/489877148 >> v2:172.21.15.3:3300/0 conn(0x7ff3441590c0 0x7ff3440cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff330004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff349c0d700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff330003a60 0x7ff330003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34a40e700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3300051c0 0x7ff33000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 -- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff330003a60 msgr2=0x7ff330003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff330003a60 0x7ff330003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 -- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3300051c0 msgr2=0x7ff33000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3300051c0 0x7ff33000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 -- 172.21.15.3:0/489877148 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330003570 con 0x7ff330004810 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34a40e700 1 -- 172.21.15.3:0/489877148 reap_dead start 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34940c700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff330004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff340006f00 tx=0x7ff3400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5b170eed221b9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000e6b0 con 0x7ff330004810 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34000e810 con 0x7ff330004810 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff348c0b700 1 -- 172.21.15.3:0/489877148 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000ebd0 con 0x7ff330004810 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 -- 172.21.15.3:0/489877148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 msgr2=0x7ff330004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff330004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff340006f00 tx=0x7ff3400091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 -- 172.21.15.3:0/489877148 shutdown_connections 2023-10-08T16:08:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 --2- 172.21.15.3:0/489877148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff330004c80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 -- 172.21.15.3:0/489877148 >> 172.21.15.3:0/489877148 conn(0x7ff3440ca710 msgr2=0x7ff3440cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 -- 172.21.15.3:0/489877148 shutdown_connections 2023-10-08T16:08:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.905+0000 7ff34be71700 1 -- 172.21.15.3:0/489877148 wait complete. 2023-10-08T16:08:33.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.909+0000 7ff34be71700 1 Processor -- start 2023-10-08T16:08:33.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.909+0000 7ff34be71700 1 -- start start 2023-10-08T16:08:33.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff3440b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3440b0040 0x7ff3440c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff3440b0f80 0x7ff3440b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34415cc30 con 0x7ff330004810 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b1930 con 0x7ff3440b0040 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c6dd0 con 0x7ff3440b0f80 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff3440b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff3440b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55356/0 (socket says 172.21.15.3:55356) 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 -- 172.21.15.3:0/1539513951 learned_addr learned my addr 172.21.15.3:0/1539513951 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34a40e700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff3440b0f80 0x7ff3440b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34940c700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3440b0040 0x7ff3440c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 -- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff3440b0f80 msgr2=0x7ff3440b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff3440b0f80 0x7ff3440b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 -- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3440b0040 msgr2=0x7ff3440c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3440b0040 0x7ff3440c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 -- 172.21.15.3:0/1539513951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440c78f0 con 0x7ff330004810 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff349c0d700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff3440b3570 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff334011a50 tx=0x7ff334008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334011e90 con 0x7ff330004810 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400f8e0 con 0x7ff330004810 2023-10-08T16:08:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3440c7050 con 0x7ff330004810 2023-10-08T16:08:33.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400fc60 con 0x7ff330004810 2023-10-08T16:08:33.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440c7610 con 0x7ff330004810 2023-10-08T16:08:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.913+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff344071180 con 0x7ff330004810 2023-10-08T16:08:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.917+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff334015460 con 0x7ff330004810 2023-10-08T16:08:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.917+0000 7ff339ffb700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff328060550 0x7ff328062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.917+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff33407ce00 con 0x7ff330004810 2023-10-08T16:08:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.917+0000 7ff34940c700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff328060550 0x7ff328062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.917+0000 7ff34940c700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff328060550 0x7ff328062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3400091e0 tx=0x7ff34001a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:33.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:33.921+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff334051130 con 0x7ff330004810 2023-10-08T16:08:34.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.085+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff34406a280 con 0x7ff330004810 2023-10-08T16:08:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.489+0000 7ff339ffb700 1 -- 172.21.15.3:0/1539513951 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff334050cc0 con 0x7ff330004810 2023-10-08T16:08:34.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff328060550 msgr2=0x7ff328062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff328060550 0x7ff328062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3400091e0 tx=0x7ff34001a000 comp rx=0 tx=0).stop 2023-10-08T16:08:34.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 msgr2=0x7ff3440b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff3440b3570 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff334011a50 tx=0x7ff334008040 comp rx=0 tx=0).stop 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 shutdown_connections 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff328060550 0x7ff328062a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff3440b0f80 0x7ff3440b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3440b0040 0x7ff3440c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 --2- 172.21.15.3:0/1539513951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff330004810 0x7ff3440b3570 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 >> 172.21.15.3:0/1539513951 conn(0x7ff3440ca710 msgr2=0x7ff3440c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 shutdown_connections 2023-10-08T16:08:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.501+0000 7ff34be71700 1 -- 172.21.15.3:0/1539513951 wait complete. 2023-10-08T16:08:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T16:08:34.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:08:34.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.629+0000 7f24f694e700 1 Processor -- start 2023-10-08T16:08:34.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.629+0000 7f24f694e700 1 -- start start 2023-10-08T16:08:34.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24f694e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24f0068880 0x7f24f00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:34.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24f694e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f00c7ec0 con 0x7f24f00684b0 2023-10-08T16:08:34.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24f694e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f006e630 con 0x7f24f00c8890 2023-10-08T16:08:34.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24f694e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f006db00 con 0x7f24f0068880 2023-10-08T16:08:34.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24e77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24f0068880 0x7f24f00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:34.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24effff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f24f00684b0 0x7f24f00c9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54034/0 (socket says 172.21.15.3:54034) 2023-10-08T16:08:34.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24effff700 1 -- 172.21.15.3:0/595643052 learned_addr learned my addr 172.21.15.3:0/595643052 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24e77fe700 1 -- 172.21.15.3:0/595643052 >> v1:172.21.15.27:6789/0 conn(0x7f24f00c8890 legacy=0x7f24f006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24e77fe700 1 -- 172.21.15.3:0/595643052 >> v1:172.21.15.3:6789/0 conn(0x7f24f00684b0 legacy=0x7f24f00c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24e77fe700 1 -- 172.21.15.3:0/595643052 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f006dde0 con 0x7f24f0068880 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24e77fe700 1 --2- 172.21.15.3:0/595643052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f0068880 0x7f24f00c8350 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f24d80098e0 tx=0x7f24d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3f41dcd3009451 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24ef7fe700 1 -- 172.21.15.3:0/595643052 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8009e80 con 0x7f24f0068880 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24ef7fe700 1 -- 172.21.15.3:0/595643052 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800b860 con 0x7f24f0068880 2023-10-08T16:08:34.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.633+0000 7f24ef7fe700 1 -- 172.21.15.3:0/595643052 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800bbe0 con 0x7f24f0068880 2023-10-08T16:08:34.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 -- 172.21.15.3:0/595643052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f0068880 msgr2=0x7f24f00c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 --2- 172.21.15.3:0/595643052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f0068880 0x7f24f00c8350 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f24d80098e0 tx=0x7f24d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 -- 172.21.15.3:0/595643052 shutdown_connections 2023-10-08T16:08:34.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 --2- 172.21.15.3:0/595643052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f0068880 0x7f24f00c8350 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 -- 172.21.15.3:0/595643052 >> 172.21.15.3:0/595643052 conn(0x7f24f00c8df0 msgr2=0x7f24f00c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:34.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 -- 172.21.15.3:0/595643052 shutdown_connections 2023-10-08T16:08:34.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 -- 172.21.15.3:0/595643052 wait complete. 2023-10-08T16:08:34.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 Processor -- start 2023-10-08T16:08:34.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.637+0000 7f24f694e700 1 -- start start 2023-10-08T16:08:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24f00684b0 0x7f24f014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f24f0068880 0x7f24f01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 0x7f24f00c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f00b0140 con 0x7f24f00c8890 2023-10-08T16:08:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0151b70 con 0x7f24f00684b0 2023-10-08T16:08:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f00b0390 con 0x7f24f0068880 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 0x7f24f00c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 0x7f24f00c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55376/0 (socket says 172.21.15.3:55376) 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 -- 172.21.15.3:0/1377006074 learned_addr learned my addr 172.21.15.3:0/1377006074 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24e77fe700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f24f0068880 0x7f24f01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24effff700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24f00684b0 0x7f24f014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 -- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f24f0068880 msgr2=0x7f24f01541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f24f0068880 0x7f24f01541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 -- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24f00684b0 msgr2=0x7f24f014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24f00684b0 0x7f24f014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:34.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 -- 172.21.15.3:0/1377006074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8009420 con 0x7f24f00c8890 2023-10-08T16:08:34.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f4eeb700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 0x7f24f00c5640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f24e800c840 tx=0x7f24e8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:34.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8012630 con 0x7f24f00c8890 2023-10-08T16:08:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e8012790 con 0x7f24f00c8890 2023-10-08T16:08:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f00b0670 con 0x7f24f00c8890 2023-10-08T16:08:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8012b50 con 0x7f24f00c8890 2023-10-08T16:08:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.641+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f00b0c30 con 0x7f24f00c8890 2023-10-08T16:08:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.645+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f0071180 con 0x7f24f00c8890 2023-10-08T16:08:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.645+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f24e8003030 con 0x7f24f00c8890 2023-10-08T16:08:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.645+0000 7f24ecff9700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f24d0060580 0x7f24d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.645+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f24e807c460 con 0x7f24f00c8890 2023-10-08T16:08:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.645+0000 7f24effff700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f24d0060580 0x7f24d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.645+0000 7f24effff700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f24d0060580 0x7f24d0062a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24e0007fd0 tx=0x7f24e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:34.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.649+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f24e804cc30 con 0x7f24f00c8890 2023-10-08T16:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:34.817+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f24f00c7b50 con 0x7f24f00c8890 2023-10-08T16:08:35.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.493+0000 7f24ecff9700 1 -- 172.21.15.3:0/1377006074 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f24e8050250 con 0x7f24f00c8890 2023-10-08T16:08:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f24d0060580 msgr2=0x7f24d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f24d0060580 0x7f24d0062a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24e0007fd0 tx=0x7f24e0009040 comp rx=0 tx=0).stop 2023-10-08T16:08:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 msgr2=0x7f24f00c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 0x7f24f00c5640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f24e800c840 tx=0x7f24e8001670 comp rx=0 tx=0).stop 2023-10-08T16:08:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 shutdown_connections 2023-10-08T16:08:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f24d0060580 0x7f24d0062a30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24f00c8890 0x7f24f00c5640 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f24f0068880 0x7f24f01541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 --2- 172.21.15.3:0/1377006074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24f00684b0 0x7f24f014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.509+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 >> 172.21.15.3:0/1377006074 conn(0x7f24f00c8df0 msgr2=0x7f24f0155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:35.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.513+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 shutdown_connections 2023-10-08T16:08:35.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.513+0000 7f24f694e700 1 -- 172.21.15.3:0/1377006074 wait complete. 2023-10-08T16:08:35.520 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T16:08:35.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:08:35.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.637+0000 7ff85b033700 1 Processor -- start 2023-10-08T16:08:35.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.637+0000 7ff85b033700 1 -- start start 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.637+0000 7ff85b033700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff85406db60 0x7ff85415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.637+0000 7ff85b033700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85406bb50 con 0x7ff8540b37c0 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.637+0000 7ff85b033700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8540b45a0 con 0x7ff854158c80 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.637+0000 7ff85b033700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85406a3a0 con 0x7ff85406db60 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85a832700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff8540b37c0 0x7ff854159050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54044/0 (socket says 172.21.15.3:54044) 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85a832700 1 -- 172.21.15.3:0/445551669 learned_addr learned my addr 172.21.15.3:0/445551669 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 --2- 172.21.15.3:0/445551669 >> v2:172.21.15.27:3300/0 conn(0x7ff85406db60 0x7ff85415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745576993 0 0) 0x7ff85406bb50 con 0x7ff8540b37c0 2023-10-08T16:08:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff840003570 con 0x7ff8540b37c0 2023-10-08T16:08:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714647020 0 0) 0x7ff840003570 con 0x7ff8540b37c0 2023-10-08T16:08:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 >> v2:172.21.15.27:3300/0 conn(0x7ff85406db60 msgr2=0x7ff85415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 --2- 172.21.15.3:0/445551669 >> v2:172.21.15.27:3300/0 conn(0x7ff85406db60 0x7ff85415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 >> v1:172.21.15.27:6789/0 conn(0x7ff854158c80 legacy=0x7ff85406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85406a680 con 0x7ff8540b37c0 2023-10-08T16:08:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7ff84c0017f0 con 0x7ff8540b37c0 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 >> v1:172.21.15.3:6789/0 conn(0x7ff8540b37c0 legacy=0x7ff854159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff840003a60 0x7ff840003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff840004810 0x7ff840004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff8400051c0 0x7ff84000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85406a3a0 con 0x7ff840004810 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84000c0d0 con 0x7ff840003a60 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84000c290 con 0x7ff8400051c0 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85a031700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff840003a60 0x7ff840003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff840004810 0x7ff840004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85a832700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff8400051c0 0x7ff84000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 -- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff8400051c0 msgr2=0x7ff84000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff8400051c0 0x7ff84000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 -- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff840003a60 msgr2=0x7ff840003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff840003a60 0x7ff840003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 -- 172.21.15.3:0/445551669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840003570 con 0x7ff840004810 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85a832700 1 -- 172.21.15.3:0/445551669 reap_dead start 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff859830700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff840004810 0x7ff840004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff848009c00 tx=0x7ff8480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b085e014886005af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e710 con 0x7ff840004810 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800e870 con 0x7ff840004810 2023-10-08T16:08:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85902f700 1 -- 172.21.15.3:0/445551669 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800ec30 con 0x7ff840004810 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 -- 172.21.15.3:0/445551669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff840004810 msgr2=0x7ff840004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff840004810 0x7ff840004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff848009c00 tx=0x7ff8480091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 -- 172.21.15.3:0/445551669 shutdown_connections 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 --2- 172.21.15.3:0/445551669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff840004810 0x7ff840004c80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 -- 172.21.15.3:0/445551669 >> 172.21.15.3:0/445551669 conn(0x7ff8540d0820 msgr2=0x7ff8540b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 -- 172.21.15.3:0/445551669 shutdown_connections 2023-10-08T16:08:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.641+0000 7ff85b033700 1 -- 172.21.15.3:0/445551669 wait complete. 2023-10-08T16:08:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 Processor -- start 2023-10-08T16:08:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 -- start start 2023-10-08T16:08:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff840004810 0x7ff854151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 0x7ff854155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff854155870 0x7ff854067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415a040 con 0x7ff854168cf0 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854159430 con 0x7ff854155870 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85b033700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff854159710 con 0x7ff840004810 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 0x7ff854155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 0x7ff854155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55384/0 (socket says 172.21.15.3:55384) 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 -- 172.21.15.3:0/4027923133 learned_addr learned my addr 172.21.15.3:0/4027923133 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85a031700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff840004810 0x7ff854151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85a832700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff854155870 0x7ff854067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 -- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff840004810 msgr2=0x7ff854151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff840004810 0x7ff854151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 -- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff854155870 msgr2=0x7ff854067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff854155870 0x7ff854067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 -- 172.21.15.3:0/4027923133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8541599f0 con 0x7ff854168cf0 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff85a832700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff854155870 0x7ff854067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.645+0000 7ff859830700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 0x7ff854155330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c0a0 tx=0x7ff84801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848022070 con 0x7ff854168cf0 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800e9e0 con 0x7ff854168cf0 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff854159cd0 con 0x7ff854168cf0 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480276a0 con 0x7ff854168cf0 2023-10-08T16:08:35.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff854159050 con 0x7ff854168cf0 2023-10-08T16:08:35.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85415a1b0 con 0x7ff854168cf0 2023-10-08T16:08:35.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff84801c450 con 0x7ff854168cf0 2023-10-08T16:08:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.649+0000 7ff8467fc700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff838060580 0x7ff838062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.653+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5605+0+0 (secure 0 0 0) 0x7ff84807e2e0 con 0x7ff854168cf0 2023-10-08T16:08:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.653+0000 7ff85a031700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff838060580 0x7ff838062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.653+0000 7ff85a031700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff838060580 0x7ff838062a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff850000c00 tx=0x7ff850007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:35.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.661+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff84804eab0 con 0x7ff854168cf0 2023-10-08T16:08:35.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:35.857+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff85404be40 con 0x7ff854168cf0 2023-10-08T16:08:36.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.545+0000 7ff8467fc700 1 -- 172.21.15.3:0/4027923133 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v16) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff848052090 con 0x7ff854168cf0 2023-10-08T16:08:36.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff838060580 msgr2=0x7ff838062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff838060580 0x7ff838062a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff850000c00 tx=0x7ff850007d30 comp rx=0 tx=0).stop 2023-10-08T16:08:36.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 msgr2=0x7ff854155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 0x7ff854155330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c0a0 tx=0x7ff84801a000 comp rx=0 tx=0).stop 2023-10-08T16:08:36.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 shutdown_connections 2023-10-08T16:08:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7ff838060580 0x7ff838062a30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff854155870 0x7ff854067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff854168cf0 0x7ff854155330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 --2- 172.21.15.3:0/4027923133 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7ff840004810 0x7ff854151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 >> 172.21.15.3:0/4027923133 conn(0x7ff8540d0820 msgr2=0x7ff854156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 shutdown_connections 2023-10-08T16:08:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.553+0000 7ff85b033700 1 -- 172.21.15.3:0/4027923133 wait complete. 2023-10-08T16:08:36.561 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 6 and data pool 7 2023-10-08T16:08:36.573 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.669+0000 7fe0409be700 1 Processor -- start 2023-10-08T16:08:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.669+0000 7fe0409be700 1 -- start start 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.669+0000 7fe0409be700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe03c15d2e0 0x7fe03c069340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c068280 0x7fe03c0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c06e0d0 con 0x7fe03c15d6b0 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c069880 con 0x7fe03c15d2e0 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0c7dd0 con 0x7fe03c068280 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03259c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe03c15d6b0 0x7fe03c06ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54054/0 (socket says 172.21.15.3:54054) 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03259c700 1 -- 172.21.15.3:0/3633340418 learned_addr learned my addr 172.21.15.3:0/3633340418 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03ad9d700 1 --2- 172.21.15.3:0/3633340418 >> v2:172.21.15.27:3300/0 conn(0x7fe03c15d2e0 0x7fe03c069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03b59e700 1 --2- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c068280 0x7fe03c0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03a59c700 1 -- 172.21.15.3:0/3633340418 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552969787 0 0) 0x7fe03c06e0d0 con 0x7fe03c15d6b0 2023-10-08T16:08:36.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03a59c700 1 -- 172.21.15.3:0/3633340418 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe028003570 con 0x7fe03c15d6b0 2023-10-08T16:08:36.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03ad9d700 1 -- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c068280 msgr2=0x7fe03c0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:36.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03ad9d700 1 --2- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c068280 0x7fe03c0686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03ad9d700 1 -- 172.21.15.3:0/3633340418 >> v1:172.21.15.3:6789/0 conn(0x7fe03c15d6b0 legacy=0x7fe03c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03ad9d700 1 -- 172.21.15.3:0/3633340418 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c068c00 con 0x7fe03c15d2e0 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03ad9d700 1 --2- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c15d2e0 0x7fe03c069340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009e90 tx=0x7fe02c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d570b0a85d8ea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03a59c700 1 -- 172.21.15.3:0/3633340418 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00e070 con 0x7fe03c15d2e0 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03a59c700 1 -- 172.21.15.3:0/3633340418 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c00bb40 con 0x7fe03c15d2e0 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe03a59c700 1 -- 172.21.15.3:0/3633340418 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c012430 con 0x7fe03c15d2e0 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c15d2e0 msgr2=0x7fe03c069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 --2- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c15d2e0 0x7fe03c069340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009e90 tx=0x7fe02c009780 comp rx=0 tx=0).stop 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- 172.21.15.3:0/3633340418 shutdown_connections 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 --2- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c068280 0x7fe03c0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 --2- 172.21.15.3:0/3633340418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c15d2e0 0x7fe03c069340 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- 172.21.15.3:0/3633340418 >> 172.21.15.3:0/3633340418 conn(0x7fe03c0c8c90 msgr2=0x7fe03c0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- 172.21.15.3:0/3633340418 shutdown_connections 2023-10-08T16:08:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.673+0000 7fe0409be700 1 -- 172.21.15.3:0/3633340418 wait complete. 2023-10-08T16:08:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 Processor -- start 2023-10-08T16:08:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 -- start start 2023-10-08T16:08:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 0x7fe03c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 0x7fe03c163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c15d6b0 0x7fe03c1637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15eb60 con 0x7fe03c15d2e0 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c16e760 con 0x7fe03c068280 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe0409be700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c16de30 con 0x7fe03c15d6b0 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 0x7fe03c163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 0x7fe03c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 0x7fe03c153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:56800/0 (socket says 172.21.15.3:56800) 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c15d6b0 0x7fe03c1637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03ad9d700 1 -- 172.21.15.3:0/2356737780 learned_addr learned my addr 172.21.15.3:0/2356737780 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 0x7fe03c163260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55400/0 (socket says 172.21.15.3:55400) 2023-10-08T16:08:36.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 -- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c15d6b0 msgr2=0x7fe03c1637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c15d6b0 0x7fe03c1637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 -- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 msgr2=0x7fe03c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 0x7fe03c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 -- 172.21.15.3:0/2356737780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009a20 con 0x7fe03c15d2e0 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03ad9d700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 0x7fe03c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.677+0000 7fe03259c700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 0x7fe03c163260 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe0240058d0 tx=0x7fe024007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024005b30 con 0x7fe03c15d2e0 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024005cd0 con 0x7fe03c15d2e0 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c16e110 con 0x7fe03c15d2e0 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024007320 con 0x7fe03c15d2e0 2023-10-08T16:08:36.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c16db10 con 0x7fe03c15d2e0 2023-10-08T16:08:36.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c04be40 con 0x7fe03c15d2e0 2023-10-08T16:08:36.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe024007690 con 0x7fe03c15d2e0 2023-10-08T16:08:36.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.681+0000 7fe0337fe700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe01c060550 0x7fe01c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.685+0000 7fe03ad9d700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe01c060550 0x7fe01c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.685+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe02407b9b0 con 0x7fe03c15d2e0 2023-10-08T16:08:36.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.685+0000 7fe03ad9d700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe01c060550 0x7fe01c062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009de0 tx=0x7fe02c019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:36.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.689+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe024049be0 con 0x7fe03c15d2e0 2023-10-08T16:08:36.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe03c16e8a0 con 0x7fe03c15d2e0 2023-10-08T16:08:36.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0337fe700 1 -- 172.21.15.3:0/2356737780 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fe024017020 con 0x7fe03c15d2e0 2023-10-08T16:08:36.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:36.854 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":43,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:08:35.863110+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:36.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe01c060550 msgr2=0x7fe01c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe01c060550 0x7fe01c062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009de0 tx=0x7fe02c019000 comp rx=0 tx=0).stop 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 msgr2=0x7fe03c163260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 0x7fe03c163260 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe0240058d0 tx=0x7fe024007d10 comp rx=0 tx=0).stop 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 shutdown_connections 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe01c060550 0x7fe01c062a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe03c15d6b0 0x7fe03c1637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe03c15d2e0 0x7fe03c163260 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 --2- 172.21.15.3:0/2356737780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe03c068280 0x7fe03c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 >> 172.21.15.3:0/2356737780 conn(0x7fe03c0c8c90 msgr2=0x7fe03c0c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 shutdown_connections 2023-10-08T16:08:36.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.849+0000 7fe0409be700 1 -- 172.21.15.3:0/2356737780 wait complete. 2023-10-08T16:08:36.874 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:36.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 Processor -- start 2023-10-08T16:08:36.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 -- start start 2023-10-08T16:08:36.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6314159d40 0x7f6314068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63140687c0 0x7f63140c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140c7fb0 con 0x7f631413eed0 2023-10-08T16:08:36.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6314068c40 con 0x7f6314159d40 2023-10-08T16:08:36.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.977+0000 7f6313fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140c8290 con 0x7f63140687c0 2023-10-08T16:08:36.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f630bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6314159d40 0x7f6314068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6312ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f631413eed0 0x7f63140c7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:60242/0 (socket says 172.21.15.3:60242) 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6312ffd700 1 -- 172.21.15.3:0/2279896308 learned_addr learned my addr 172.21.15.3:0/2279896308 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f63137fe700 1 --2- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63140687c0 0x7f63140c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f630bfff700 1 -- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63140687c0 msgr2=0x7f63140c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f630bfff700 1 --2- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63140687c0 0x7f63140c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f630bfff700 1 -- 172.21.15.3:0/2279896308 >> v1:172.21.15.27:6789/0 conn(0x7f631413eed0 legacy=0x7f63140c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f63127fc700 1 -- 172.21.15.3:0/2279896308 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524437172 0 0) 0x7f63140c7fb0 con 0x7f631413eed0 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f630bfff700 1 -- 172.21.15.3:0/2279896308 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140c8570 con 0x7f6314159d40 2023-10-08T16:08:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f630bfff700 1 --2- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6314159d40 0x7f6314068280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00aa90 tx=0x7f62fc00a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c935198ed570ad91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f63127fc700 1 -- 172.21.15.3:0/2279896308 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00c970 con 0x7f6314159d40 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f63127fc700 1 -- 172.21.15.3:0/2279896308 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc00cad0 con 0x7f6314159d40 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f63127fc700 1 -- 172.21.15.3:0/2279896308 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00ce70 con 0x7f6314159d40 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 -- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6314159d40 msgr2=0x7f6314068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 --2- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6314159d40 0x7f6314068280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00aa90 tx=0x7f62fc00a330 comp rx=0 tx=0).stop 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 -- 172.21.15.3:0/2279896308 shutdown_connections 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 --2- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63140687c0 0x7f63140c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 --2- 172.21.15.3:0/2279896308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6314159d40 0x7f6314068280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 -- 172.21.15.3:0/2279896308 >> 172.21.15.3:0/2279896308 conn(0x7f63140c8c90 msgr2=0x7f63140c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 -- 172.21.15.3:0/2279896308 shutdown_connections 2023-10-08T16:08:36.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.981+0000 7f6313fff700 1 -- 172.21.15.3:0/2279896308 wait complete. 2023-10-08T16:08:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 Processor -- start 2023-10-08T16:08:36.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 -- start start 2023-10-08T16:08:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63140687c0 0x7f631416b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f631413eed0 0x7f63140b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6314159d40 0x7f63140b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631416b700 con 0x7f631413eed0 2023-10-08T16:08:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314168180 con 0x7f63140687c0 2023-10-08T16:08:36.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6313fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6314167600 con 0x7f6314159d40 2023-10-08T16:08:36.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f630bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f631413eed0 0x7f63140b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6312ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63140687c0 0x7f631416b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6312ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63140687c0 0x7f631416b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:56816/0 (socket says 172.21.15.3:56816) 2023-10-08T16:08:36.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f6312ffd700 1 -- 172.21.15.3:0/1586828216 learned_addr learned my addr 172.21.15.3:0/1586828216 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:36.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.985+0000 7f63137fe700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6314159d40 0x7f63140b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630bfff700 1 -- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6314159d40 msgr2=0x7f63140b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630bfff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6314159d40 0x7f63140b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630bfff700 1 -- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63140687c0 msgr2=0x7f631416b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630bfff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63140687c0 0x7f631416b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630bfff700 1 -- 172.21.15.3:0/1586828216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc00a5d0 con 0x7f631413eed0 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f63137fe700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6314159d40 0x7f63140b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630bfff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f631413eed0 0x7f63140b1210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f62fc017000 tx=0x7f62fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc01c040 con 0x7f631413eed0 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc0223f0 con 0x7f631413eed0 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63141678e0 con 0x7f631413eed0 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0227b0 con 0x7f631413eed0 2023-10-08T16:08:36.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6314167ea0 con 0x7f631413eed0 2023-10-08T16:08:36.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6314168410 con 0x7f631413eed0 2023-10-08T16:08:36.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.989+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f62fc0103f0 con 0x7f631413eed0 2023-10-08T16:08:36.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.993+0000 7f630affd700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f62f4060550 0x7f62f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:36.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.993+0000 7f6312ffd700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f62f4060550 0x7f62f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:36.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.993+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62fc07de50 con 0x7f631413eed0 2023-10-08T16:08:36.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:36.993+0000 7f6312ffd700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f62f4060550 0x7f62f4062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6304007fd0 tx=0x7f6304007d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.001+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6314168410 con 0x7f631413eed0 2023-10-08T16:08:37.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.165+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6314168410 con 0x7f631413eed0 2023-10-08T16:08:37.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.165+0000 7f630affd700 1 -- 172.21.15.3:0/1586828216 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f6314168410 con 0x7f631413eed0 2023-10-08T16:08:37.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:37.172 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":43,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:08:35.863110+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:37.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f62f4060550 msgr2=0x7f62f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f62f4060550 0x7f62f4062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6304007fd0 tx=0x7f6304007d90 comp rx=0 tx=0).stop 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f631413eed0 msgr2=0x7f63140b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f631413eed0 0x7f63140b1210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f62fc017000 tx=0x7f62fc01a000 comp rx=0 tx=0).stop 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 shutdown_connections 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f62f4060550 0x7f62f4062a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6314159d40 0x7f63140b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f631413eed0 0x7f63140b1210 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 --2- 172.21.15.3:0/1586828216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63140687c0 0x7f631416b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 >> 172.21.15.3:0/1586828216 conn(0x7f63140c8c90 msgr2=0x7f63140c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 shutdown_connections 2023-10-08T16:08:37.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.169+0000 7f6313fff700 1 -- 172.21.15.3:0/1586828216 wait complete. 2023-10-08T16:08:37.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:08:37.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.293+0000 7f8c3b59e700 1 Processor -- start 2023-10-08T16:08:37.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.293+0000 7f8c3b59e700 1 -- start start 2023-10-08T16:08:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8c3c158c80 0x7f8c3c15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c06bb50 con 0x7f8c3c06db60 2023-10-08T16:08:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0b45a0 con 0x7f8c3c0b37c0 2023-10-08T16:08:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c06a3a0 con 0x7f8c3c158c80 2023-10-08T16:08:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c39d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8c3c06db60 0x7f8c3c06b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54066/0 (socket says 172.21.15.3:54066) 2023-10-08T16:08:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c39d9b700 1 -- 172.21.15.3:0/4244828770 learned_addr learned my addr 172.21.15.3:0/4244828770 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:37.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3a59c700 1 --2- 172.21.15.3:0/4244828770 >> v2:172.21.15.27:3300/0 conn(0x7f8c3c158c80 0x7f8c3c15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3959a700 1 -- 172.21.15.3:0/4244828770 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638534407 0 0) 0x7f8c3c06bb50 con 0x7f8c3c06db60 2023-10-08T16:08:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3959a700 1 -- 172.21.15.3:0/4244828770 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c28003570 con 0x7f8c3c06db60 2023-10-08T16:08:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3a59c700 1 -- 172.21.15.3:0/4244828770 >> v1:172.21.15.27:6789/0 conn(0x7f8c3c0b37c0 legacy=0x7f8c3c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3a59c700 1 -- 172.21.15.3:0/4244828770 >> v1:172.21.15.3:6789/0 conn(0x7f8c3c06db60 legacy=0x7f8c3c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3a59c700 1 -- 172.21.15.3:0/4244828770 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c06a680 con 0x7f8c3c158c80 2023-10-08T16:08:37.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3a59c700 1 --2- 172.21.15.3:0/4244828770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c158c80 0x7f8c3c15d4c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098e0 tx=0x7f8c340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997a669effe76fef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3959a700 1 -- 172.21.15.3:0/4244828770 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400b6d0 con 0x7f8c3c158c80 2023-10-08T16:08:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3959a700 1 -- 172.21.15.3:0/4244828770 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3400b830 con 0x7f8c3c158c80 2023-10-08T16:08:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3959a700 1 -- 172.21.15.3:0/4244828770 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400bbb0 con 0x7f8c3c158c80 2023-10-08T16:08:37.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- 172.21.15.3:0/4244828770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c158c80 msgr2=0x7f8c3c15d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/4244828770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c158c80 0x7f8c3c15d4c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098e0 tx=0x7f8c340091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- 172.21.15.3:0/4244828770 shutdown_connections 2023-10-08T16:08:37.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/4244828770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c158c80 0x7f8c3c15d4c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- 172.21.15.3:0/4244828770 >> 172.21.15.3:0/4244828770 conn(0x7f8c3c0d0820 msgr2=0x7f8c3c0b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:37.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- 172.21.15.3:0/4244828770 shutdown_connections 2023-10-08T16:08:37.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.297+0000 7f8c3b59e700 1 -- 172.21.15.3:0/4244828770 wait complete. 2023-10-08T16:08:37.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.301+0000 7f8c3b59e700 1 Processor -- start 2023-10-08T16:08:37.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.301+0000 7f8c3b59e700 1 -- start start 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 0x7f8c3c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c0b37c0 0x7f8c3c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8c3c158c80 0x7f8c3c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c157620 con 0x7f8c3c06db60 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c16a810 con 0x7f8c3c0b37c0 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c14bd90 con 0x7f8c3c158c80 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 0x7f8c3c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 0x7f8c3c154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55416/0 (socket says 172.21.15.3:55416) 2023-10-08T16:08:37.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 -- 172.21.15.3:0/2425280714 learned_addr learned my addr 172.21.15.3:0/2425280714 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3ad9d700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8c3c158c80 0x7f8c3c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c39d9b700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c0b37c0 0x7f8c3c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 -- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8c3c158c80 msgr2=0x7f8c3c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8c3c158c80 0x7f8c3c155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 -- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c0b37c0 msgr2=0x7f8c3c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c0b37c0 0x7f8c3c1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 -- 172.21.15.3:0/2425280714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34009420 con 0x7f8c3c06db60 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c39d9b700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c0b37c0 0x7f8c3c1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3a59c700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 0x7f8c3c154a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c06f8c0 tx=0x7f8c34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400bbb0 con 0x7f8c3c06db60 2023-10-08T16:08:37.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34011420 con 0x7f8c3c06db60 2023-10-08T16:08:37.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c16a530 con 0x7f8c3c06db60 2023-10-08T16:08:37.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011820 con 0x7f8c3c06db60 2023-10-08T16:08:37.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.305+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c14ba20 con 0x7f8c3c06db60 2023-10-08T16:08:37.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.309+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8c34011c50 con 0x7f8c3c06db60 2023-10-08T16:08:37.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.309+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c04be40 con 0x7f8c3c06db60 2023-10-08T16:08:37.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.309+0000 7f8c327fc700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8c1c060550 0x7f8c1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.309+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c3407dfe0 con 0x7f8c3c06db60 2023-10-08T16:08:37.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.309+0000 7f8c39d9b700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8c1c060550 0x7f8c1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.309+0000 7f8c39d9b700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8c1c060550 0x7f8c1c062a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0cfd20 tx=0x7f8c24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.317+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c3404e550 con 0x7f8c3c06db60 2023-10-08T16:08:37.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.513+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8c3c154fc0 con 0x7f8c3c06db60 2023-10-08T16:08:37.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.533+0000 7f8c327fc700 1 -- 172.21.15.3:0/2425280714 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c340150b0 con 0x7f8c3c06db60 2023-10-08T16:08:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8c1c060550 msgr2=0x7f8c1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8c1c060550 0x7f8c1c062a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0cfd20 tx=0x7f8c24009040 comp rx=0 tx=0).stop 2023-10-08T16:08:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 msgr2=0x7f8c3c154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 0x7f8c3c154a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c06f8c0 tx=0x7f8c34017000 comp rx=0 tx=0).stop 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 shutdown_connections 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8c1c060550 0x7f8c1c062a00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8c3c158c80 0x7f8c3c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c3c0b37c0 0x7f8c3c1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 --2- 172.21.15.3:0/2425280714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c3c06db60 0x7f8c3c154a80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 >> 172.21.15.3:0/2425280714 conn(0x7f8c3c0d0820 msgr2=0x7f8c3c159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 shutdown_connections 2023-10-08T16:08:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.537+0000 7f8c3b59e700 1 -- 172.21.15.3:0/2425280714 wait complete. 2023-10-08T16:08:37.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:08:37.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.661+0000 7f99b9224700 1 Processor -- start 2023-10-08T16:08:37.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.661+0000 7f99b9224700 1 -- start start 2023-10-08T16:08:37.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b406db60 0x7f99b415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f99b40b37c0 0x7f99b40b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40b4140 con 0x7f99b4158c80 2023-10-08T16:08:37.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b415a060 con 0x7f99b40b37c0 2023-10-08T16:08:37.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b406bb50 con 0x7f99b406db60 2023-10-08T16:08:37.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b8a23700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f99b40b37c0 0x7f99b40b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f99b4158c80 0x7f99b406b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54074/0 (socket says 172.21.15.3:54074) 2023-10-08T16:08:37.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b3fff700 1 -- 172.21.15.3:0/141274278 learned_addr learned my addr 172.21.15.3:0/141274278 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:37.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b37fe700 1 --2- 172.21.15.3:0/141274278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b406db60 0x7f99b415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b8a23700 1 -- 172.21.15.3:0/141274278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b406db60 msgr2=0x7f99b415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:37.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b8a23700 1 --2- 172.21.15.3:0/141274278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b406db60 0x7f99b415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b8a23700 1 -- 172.21.15.3:0/141274278 >> v1:172.21.15.3:6789/0 conn(0x7f99b4158c80 legacy=0x7f99b406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b8a23700 1 -- 172.21.15.3:0/141274278 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40b45a0 con 0x7f99b40b37c0 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b8a23700 1 --2- 172.21.15.3:0/141274278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40b3c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009e60 tx=0x7f99ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fa9009b226c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b2ffd700 1 -- 172.21.15.3:0/141274278 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00e070 con 0x7f99b40b37c0 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b2ffd700 1 -- 172.21.15.3:0/141274278 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00bb60 con 0x7f99b40b37c0 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b2ffd700 1 -- 172.21.15.3:0/141274278 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac012430 con 0x7f99b40b37c0 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- 172.21.15.3:0/141274278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 msgr2=0x7f99b40b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 --2- 172.21.15.3:0/141274278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40b3c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009e60 tx=0x7f99ac009780 comp rx=0 tx=0).stop 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- 172.21.15.3:0/141274278 shutdown_connections 2023-10-08T16:08:37.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 --2- 172.21.15.3:0/141274278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40b3c00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 --2- 172.21.15.3:0/141274278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b406db60 0x7f99b415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- 172.21.15.3:0/141274278 >> 172.21.15.3:0/141274278 conn(0x7f99b40d0820 msgr2=0x7f99b40b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:37.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- 172.21.15.3:0/141274278 shutdown_connections 2023-10-08T16:08:37.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- 172.21.15.3:0/141274278 wait complete. 2023-10-08T16:08:37.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 Processor -- start 2023-10-08T16:08:37.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.665+0000 7f99b9224700 1 -- start start 2023-10-08T16:08:37.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b406db60 0x7f99b40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b4158c80 0x7f99b4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c5170 con 0x7f99b40b37c0 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c5450 con 0x7f99b406db60 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c5730 con 0x7f99b4158c80 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55440/0 (socket says 172.21.15.3:55440) 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 -- 172.21.15.3:0/3459285572 learned_addr learned my addr 172.21.15.3:0/3459285572 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b3fff700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b406db60 0x7f99b40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b8a23700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b4158c80 0x7f99b4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 -- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b4158c80 msgr2=0x7f99b4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b4158c80 0x7f99b4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 -- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b406db60 msgr2=0x7f99b40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:37.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b406db60 0x7f99b40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:37.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 -- 172.21.15.3:0/3459285572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009a20 con 0x7f99b40b37c0 2023-10-08T16:08:37.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b3fff700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b406db60 0x7f99b40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:37.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b37fe700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40cb2e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f99a400e950 tx=0x7f99a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400c850 con 0x7f99b40b37c0 2023-10-08T16:08:37.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400c9b0 con 0x7f99b40b37c0 2023-10-08T16:08:37.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b40c5a10 con 0x7f99b40b37c0 2023-10-08T16:08:37.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400cdb0 con 0x7f99b40b37c0 2023-10-08T16:08:37.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b40cfa40 con 0x7f99b40b37c0 2023-10-08T16:08:37.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.669+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b404be40 con 0x7f99b40b37c0 2023-10-08T16:08:37.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.673+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f99a4013680 con 0x7f99b40b37c0 2023-10-08T16:08:37.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.673+0000 7f99abfff700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9994060550 0x7f9994062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:37.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.673+0000 7f99b3fff700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9994060550 0x7f9994062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:37.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.673+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99a407d1e0 con 0x7f99b40b37c0 2023-10-08T16:08:37.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.673+0000 7f99b3fff700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9994060550 0x7f9994062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f999c007fd0 tx=0x7f999c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:37.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.677+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99a404d7b0 con 0x7f99b40b37c0 2023-10-08T16:08:37.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:37.877+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f99b40631e0 con 0x7f99b40b37c0 2023-10-08T16:08:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.545+0000 7f99abfff700 1 -- 172.21.15.3:0/3459285572 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f99a4050dd0 con 0x7f99b40b37c0 2023-10-08T16:08:38.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9994060550 msgr2=0x7f9994062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9994060550 0x7f9994062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f999c007fd0 tx=0x7f999c009040 comp rx=0 tx=0).stop 2023-10-08T16:08:38.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 msgr2=0x7f99b40cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40cb2e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f99a400e950 tx=0x7f99a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 shutdown_connections 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9994060550 0x7f9994062a00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f99b4158c80 0x7f99b4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f99b40b37c0 0x7f99b40cb2e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 --2- 172.21.15.3:0/3459285572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b406db60 0x7f99b40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 >> 172.21.15.3:0/3459285572 conn(0x7f99b40d0820 msgr2=0x7f99b41562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 shutdown_connections 2023-10-08T16:08:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.549+0000 7f99b9224700 1 -- 172.21.15.3:0/3459285572 wait complete. 2023-10-08T16:08:38.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:38.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 Processor -- start 2023-10-08T16:08:38.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 -- start start 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c0aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba8c0c6920 0x7fba8c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fba8c159e20 0x7fba8c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c15a7e0 con 0x7fba8c159e20 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c06c260 con 0x7fba8c0c6920 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba91c30700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c06b650 con 0x7fba8c0aa960 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.677+0000 7fba9142f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fba8c159e20 0x7fba8c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fba8c159e20 0x7fba8c15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55444/0 (socket says 172.21.15.3:55444) 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 -- 172.21.15.3:0/2508649112 learned_addr learned my addr 172.21.15.3:0/2508649112 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba8bfff700 1 --2- 172.21.15.3:0/2508649112 >> v2:172.21.15.27:3300/0 conn(0x7fba8c0c6920 0x7fba8c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba90c2e700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c0aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 -- 172.21.15.3:0/2508649112 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 msgr2=0x7fba8c0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:38.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c0aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 -- 172.21.15.3:0/2508649112 >> v2:172.21.15.27:3300/0 conn(0x7fba8c0c6920 msgr2=0x7fba8c0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:38.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 --2- 172.21.15.3:0/2508649112 >> v2:172.21.15.27:3300/0 conn(0x7fba8c0c6920 0x7fba8c0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 -- 172.21.15.3:0/2508649112 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c06b930 con 0x7fba8c159e20 2023-10-08T16:08:38.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba90c2e700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba9142f700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c159e20 0x7fba8c15a2a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0699c0 tx=0x7fba7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc50b8a65dd5f5b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba8b7fe700 1 -- 172.21.15.3:0/2508649112 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c009e70 con 0x7fba8c159e20 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba8b7fe700 1 -- 172.21.15.3:0/2508649112 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c00b860 con 0x7fba8c159e20 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba8b7fe700 1 -- 172.21.15.3:0/2508649112 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00bc00 con 0x7fba8c159e20 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 -- 172.21.15.3:0/2508649112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c159e20 msgr2=0x7fba8c15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c159e20 0x7fba8c15a2a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0699c0 tx=0x7fba7c009250 comp rx=0 tx=0).stop 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 -- 172.21.15.3:0/2508649112 shutdown_connections 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c159e20 0x7fba8c15a2a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 --2- 172.21.15.3:0/2508649112 >> v2:172.21.15.27:3300/0 conn(0x7fba8c0c6920 0x7fba8c0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 --2- 172.21.15.3:0/2508649112 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 -- 172.21.15.3:0/2508649112 >> 172.21.15.3:0/2508649112 conn(0x7fba8c0c83d0 msgr2=0x7fba8c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:38.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 -- 172.21.15.3:0/2508649112 shutdown_connections 2023-10-08T16:08:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 -- 172.21.15.3:0/2508649112 wait complete. 2023-10-08T16:08:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.681+0000 7fba91c30700 1 Processor -- start 2023-10-08T16:08:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 -- start start 2023-10-08T16:08:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 0x7fba8c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba8c159e20 0x7fba8c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1593b0 con 0x7fba8c0c6920 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c167650 con 0x7fba8c159e20 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0c5490 con 0x7fba8c0aa960 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 0x7fba8c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 0x7fba8c0b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55458/0 (socket says 172.21.15.3:55458) 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 -- 172.21.15.3:0/2749268760 learned_addr learned my addr 172.21.15.3:0/2749268760 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba90c2e700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba9142f700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba8c159e20 0x7fba8c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 -- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 msgr2=0x7fba8c1544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c1544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 -- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba8c159e20 msgr2=0x7fba8c0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba8c159e20 0x7fba8c0b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 -- 172.21.15.3:0/2749268760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0094f0 con 0x7fba8c0c6920 2023-10-08T16:08:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba8bfff700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 0x7fba8c0b09c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba74009ef0 tx=0x7fba7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400cc00 con 0x7fba8c0c6920 2023-10-08T16:08:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400f040 con 0x7fba8c0c6920 2023-10-08T16:08:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c167000 con 0x7fba8c0c6920 2023-10-08T16:08:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74014480 con 0x7fba8c0c6920 2023-10-08T16:08:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.685+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c154a10 con 0x7fba8c0c6920 2023-10-08T16:08:38.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.689+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fba740147f0 con 0x7fba8c0c6920 2023-10-08T16:08:38.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.689+0000 7fba88ff9700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fba70060550 0x7fba70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:38.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.689+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c04be40 con 0x7fba8c0c6920 2023-10-08T16:08:38.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.689+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba7407d490 con 0x7fba8c0c6920 2023-10-08T16:08:38.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.689+0000 7fba90c2e700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fba70060550 0x7fba70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:38.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.689+0000 7fba90c2e700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fba70060550 0x7fba70062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba84006f00 tx=0x7fba84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:38.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.693+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fba7404da80 con 0x7fba8c0c6920 2023-10-08T16:08:38.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba8c06bc10 con 0x7fba8c0c6920 2023-10-08T16:08:38.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba88ff9700 1 -- 172.21.15.3:0/2749268760 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fba740510a0 con 0x7fba8c0c6920 2023-10-08T16:08:38.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:38.898 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:08:38.537902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:08:38.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fba70060550 msgr2=0x7fba70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fba70060550 0x7fba70062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba84006f00 tx=0x7fba84008040 comp rx=0 tx=0).stop 2023-10-08T16:08:38.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 msgr2=0x7fba8c0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:38.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 0x7fba8c0b09c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba74009ef0 tx=0x7fba7400b040 comp rx=0 tx=0).stop 2023-10-08T16:08:38.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 shutdown_connections 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fba70060550 0x7fba70062a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba8c159e20 0x7fba8c0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba8c0c6920 0x7fba8c0b09c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 --2- 172.21.15.3:0/2749268760 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fba8c0aa960 0x7fba8c1544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 >> 172.21.15.3:0/2749268760 conn(0x7fba8c0c83d0 msgr2=0x7fba8c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 shutdown_connections 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:38.893+0000 7fba91c30700 1 -- 172.21.15.3:0/2749268760 wait complete. 2023-10-08T16:08:38.901 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 18 2023-10-08T16:08:38.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:39.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.013+0000 7fb7023e6700 1 Processor -- start 2023-10-08T16:08:39.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.013+0000 7fb7023e6700 1 -- start start 2023-10-08T16:08:39.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb6fc158b90 0x7fb6fc158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc06a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc0ca2d0 con 0x7fb6fc0cad20 2023-10-08T16:08:39.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc1594a0 con 0x7fb6fc158b90 2023-10-08T16:08:39.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0ca890 con 0x7fb6fc06a400 2023-10-08T16:08:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc06a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc06a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:44374/0 (socket says 172.21.15.3:44374) 2023-10-08T16:08:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 -- 172.21.15.3:0/2893951243 learned_addr learned my addr 172.21.15.3:0/2893951243 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7013e4700 1 --2- 172.21.15.3:0/2893951243 >> v2:172.21.15.27:3300/0 conn(0x7fb6fc158b90 0x7fb6fc158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 -- 172.21.15.3:0/2893951243 >> v2:172.21.15.27:3300/0 conn(0x7fb6fc158b90 msgr2=0x7fb6fc158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 --2- 172.21.15.3:0/2893951243 >> v2:172.21.15.27:3300/0 conn(0x7fb6fc158b90 0x7fb6fc158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 -- 172.21.15.3:0/2893951243 >> v1:172.21.15.27:6789/0 conn(0x7fb6fc0cad20 legacy=0x7fb6fc067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 -- 172.21.15.3:0/2893951243 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc159890 con 0x7fb6fc06a400 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb700be3700 1 --2- 172.21.15.3:0/2893951243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc06a850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0099b0 tx=0x7fb6ec009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e883d584ac6c886 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb6f3fff700 1 -- 172.21.15.3:0/2893951243 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec009ea0 con 0x7fb6fc06a400 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb6f3fff700 1 -- 172.21.15.3:0/2893951243 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec00b860 con 0x7fb6fc06a400 2023-10-08T16:08:39.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb6f3fff700 1 -- 172.21.15.3:0/2893951243 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00bc20 con 0x7fb6fc06a400 2023-10-08T16:08:39.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- 172.21.15.3:0/2893951243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 msgr2=0x7fb6fc06a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2893951243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc06a850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0099b0 tx=0x7fb6ec009250 comp rx=0 tx=0).stop 2023-10-08T16:08:39.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- 172.21.15.3:0/2893951243 shutdown_connections 2023-10-08T16:08:39.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2893951243 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc06a850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2893951243 >> v2:172.21.15.27:3300/0 conn(0x7fb6fc158b90 0x7fb6fc158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- 172.21.15.3:0/2893951243 >> 172.21.15.3:0/2893951243 conn(0x7fb6fc0cfd30 msgr2=0x7fb6fc0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:39.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- 172.21.15.3:0/2893951243 shutdown_connections 2023-10-08T16:08:39.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.017+0000 7fb7023e6700 1 -- 172.21.15.3:0/2893951243 wait complete. 2023-10-08T16:08:39.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 Processor -- start 2023-10-08T16:08:39.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 -- start start 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6fc0cad20 0x7fb6fc14a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 0x7fb6fc0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c4740 con 0x7fb6fc158b90 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c4fa0 con 0x7fb6fc0cad20 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc16d750 con 0x7fb6fc06a400 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 0x7fb6fc0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7013e4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 0x7fb6fc0b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55470/0 (socket says 172.21.15.3:55470) 2023-10-08T16:08:39.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 -- 172.21.15.3:0/2827093577 learned_addr learned my addr 172.21.15.3:0/2827093577 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:39.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb700be3700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6fc0cad20 0x7fb6fc14a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 -- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 msgr2=0x7fb6fc0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 -- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6fc0cad20 msgr2=0x7fb6fc14a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6fc0cad20 0x7fb6fc14a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 -- 172.21.15.3:0/2827093577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec0094f0 con 0x7fb6fc158b90 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb700be3700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6fc0cad20 0x7fb6fc14a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7013e4700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb701be5700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 0x7fb6fc0b4fd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400c8e0 tx=0x7fb6f4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4012630 con 0x7fb6fc158b90 2023-10-08T16:08:39.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f4012790 con 0x7fb6fc158b90 2023-10-08T16:08:39.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc0c4950 con 0x7fb6fc158b90 2023-10-08T16:08:39.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4012b50 con 0x7fb6fc158b90 2023-10-08T16:08:39.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.021+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc14a810 con 0x7fb6fc158b90 2023-10-08T16:08:39.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.025+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb6f401a3a0 con 0x7fb6fc158b90 2023-10-08T16:08:39.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.025+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc0c5130 con 0x7fb6fc158b90 2023-10-08T16:08:39.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.025+0000 7fb6f17fa700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb6e0060550 0x7fb6e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.025+0000 7fb7013e4700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb6e0060550 0x7fb6e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.025+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6f407c9a0 con 0x7fb6fc158b90 2023-10-08T16:08:39.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.029+0000 7fb7013e4700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb6e0060550 0x7fb6e0062a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8011480 tx=0x7fb6f80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.033+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb6f404cf90 con 0x7fb6fc158b90 2023-10-08T16:08:39.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.197+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6fc04be40 con 0x7fb6fc158b90 2023-10-08T16:08:39.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.197+0000 7fb6f17fa700 1 -- 172.21.15.3:0/2827093577 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fb6f40505b0 con 0x7fb6fc158b90 2023-10-08T16:08:39.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:39.204 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":44,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:08:37.512440+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb6e0060550 msgr2=0x7fb6e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb6e0060550 0x7fb6e0062a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8011480 tx=0x7fb6f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 msgr2=0x7fb6fc0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 0x7fb6fc0b4fd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400c8e0 tx=0x7fb6f4001710 comp rx=0 tx=0).stop 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 shutdown_connections 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb6e0060550 0x7fb6e0062a00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6fc158b90 0x7fb6fc0b4fd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6fc0cad20 0x7fb6fc14a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 --2- 172.21.15.3:0/2827093577 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb6fc06a400 0x7fb6fc0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 >> 172.21.15.3:0/2827093577 conn(0x7fb6fc0cfd30 msgr2=0x7fb6fc0ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:39.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 shutdown_connections 2023-10-08T16:08:39.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.201+0000 7fb7023e6700 1 -- 172.21.15.3:0/2827093577 wait complete. 2023-10-08T16:08:39.223 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:08:39.223 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:08:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 Processor -- start 2023-10-08T16:08:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 -- start start 2023-10-08T16:08:39.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad4c0ade60 0x7fad4c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad4c0ae230 0x7fad4c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c1562c0 con 0x7fad4c0ade60 2023-10-08T16:08:39.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c06b0b0 con 0x7fad4c0ae230 2023-10-08T16:08:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5191e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c06b390 con 0x7fad4c0c7660 2023-10-08T16:08:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad4c0ae230 0x7fad4c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad4c0ae230 0x7fad4c0cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:56894/0 (socket says 172.21.15.3:56894) 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 -- 172.21.15.3:0/3800729930 learned_addr learned my addr 172.21.15.3:0/3800729930 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5091c700 1 --2- 172.21.15.3:0/3800729930 >> v2:172.21.15.3:3300/0 conn(0x7fad4c0ade60 0x7fad4c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 -- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 msgr2=0x7fad4c0c7b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 --2- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c7b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 -- 172.21.15.3:0/3800729930 >> v2:172.21.15.3:3300/0 conn(0x7fad4c0ade60 msgr2=0x7fad4c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 --2- 172.21.15.3:0/3800729930 >> v2:172.21.15.3:3300/0 conn(0x7fad4c0ade60 0x7fad4c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 -- 172.21.15.3:0/3800729930 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c06b670 con 0x7fad4c0ae230 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad5091c700 1 --2- 172.21.15.3:0/3800729930 >> v2:172.21.15.3:3300/0 conn(0x7fad4c0ade60 0x7fad4c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4bfff700 1 --2- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ae230 0x7fad4c0cb390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0c8330 tx=0x7fad3c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8121aa530de604fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4b7fe700 1 -- 172.21.15.3:0/3800729930 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00f360 con 0x7fad4c0ae230 2023-10-08T16:08:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4b7fe700 1 -- 172.21.15.3:0/3800729930 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c013070 con 0x7fad4c0ae230 2023-10-08T16:08:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.329+0000 7fad4b7fe700 1 -- 172.21.15.3:0/3800729930 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c009940 con 0x7fad4c0ae230 2023-10-08T16:08:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ae230 msgr2=0x7fad4c0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ae230 0x7fad4c0cb390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0c8330 tx=0x7fad3c009250 comp rx=0 tx=0).stop 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- 172.21.15.3:0/3800729930 shutdown_connections 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- 172.21.15.3:0/3800729930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ae230 0x7fad4c0cb390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- 172.21.15.3:0/3800729930 >> v2:172.21.15.3:3300/0 conn(0x7fad4c0ade60 0x7fad4c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- 172.21.15.3:0/3800729930 >> 172.21.15.3:0/3800729930 conn(0x7fad4c0c83d0 msgr2=0x7fad4c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- 172.21.15.3:0/3800729930 shutdown_connections 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- 172.21.15.3:0/3800729930 wait complete. 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 Processor -- start 2023-10-08T16:08:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- start start 2023-10-08T16:08:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ade60 0x7fad4c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 0x7fad4c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0c55c0 con 0x7fad4c0ae230 2023-10-08T16:08:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0c4940 con 0x7fad4c0ade60 2023-10-08T16:08:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5191e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0c4c20 con 0x7fad4c0c7660 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 0x7fad4c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 0x7fad4c0c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55482/0 (socket says 172.21.15.3:55482) 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 -- 172.21.15.3:0/1622384339 learned_addr learned my addr 172.21.15.3:0/1622384339 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5091c700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ade60 0x7fad4c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5111d700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 -- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 msgr2=0x7fad4c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 -- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ade60 msgr2=0x7fad4c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ade60 0x7fad4c158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 -- 172.21.15.3:0/1622384339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44009a20 con 0x7fad4c0ae230 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5111d700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad5091c700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ade60 0x7fad4c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.333+0000 7fad4bfff700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 0x7fad4c0c3dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fad4c156400 tx=0x7fad3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c01d070 con 0x7fad4c0ae230 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c00c070 con 0x7fad4c0ae230 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c00f610 con 0x7fad4c0ae230 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c000c90 con 0x7fad4c0ae230 2023-10-08T16:08:39.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c0c51e0 con 0x7fad4c0ae230 2023-10-08T16:08:39.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c0c5700 con 0x7fad4c0ae230 2023-10-08T16:08:39.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad3c02a3b0 con 0x7fad4c0ae230 2023-10-08T16:08:39.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad48ff9700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad38060550 0x7fad38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad5091c700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad38060550 0x7fad38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.337+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad3c07d5c0 con 0x7fad4c0ae230 2023-10-08T16:08:39.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.341+0000 7fad5091c700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad38060550 0x7fad38062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fad440099f0 tx=0x7fad44015040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.345+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad3c04dc40 con 0x7fad4c0ae230 2023-10-08T16:08:39.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.501+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad4c0c5700 con 0x7fad38060550 2023-10-08T16:08:39.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.517+0000 7fad48ff9700 1 -- 172.21.15.3:0/1622384339 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272075 (secure 0 0 0) 0x7fad4c0c5700 con 0x7fad38060550 2023-10-08T16:08:39.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad38060550 msgr2=0x7fad38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad38060550 0x7fad38062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fad440099f0 tx=0x7fad44015040 comp rx=0 tx=0).stop 2023-10-08T16:08:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 msgr2=0x7fad4c0c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 0x7fad4c0c3dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fad4c156400 tx=0x7fad3c013000 comp rx=0 tx=0).stop 2023-10-08T16:08:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 shutdown_connections 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad38060550 0x7fad38062a00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fad4c0c7660 0x7fad4c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad4c0ae230 0x7fad4c0c3dc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 --2- 172.21.15.3:0/1622384339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4c0ade60 0x7fad4c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.521+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 >> 172.21.15.3:0/1622384339 conn(0x7fad4c0c83d0 msgr2=0x7fad4c153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.525+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 shutdown_connections 2023-10-08T16:08:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.525+0000 7fad5191e700 1 -- 172.21.15.3:0/1622384339 wait complete. 2023-10-08T16:08:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:08:39.543 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-10-08T16:08:37.857601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2387124,"kb_used_data":4724,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587596,"statfs":{"total":773094113280,"available":770649698304,"internally_reserved":0,"allocated":4837376,"data_stored":2603083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000965"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T16:08:27.643682+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:08:27.643682+0000","last_peered":"2023-10-08T16:08:27.643682+0000","last_clean":"2023-10-08T16:08:27.643682+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:08:27.643682+0000","last_undegraded":"2023-10-08T16:08:27.643682+0000","last_fullsized":"2023-10-08T16:08:27.643682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302408,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069432,"statfs":{"total":96636764160,"available":96327098368,"internally_reserved":0,"allocated":1048576,"data_stored":767522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.242,"5min":1.343,"15min":1.343},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2450000000000001,"5min":1.429,"15min":1.429},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.70999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.3440000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.71899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1399999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.014,"15min":1.02},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.258,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.998,"15min":1.008},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2949999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1399999999999999,"15min":1.149},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.24,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1890000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0860000000000001,"15min":1.107},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.163,"5min":1.492,"15min":1.492},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.1100000000000001,"15min":1.129},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.702,"15min":1.702},"last":1.2370000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.171,"15min":1.1830000000000001},"min":{"1min":0.68100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.355,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3089999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2330000000000001,"15min":1.2450000000000001},"min":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.429,"5min":1.75,"15min":1.75},"last":1.429},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1899999999999999,"15min":1.206},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.401,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.3879999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.97999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.0469999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.1419999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.246}]},{"osd":5,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.27},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.196}]},{"osd":7,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.321},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.409}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.302,"5min":1.377,"15min":1.377},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.228,"15min":1.228},"last":0.75}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.22,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.127},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3700000000000001,"5min":1.734,"15min":1.734},"last":1.149}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96299999999999997},"min":{"1min":0.754,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.206,"5min":1.972,"15min":1.972},"last":1.292},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.032,"15min":1.048},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.21,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0269999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.077,"15min":1.077},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4710000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.749,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3460000000000001,"5min":2.141,"15min":2.141},"last":1.1970000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.018,"15min":1.038},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.139,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.89000000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7589999999999999,"5min":2.101,"15min":2.101},"last":1.3680000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.401,"5min":2.383,"15min":2.383},"last":1.075},{"interface":"front","average":{"1min":1.081,"5min":1.224,"15min":1.248},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.3540000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.224}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9299999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.387,"15min":1.405},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4770000000000001,"5min":2.605,"15min":2.605},"last":1.3939999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":0.95999999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.526}]},{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.2},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.03,"15min":1.0469999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.099,"15min":1.125},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.157,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4610000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1240000000000001,"15min":1.1479999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.395},{"interface":"front","average":{"1min":1.032,"5min":1.113,"15min":1.127},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.284,"5min":1.607,"15min":1.607},"last":1.4299999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.194,"15min":1.226},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.647},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.216,"15min":1.2430000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3340000000000001,"5min":1.702,"15min":1.702},"last":1.7150000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.157,"15min":1.1859999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.3640000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.139},{"interface":"front","average":{"1min":1.177,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":2.347,"15min":2.347},"last":1.7490000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4810000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.867},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3600000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3680000000000001,"5min":1.95,"15min":1.95},"last":1.5589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":182269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77100000000000002,"15min":0.76500000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.27,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.103,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0589999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.61299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.92900000000000005},"min":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1120000000000001,"5min":1.403,"15min":1.403},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.03,"15min":1.024},"min":{"1min":0.79800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5680000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6659999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.4399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.76500000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.54,"15min":1.54},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.248}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.85099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5049999999999999,"5min":1.575,"15min":1.575},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.248},"min":{"1min":0.95999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5529999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.4910000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2310000000000001,"15min":1.2270000000000001},"min":{"1min":0.94599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.034},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2549999999999999,"15min":1.262},"min":{"1min":0.97399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6180000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.3089999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.89500000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.032},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.1830000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.244},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.125}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.49299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90700000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.755,"15min":0.74399999999999999},"min":{"1min":0.65900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.345}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":1.004,"15min":1.004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.83699999999999997,"15min":0.83199999999999996},"min":{"1min":0.59199999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0569999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.034}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.69399999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83099999999999996,"15min":0.81699999999999995},"min":{"1min":0.58099999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.21,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.155}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.97699999999999998,"15min":0.97299999999999998},"min":{"1min":0.79700000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.3999999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.008},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4119999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.117,"15min":1.117},"min":{"1min":0.91900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3580000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.548,"5min":1.768,"15min":1.768},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.84599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.101}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1659999999999999,"15min":1.1719999999999999},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.339,"5min":1.625,"15min":1.625},"last":1},{"interface":"front","average":{"1min":1.22,"5min":1.248,"15min":1.2529999999999999},"min":{"1min":1.022,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6379999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":767522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.54300000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.109,"5min":1.3,"15min":1.3},"last":0.82899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.266,"15min":1.266},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.60699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.244,"15min":1.244},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.996,"5min":0.96699999999999997,"15min":0.96199999999999997},"min":{"1min":0.70299999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3740000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0509999999999999,"15min":1.0389999999999999},"min":{"1min":0.78100000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.749}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.1299999999999999},"min":{"1min":0.76600000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.667,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.276},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.1990000000000001},"min":{"1min":0.95699999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.897,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.327}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.875,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2450000000000001,"15min":1.234},"min":{"1min":0.94999999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.238,"15min":1.234},"min":{"1min":0.97999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.177},{"interface":"front","average":{"1min":1.23,"5min":1.2,"15min":1.1950000000000001},"min":{"1min":1.0209999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.74,"5min":2.008,"15min":2.008},"last":0.97299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:08:39.551 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:08:39.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 Processor -- start 2023-10-08T16:08:39.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 -- start start 2023-10-08T16:08:39.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f63b4158a80 0x7f63b4158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40ca7a0 con 0x7f63b40abee0 2023-10-08T16:08:39.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40c8240 con 0x7f63b4158a80 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b9610700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40caa40 con 0x7f63b406d0c0 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b27fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f63b40abee0 0x7f63b40c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36270/0 (socket says 172.21.15.3:36270) 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b27fc700 1 -- 172.21.15.3:0/1548932454 learned_addr learned my addr 172.21.15.3:0/1548932454 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b37fe700 1 --2- 172.21.15.3:0/1548932454 >> v2:172.21.15.3:3300/0 conn(0x7f63b4158a80 0x7f63b4158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b2ffd700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b1ffb700 1 -- 172.21.15.3:0/1548932454 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940396139 0 0) 0x7f63b40ca7a0 con 0x7f63b40abee0 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b1ffb700 1 -- 172.21.15.3:0/1548932454 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a0003570 con 0x7f63b40abee0 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b37fe700 1 -- 172.21.15.3:0/1548932454 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 msgr2=0x7f63b406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.657+0000 7f63b37fe700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b37fe700 1 -- 172.21.15.3:0/1548932454 >> v1:172.21.15.3:6789/0 conn(0x7f63b40abee0 legacy=0x7f63b40c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b37fe700 1 -- 172.21.15.3:0/1548932454 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40cad20 con 0x7f63b4158a80 2023-10-08T16:08:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b2ffd700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b37fe700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b4158a80 0x7f63b4158eb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009e60 tx=0x7f63ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef2e28dbc2695a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b1ffb700 1 -- 172.21.15.3:0/1548932454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00e070 con 0x7f63b4158a80 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b1ffb700 1 -- 172.21.15.3:0/1548932454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac00bab0 con 0x7f63b4158a80 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b1ffb700 1 -- 172.21.15.3:0/1548932454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00be70 con 0x7f63b4158a80 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 -- 172.21.15.3:0/1548932454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b4158a80 msgr2=0x7f63b4158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b4158a80 0x7f63b4158eb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009e60 tx=0x7f63ac009780 comp rx=0 tx=0).stop 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 -- 172.21.15.3:0/1548932454 shutdown_connections 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b4158a80 0x7f63b4158eb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 --2- 172.21.15.3:0/1548932454 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 -- 172.21.15.3:0/1548932454 >> 172.21.15.3:0/1548932454 conn(0x7f63b40ccbd0 msgr2=0x7f63b40ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 -- 172.21.15.3:0/1548932454 shutdown_connections 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 -- 172.21.15.3:0/1548932454 wait complete. 2023-10-08T16:08:39.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 Processor -- start 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.661+0000 7f63b9610700 1 -- start start 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b9610700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b4158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b9610700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 0x7f63b40a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b9610700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63b4158a80 0x7f63b40aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b9610700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40c6d00 con 0x7f63b40abee0 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b9610700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40c3fa0 con 0x7f63b4158a80 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b9610700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40a8d70 con 0x7f63b406d0c0 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 0x7f63b40a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 0x7f63b40a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33504/0 (socket says 172.21.15.3:33504) 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 -- 172.21.15.3:0/970239223 learned_addr learned my addr 172.21.15.3:0/970239223 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b2ffd700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b4158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b37fe700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63b4158a80 0x7f63b40aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 -- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 msgr2=0x7f63b4158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b4158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 -- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63b4158a80 msgr2=0x7f63b40aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63b4158a80 0x7f63b40aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 -- 172.21.15.3:0/970239223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a4009420 con 0x7f63b40abee0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b2ffd700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b4158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.665+0000 7f63b27fc700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 0x7f63b40a9b30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f639c00c7c0 tx=0x7f639c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c005c00 con 0x7f63b40abee0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c005d60 con 0x7f63b40abee0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac009a20 con 0x7f63b40abee0 2023-10-08T16:08:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c007320 con 0x7f63b40abee0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b40a9330 con 0x7f63b40abee0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f639c01b3b0 con 0x7f63b40abee0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b404be40 con 0x7f63b40abee0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63aaffd700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6394060550 0x7f6394062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f639c07bc90 con 0x7f63b40abee0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.669+0000 7f63b2ffd700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6394060550 0x7f6394062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.673+0000 7f63b2ffd700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6394060550 0x7f6394062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011600 tx=0x7f63a40091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:39.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.677+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f639c04c280 con 0x7f63b40abee0 2023-10-08T16:08:39.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.837+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63b40cb000 con 0x7f6394060550 2023-10-08T16:08:39.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.853+0000 7f63aaffd700 1 -- 172.21.15.3:0/970239223 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272075 (secure 0 0 0) 0x7f63b40cb000 con 0x7f6394060550 2023-10-08T16:08:39.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:39.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.857+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6394060550 msgr2=0x7f6394062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.857+0000 7f63b9610700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6394060550 0x7f6394062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011600 tx=0x7f63a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 msgr2=0x7f63b40a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:39.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 0x7f63b40a9b30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f639c00c7c0 tx=0x7f639c007dd0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 shutdown_connections 2023-10-08T16:08:39.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6394060550 0x7f6394062a00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63b4158a80 0x7f63b40aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63b40abee0 0x7f63b40a9b30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 --2- 172.21.15.3:0/970239223 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f63b406d0c0 0x7f63b4158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 >> 172.21.15.3:0/970239223 conn(0x7f63b40ccbd0 msgr2=0x7f63b40c7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 shutdown_connections 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:39.861+0000 7f63b9610700 1 -- 172.21.15.3:0/970239223 wait complete. 2023-10-08T16:08:39.866 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:08:39.879 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-10-08T16:08:37.857601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2387124,"kb_used_data":4724,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587596,"statfs":{"total":773094113280,"available":770649698304,"internally_reserved":0,"allocated":4837376,"data_stored":2603083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000965"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:35.485037+0000","last_change":"2023-10-08T16:08:35.485037+0000","last_active":"2023-10-08T16:08:35.485037+0000","last_peered":"2023-10-08T16:08:35.485037+0000","last_clean":"2023-10-08T16:08:35.485037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:35.485037+0000","last_undegraded":"2023-10-08T16:08:35.485037+0000","last_fullsized":"2023-10-08T16:08:35.485037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:08:34.474399+0000","last_change":"2023-10-08T16:08:34.474399+0000","last_active":"2023-10-08T16:08:34.474399+0000","last_peered":"2023-10-08T16:08:34.474399+0000","last_clean":"2023-10-08T16:08:34.474399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:34.474399+0000","last_undegraded":"2023-10-08T16:08:34.474399+0000","last_fullsized":"2023-10-08T16:08:34.474399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T16:08:27.643682+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:08:27.643682+0000","last_peered":"2023-10-08T16:08:27.643682+0000","last_clean":"2023-10-08T16:08:27.643682+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:08:27.643682+0000","last_undegraded":"2023-10-08T16:08:27.643682+0000","last_fullsized":"2023-10-08T16:08:27.643682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302408,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069432,"statfs":{"total":96636764160,"available":96327098368,"internally_reserved":0,"allocated":1048576,"data_stored":767522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.242,"5min":1.343,"15min":1.343},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2450000000000001,"5min":1.429,"15min":1.429},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.70999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.3440000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.71899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1399999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.014,"15min":1.02},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.258,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.998,"15min":1.008},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2949999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1399999999999999,"15min":1.149},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.24,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1890000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0860000000000001,"15min":1.107},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.163,"5min":1.492,"15min":1.492},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.1100000000000001,"15min":1.129},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.702,"15min":1.702},"last":1.2370000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.171,"15min":1.1830000000000001},"min":{"1min":0.68100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.355,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3089999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2330000000000001,"15min":1.2450000000000001},"min":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.429,"5min":1.75,"15min":1.75},"last":1.429},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1899999999999999,"15min":1.206},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.401,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.3879999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.97999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.0469999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.1419999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.246}]},{"osd":5,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.27},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.196}]},{"osd":7,"last update":"Sun Oct 8 16:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.321},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.409}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.302,"5min":1.377,"15min":1.377},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.228,"15min":1.228},"last":0.75}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.22,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.127},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3700000000000001,"5min":1.734,"15min":1.734},"last":1.149}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96299999999999997},"min":{"1min":0.754,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.206,"5min":1.972,"15min":1.972},"last":1.292},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.032,"15min":1.048},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.21,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0269999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.077,"15min":1.077},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4710000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.749,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3460000000000001,"5min":2.141,"15min":2.141},"last":1.1970000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.018,"15min":1.038},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.139,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.89000000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7589999999999999,"5min":2.101,"15min":2.101},"last":1.3680000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.401,"5min":2.383,"15min":2.383},"last":1.075},{"interface":"front","average":{"1min":1.081,"5min":1.224,"15min":1.248},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.3540000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.224}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9299999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.387,"15min":1.405},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4770000000000001,"5min":2.605,"15min":2.605},"last":1.3939999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":0.95999999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.526}]},{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.2},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.03,"15min":1.0469999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.099,"15min":1.125},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.157,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4610000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1240000000000001,"15min":1.1479999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.395},{"interface":"front","average":{"1min":1.032,"5min":1.113,"15min":1.127},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.284,"5min":1.607,"15min":1.607},"last":1.4299999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.194,"15min":1.226},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.647},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.216,"15min":1.2430000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3340000000000001,"5min":1.702,"15min":1.702},"last":1.7150000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.157,"15min":1.1859999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.3640000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.139},{"interface":"front","average":{"1min":1.177,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":2.347,"15min":2.347},"last":1.7490000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4810000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.867},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3600000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3680000000000001,"5min":1.95,"15min":1.95},"last":1.5589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":182269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77100000000000002,"15min":0.76500000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.27,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.103,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0589999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.61299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.92900000000000005},"min":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1120000000000001,"5min":1.403,"15min":1.403},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.03,"15min":1.024},"min":{"1min":0.79800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5680000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6659999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.4399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.76500000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.54,"15min":1.54},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.248}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.85099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5049999999999999,"5min":1.575,"15min":1.575},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.248},"min":{"1min":0.95999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5529999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.4910000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2310000000000001,"15min":1.2270000000000001},"min":{"1min":0.94599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.034},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2549999999999999,"15min":1.262},"min":{"1min":0.97399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6180000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.3089999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.89500000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.032},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.1830000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:07:29 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.244},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.125}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":177154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.49299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90700000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.755,"15min":0.74399999999999999},"min":{"1min":0.65900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.345}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":1.004,"15min":1.004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.83699999999999997,"15min":0.83199999999999996},"min":{"1min":0.59199999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0569999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.034}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.69399999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83099999999999996,"15min":0.81699999999999995},"min":{"1min":0.58099999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.21,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.155}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.97699999999999998,"15min":0.97299999999999998},"min":{"1min":0.79700000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.3999999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.008},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4119999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.117,"15min":1.117},"min":{"1min":0.91900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3580000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.548,"5min":1.768,"15min":1.768},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.84599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.101}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1659999999999999,"15min":1.1719999999999999},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.339,"5min":1.625,"15min":1.625},"last":1},{"interface":"front","average":{"1min":1.22,"5min":1.248,"15min":1.2529999999999999},"min":{"1min":1.022,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6379999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":767522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.54300000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.109,"5min":1.3,"15min":1.3},"last":0.82899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.266,"15min":1.266},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.60699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.244,"15min":1.244},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.996,"5min":0.96699999999999997,"15min":0.96199999999999997},"min":{"1min":0.70299999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3740000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0509999999999999,"15min":1.0389999999999999},"min":{"1min":0.78100000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.749}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.1299999999999999},"min":{"1min":0.76600000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.667,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.276},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.1990000000000001},"min":{"1min":0.95699999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.897,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.327}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.875,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2450000000000001,"15min":1.234},"min":{"1min":0.94999999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.238,"15min":1.234},"min":{"1min":0.97999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.177},{"interface":"front","average":{"1min":1.23,"5min":1.2,"15min":1.1950000000000001},"min":{"1min":1.0209999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.74,"5min":2.008,"15min":2.008},"last":0.97299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:08:39.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:08:40.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 Processor -- start 2023-10-08T16:08:40.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 -- start start 2023-10-08T16:08:40.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b80adc30 0x7f23b806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f23b80ca810 0x7f23b80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b80ae540 con 0x7f23b806ab00 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b806cae0 con 0x7f23b80ca810 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23bd231700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b806cdc0 con 0x7f23b80adc30 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f23b806ab00 0x7f23b80ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36276/0 (socket says 172.21.15.3:36276) 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b659c700 1 -- 172.21.15.3:0/816381466 learned_addr learned my addr 172.21.15.3:0/816381466 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b6d9d700 1 --2- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b80adc30 0x7f23b806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b759e700 1 --2- 172.21.15.3:0/816381466 >> v2:172.21.15.27:3300/0 conn(0x7f23b80ca810 0x7f23b80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b5d9b700 1 -- 172.21.15.3:0/816381466 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93538589 0 0) 0x7f23b80ae540 con 0x7f23b806ab00 2023-10-08T16:08:40.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b5d9b700 1 -- 172.21.15.3:0/816381466 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a4003570 con 0x7f23b806ab00 2023-10-08T16:08:40.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b759e700 1 -- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b80adc30 msgr2=0x7f23b806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:40.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b759e700 1 --2- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b80adc30 0x7f23b806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b759e700 1 -- 172.21.15.3:0/816381466 >> v1:172.21.15.3:6789/0 conn(0x7f23b806ab00 legacy=0x7f23b80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b759e700 1 -- 172.21.15.3:0/816381466 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b806d0a0 con 0x7f23b80ca810 2023-10-08T16:08:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b759e700 1 --2- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80ca810 0x7f23b80ae000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f23b00098e0 tx=0x7f23b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abd111eba6b961b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b5d9b700 1 -- 172.21.15.3:0/816381466 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0011630 con 0x7f23b80ca810 2023-10-08T16:08:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b5d9b700 1 -- 172.21.15.3:0/816381466 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0011790 con 0x7f23b80ca810 2023-10-08T16:08:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.077+0000 7f23b5d9b700 1 -- 172.21.15.3:0/816381466 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0011b10 con 0x7f23b80ca810 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80ca810 msgr2=0x7f23b80ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 --2- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80ca810 0x7f23b80ae000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f23b00098e0 tx=0x7f23b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- 172.21.15.3:0/816381466 shutdown_connections 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 --2- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80ca810 0x7f23b80ae000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 --2- 172.21.15.3:0/816381466 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b80adc30 0x7f23b806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- 172.21.15.3:0/816381466 >> 172.21.15.3:0/816381466 conn(0x7f23b80cc5d0 msgr2=0x7f23b80c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- 172.21.15.3:0/816381466 shutdown_connections 2023-10-08T16:08:40.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- 172.21.15.3:0/816381466 wait complete. 2023-10-08T16:08:40.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 Processor -- start 2023-10-08T16:08:40.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- start start 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80adc30 0x7f23b815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 0x7f23b80c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b814efd0 0x7f23b80c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.081+0000 7f23bd231700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b815efc0 con 0x7f23b80ca810 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23bd231700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80c5a50 con 0x7f23b80adc30 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23bd231700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b815e3b0 con 0x7f23b814efd0 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 0x7f23b80c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 0x7f23b80c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33506/0 (socket says 172.21.15.3:33506) 2023-10-08T16:08:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 -- 172.21.15.3:0/252010718 learned_addr learned my addr 172.21.15.3:0/252010718 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b759e700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b814efd0 0x7f23b80c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b6d9d700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80adc30 0x7f23b815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 -- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b814efd0 msgr2=0x7f23b80c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b814efd0 0x7f23b80c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 -- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80adc30 msgr2=0x7f23b815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80adc30 0x7f23b815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 -- 172.21.15.3:0/252010718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009420 con 0x7f23b80ca810 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23b659c700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 0x7f23b80c5510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23a800cc40 tx=0x7f23a8001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800a870 con 0x7f23b80ca810 2023-10-08T16:08:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800a9d0 con 0x7f23b80ca810 2023-10-08T16:08:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b815e690 con 0x7f23b80ca810 2023-10-08T16:08:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800ad70 con 0x7f23b80ca810 2023-10-08T16:08:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b815ec50 con 0x7f23b80ca810 2023-10-08T16:08:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.085+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b815f130 con 0x7f23b80ca810 2023-10-08T16:08:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.089+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f23a8007300 con 0x7f23b80ca810 2023-10-08T16:08:40.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.089+0000 7f23aeffd700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2398060550 0x7f2398062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.089+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23a807caf0 con 0x7f23b80ca810 2023-10-08T16:08:40.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.089+0000 7f23b6d9d700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2398060550 0x7f2398062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.089+0000 7f23b6d9d700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2398060550 0x7f2398062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c8180 tx=0x7f23a00091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.097+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f23a804d0e0 con 0x7f23b80ca810 2023-10-08T16:08:40.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.257+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23b804be40 con 0x7f2398060550 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.273+0000 7f23aeffd700 1 -- 172.21.15.3:0/252010718 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286964 (secure 0 0 0) 0x7f23b804be40 con 0x7f2398060550 2023-10-08T16:08:40.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:40.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2398060550 msgr2=0x7f2398062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2398060550 0x7f2398062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c8180 tx=0x7f23a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 msgr2=0x7f23b80c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 0x7f23b80c5510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23a800cc40 tx=0x7f23a8001a60 comp rx=0 tx=0).stop 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 shutdown_connections 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2398060550 0x7f2398062a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f23b814efd0 0x7f23b80c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b80ca810 0x7f23b80c5510 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 --2- 172.21.15.3:0/252010718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23b80adc30 0x7f23b815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 >> 172.21.15.3:0/252010718 conn(0x7f23b80cc5d0 msgr2=0x7f23b80c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 shutdown_connections 2023-10-08T16:08:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.281+0000 7f23bd231700 1 -- 172.21.15.3:0/252010718 wait complete. 2023-10-08T16:08:40.288 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:08:40.300 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-08T16:08:39.858203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387560,"kb_used_data":5160,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587160,"statfs":{"total":773094113280,"available":770649251840,"internally_reserved":0,"allocated":5283840,"data_stored":2794084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.371727"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546580+0000","last_change":"2023-10-08T16:08:36.537783+0000","last_active":"2023-10-08T16:08:36.546580+0000","last_peered":"2023-10-08T16:08:36.546580+0000","last_clean":"2023-10-08T16:08:36.546580+0000","last_became_active":"2023-10-08T16:08:36.537482+0000","last_became_peered":"2023-10-08T16:08:36.537482+0000","last_unstale":"2023-10-08T16:08:36.546580+0000","last_undegraded":"2023-10-08T16:08:36.546580+0000","last_fullsized":"2023-10-08T16:08:36.546580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:45.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560369+0000","last_change":"2023-10-08T16:08:36.560369+0000","last_active":"2023-10-08T16:08:36.560369+0000","last_peered":"2023-10-08T16:08:36.560369+0000","last_clean":"2023-10-08T16:08:36.560369+0000","last_became_active":"2023-10-08T16:08:36.560022+0000","last_became_peered":"2023-10-08T16:08:36.560022+0000","last_unstale":"2023-10-08T16:08:36.560369+0000","last_undegraded":"2023-10-08T16:08:36.560369+0000","last_fullsized":"2023-10-08T16:08:36.560369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:45.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544130+0000","last_change":"2023-10-08T16:08:36.536039+0000","last_active":"2023-10-08T16:08:36.544130+0000","last_peered":"2023-10-08T16:08:36.544130+0000","last_clean":"2023-10-08T16:08:36.544130+0000","last_became_active":"2023-10-08T16:08:36.535764+0000","last_became_peered":"2023-10-08T16:08:36.535764+0000","last_unstale":"2023-10-08T16:08:36.544130+0000","last_undegraded":"2023-10-08T16:08:36.544130+0000","last_fullsized":"2023-10-08T16:08:36.544130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558796+0000","last_change":"2023-10-08T16:08:36.558796+0000","last_active":"2023-10-08T16:08:36.558796+0000","last_peered":"2023-10-08T16:08:36.558796+0000","last_clean":"2023-10-08T16:08:36.558796+0000","last_became_active":"2023-10-08T16:08:36.557899+0000","last_became_peered":"2023-10-08T16:08:36.557899+0000","last_unstale":"2023-10-08T16:08:36.558796+0000","last_undegraded":"2023-10-08T16:08:36.558796+0000","last_fullsized":"2023-10-08T16:08:36.558796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.562121+0000","last_change":"2023-10-08T16:08:36.562121+0000","last_active":"2023-10-08T16:08:36.562121+0000","last_peered":"2023-10-08T16:08:36.562121+0000","last_clean":"2023-10-08T16:08:36.562121+0000","last_became_active":"2023-10-08T16:08:36.561724+0000","last_became_peered":"2023-10-08T16:08:36.561724+0000","last_unstale":"2023-10-08T16:08:36.562121+0000","last_undegraded":"2023-10-08T16:08:36.562121+0000","last_fullsized":"2023-10-08T16:08:36.562121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:22.313827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543247+0000","last_change":"2023-10-08T16:08:36.543247+0000","last_active":"2023-10-08T16:08:36.543247+0000","last_peered":"2023-10-08T16:08:36.543247+0000","last_clean":"2023-10-08T16:08:36.543247+0000","last_became_active":"2023-10-08T16:08:36.541062+0000","last_became_peered":"2023-10-08T16:08:36.541062+0000","last_unstale":"2023-10-08T16:08:36.543247+0000","last_undegraded":"2023-10-08T16:08:36.543247+0000","last_fullsized":"2023-10-08T16:08:36.543247+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:29.287579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547618+0000","last_change":"2023-10-08T16:08:36.544885+0000","last_active":"2023-10-08T16:08:36.547618+0000","last_peered":"2023-10-08T16:08:36.547618+0000","last_clean":"2023-10-08T16:08:36.547618+0000","last_became_active":"2023-10-08T16:08:36.544384+0000","last_became_peered":"2023-10-08T16:08:36.544384+0000","last_unstale":"2023-10-08T16:08:36.547618+0000","last_undegraded":"2023-10-08T16:08:36.547618+0000","last_fullsized":"2023-10-08T16:08:36.547618+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559729+0000","last_change":"2023-10-08T16:08:36.559729+0000","last_active":"2023-10-08T16:08:36.559729+0000","last_peered":"2023-10-08T16:08:36.559729+0000","last_clean":"2023-10-08T16:08:36.559729+0000","last_became_active":"2023-10-08T16:08:36.557800+0000","last_became_peered":"2023-10-08T16:08:36.557800+0000","last_unstale":"2023-10-08T16:08:36.559729+0000","last_undegraded":"2023-10-08T16:08:36.559729+0000","last_fullsized":"2023-10-08T16:08:36.559729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:21.220985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560576+0000","last_change":"2023-10-08T16:08:36.560576+0000","last_active":"2023-10-08T16:08:36.560576+0000","last_peered":"2023-10-08T16:08:36.560576+0000","last_clean":"2023-10-08T16:08:36.560576+0000","last_became_active":"2023-10-08T16:08:36.558641+0000","last_became_peered":"2023-10-08T16:08:36.558641+0000","last_unstale":"2023-10-08T16:08:36.560576+0000","last_undegraded":"2023-10-08T16:08:36.560576+0000","last_fullsized":"2023-10-08T16:08:36.560576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:12.498531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558528+0000","last_change":"2023-10-08T16:08:36.558528+0000","last_active":"2023-10-08T16:08:36.558528+0000","last_peered":"2023-10-08T16:08:36.558528+0000","last_clean":"2023-10-08T16:08:36.558528+0000","last_became_active":"2023-10-08T16:08:36.557743+0000","last_became_peered":"2023-10-08T16:08:36.557743+0000","last_unstale":"2023-10-08T16:08:36.558528+0000","last_undegraded":"2023-10-08T16:08:36.558528+0000","last_fullsized":"2023-10-08T16:08:36.558528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:34.609360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560769+0000","last_change":"2023-10-08T16:08:36.560769+0000","last_active":"2023-10-08T16:08:36.560769+0000","last_peered":"2023-10-08T16:08:36.560769+0000","last_clean":"2023-10-08T16:08:36.560769+0000","last_became_active":"2023-10-08T16:08:36.557582+0000","last_became_peered":"2023-10-08T16:08:36.557582+0000","last_unstale":"2023-10-08T16:08:36.560769+0000","last_undegraded":"2023-10-08T16:08:36.560769+0000","last_fullsized":"2023-10-08T16:08:36.560769+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:06.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541723+0000","last_change":"2023-10-08T16:08:36.541723+0000","last_active":"2023-10-08T16:08:36.541723+0000","last_peered":"2023-10-08T16:08:36.541723+0000","last_clean":"2023-10-08T16:08:36.541723+0000","last_became_active":"2023-10-08T16:08:36.541289+0000","last_became_peered":"2023-10-08T16:08:36.541289+0000","last_unstale":"2023-10-08T16:08:36.541723+0000","last_undegraded":"2023-10-08T16:08:36.541723+0000","last_fullsized":"2023-10-08T16:08:36.541723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551852+0000","last_change":"2023-10-08T16:08:36.543404+0000","last_active":"2023-10-08T16:08:36.551852+0000","last_peered":"2023-10-08T16:08:36.551852+0000","last_clean":"2023-10-08T16:08:36.551852+0000","last_became_active":"2023-10-08T16:08:36.543088+0000","last_became_peered":"2023-10-08T16:08:36.543088+0000","last_unstale":"2023-10-08T16:08:36.551852+0000","last_undegraded":"2023-10-08T16:08:36.551852+0000","last_fullsized":"2023-10-08T16:08:36.551852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:28.131177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560544+0000","last_change":"2023-10-08T16:08:36.560544+0000","last_active":"2023-10-08T16:08:36.560544+0000","last_peered":"2023-10-08T16:08:36.560544+0000","last_clean":"2023-10-08T16:08:36.560544+0000","last_became_active":"2023-10-08T16:08:36.559502+0000","last_became_peered":"2023-10-08T16:08:36.559502+0000","last_unstale":"2023-10-08T16:08:36.560544+0000","last_undegraded":"2023-10-08T16:08:36.560544+0000","last_fullsized":"2023-10-08T16:08:36.560544+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:38.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.548706+0000","last_change":"2023-10-08T16:08:36.548706+0000","last_active":"2023-10-08T16:08:36.548706+0000","last_peered":"2023-10-08T16:08:36.548706+0000","last_clean":"2023-10-08T16:08:36.548706+0000","last_became_active":"2023-10-08T16:08:36.548396+0000","last_became_peered":"2023-10-08T16:08:36.548396+0000","last_unstale":"2023-10-08T16:08:36.548706+0000","last_undegraded":"2023-10-08T16:08:36.548706+0000","last_fullsized":"2023-10-08T16:08:36.548706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:10:35.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564127+0000","last_change":"2023-10-08T16:08:36.560263+0000","last_active":"2023-10-08T16:08:36.564127+0000","last_peered":"2023-10-08T16:08:36.564127+0000","last_clean":"2023-10-08T16:08:36.564127+0000","last_became_active":"2023-10-08T16:08:36.559562+0000","last_became_peered":"2023-10-08T16:08:36.559562+0000","last_unstale":"2023-10-08T16:08:36.564127+0000","last_undegraded":"2023-10-08T16:08:36.564127+0000","last_fullsized":"2023-10-08T16:08:36.564127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:06.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545962+0000","last_change":"2023-10-08T16:08:36.540705+0000","last_active":"2023-10-08T16:08:36.545962+0000","last_peered":"2023-10-08T16:08:36.545962+0000","last_clean":"2023-10-08T16:08:36.545962+0000","last_became_active":"2023-10-08T16:08:36.540412+0000","last_became_peered":"2023-10-08T16:08:36.540412+0000","last_unstale":"2023-10-08T16:08:36.545962+0000","last_undegraded":"2023-10-08T16:08:36.545962+0000","last_fullsized":"2023-10-08T16:08:36.545962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:34.609360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564877+0000","last_change":"2023-10-08T16:08:36.561525+0000","last_active":"2023-10-08T16:08:36.564877+0000","last_peered":"2023-10-08T16:08:36.564877+0000","last_clean":"2023-10-08T16:08:36.564877+0000","last_became_active":"2023-10-08T16:08:36.561183+0000","last_became_peered":"2023-10-08T16:08:36.561183+0000","last_unstale":"2023-10-08T16:08:36.564877+0000","last_undegraded":"2023-10-08T16:08:36.564877+0000","last_fullsized":"2023-10-08T16:08:36.564877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559034+0000","last_change":"2023-10-08T16:08:36.557870+0000","last_active":"2023-10-08T16:08:36.559034+0000","last_peered":"2023-10-08T16:08:36.559034+0000","last_clean":"2023-10-08T16:08:36.559034+0000","last_became_active":"2023-10-08T16:08:36.557424+0000","last_became_peered":"2023-10-08T16:08:36.557424+0000","last_unstale":"2023-10-08T16:08:36.559034+0000","last_undegraded":"2023-10-08T16:08:36.559034+0000","last_fullsized":"2023-10-08T16:08:36.559034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:38.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.566761+0000","last_change":"2023-10-08T16:08:36.561425+0000","last_active":"2023-10-08T16:08:36.566761+0000","last_peered":"2023-10-08T16:08:36.566761+0000","last_clean":"2023-10-08T16:08:36.566761+0000","last_became_active":"2023-10-08T16:08:36.561176+0000","last_became_peered":"2023-10-08T16:08:36.561176+0000","last_unstale":"2023-10-08T16:08:36.566761+0000","last_undegraded":"2023-10-08T16:08:36.566761+0000","last_fullsized":"2023-10-08T16:08:36.566761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:24.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545304+0000","last_change":"2023-10-08T16:08:36.545304+0000","last_active":"2023-10-08T16:08:36.545304+0000","last_peered":"2023-10-08T16:08:36.545304+0000","last_clean":"2023-10-08T16:08:36.545304+0000","last_became_active":"2023-10-08T16:08:36.542670+0000","last_became_peered":"2023-10-08T16:08:36.542670+0000","last_unstale":"2023-10-08T16:08:36.545304+0000","last_undegraded":"2023-10-08T16:08:36.545304+0000","last_fullsized":"2023-10-08T16:08:36.545304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:52.518200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559310+0000","last_change":"2023-10-08T16:08:36.559310+0000","last_active":"2023-10-08T16:08:36.559310+0000","last_peered":"2023-10-08T16:08:36.559310+0000","last_clean":"2023-10-08T16:08:36.559310+0000","last_became_active":"2023-10-08T16:08:36.558942+0000","last_became_peered":"2023-10-08T16:08:36.558942+0000","last_unstale":"2023-10-08T16:08:36.559310+0000","last_undegraded":"2023-10-08T16:08:36.559310+0000","last_fullsized":"2023-10-08T16:08:36.559310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:24.175187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543105+0000","last_change":"2023-10-08T16:08:36.538289+0000","last_active":"2023-10-08T16:08:36.543105+0000","last_peered":"2023-10-08T16:08:36.543105+0000","last_clean":"2023-10-08T16:08:36.543105+0000","last_became_active":"2023-10-08T16:08:36.537624+0000","last_became_peered":"2023-10-08T16:08:36.537624+0000","last_unstale":"2023-10-08T16:08:36.543105+0000","last_undegraded":"2023-10-08T16:08:36.543105+0000","last_fullsized":"2023-10-08T16:08:36.543105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:50.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542923+0000","last_change":"2023-10-08T16:08:36.536157+0000","last_active":"2023-10-08T16:08:36.542923+0000","last_peered":"2023-10-08T16:08:36.542923+0000","last_clean":"2023-10-08T16:08:36.542923+0000","last_became_active":"2023-10-08T16:08:36.534874+0000","last_became_peered":"2023-10-08T16:08:36.534874+0000","last_unstale":"2023-10-08T16:08:36.542923+0000","last_undegraded":"2023-10-08T16:08:36.542923+0000","last_fullsized":"2023-10-08T16:08:36.542923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:44.701730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543075+0000","last_change":"2023-10-08T16:08:36.537921+0000","last_active":"2023-10-08T16:08:36.543075+0000","last_peered":"2023-10-08T16:08:36.543075+0000","last_clean":"2023-10-08T16:08:36.543075+0000","last_became_active":"2023-10-08T16:08:36.537569+0000","last_became_peered":"2023-10-08T16:08:36.537569+0000","last_unstale":"2023-10-08T16:08:36.543075+0000","last_undegraded":"2023-10-08T16:08:36.543075+0000","last_fullsized":"2023-10-08T16:08:36.543075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:57.098974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551876+0000","last_change":"2023-10-08T16:08:36.542986+0000","last_active":"2023-10-08T16:08:36.551876+0000","last_peered":"2023-10-08T16:08:36.551876+0000","last_clean":"2023-10-08T16:08:36.551876+0000","last_became_active":"2023-10-08T16:08:36.542676+0000","last_became_peered":"2023-10-08T16:08:36.542676+0000","last_unstale":"2023-10-08T16:08:36.551876+0000","last_undegraded":"2023-10-08T16:08:36.551876+0000","last_fullsized":"2023-10-08T16:08:36.551876+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:50.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545874+0000","last_change":"2023-10-08T16:08:36.538099+0000","last_active":"2023-10-08T16:08:36.545874+0000","last_peered":"2023-10-08T16:08:36.545874+0000","last_clean":"2023-10-08T16:08:36.545874+0000","last_became_active":"2023-10-08T16:08:36.537793+0000","last_became_peered":"2023-10-08T16:08:36.537793+0000","last_unstale":"2023-10-08T16:08:36.545874+0000","last_undegraded":"2023-10-08T16:08:36.545874+0000","last_fullsized":"2023-10-08T16:08:36.545874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:21.220985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541112+0000","last_change":"2023-10-08T16:08:36.541112+0000","last_active":"2023-10-08T16:08:36.541112+0000","last_peered":"2023-10-08T16:08:36.541112+0000","last_clean":"2023-10-08T16:08:36.541112+0000","last_became_active":"2023-10-08T16:08:36.540772+0000","last_became_peered":"2023-10-08T16:08:36.540772+0000","last_unstale":"2023-10-08T16:08:36.541112+0000","last_undegraded":"2023-10-08T16:08:36.541112+0000","last_fullsized":"2023-10-08T16:08:36.541112+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546235+0000","last_change":"2023-10-08T16:08:36.544270+0000","last_active":"2023-10-08T16:08:36.546235+0000","last_peered":"2023-10-08T16:08:36.546235+0000","last_clean":"2023-10-08T16:08:36.546235+0000","last_became_active":"2023-10-08T16:08:36.543763+0000","last_became_peered":"2023-10-08T16:08:36.543763+0000","last_unstale":"2023-10-08T16:08:36.546235+0000","last_undegraded":"2023-10-08T16:08:36.546235+0000","last_fullsized":"2023-10-08T16:08:36.546235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:00.058227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544097+0000","last_change":"2023-10-08T16:08:36.535436+0000","last_active":"2023-10-08T16:08:36.544097+0000","last_peered":"2023-10-08T16:08:36.544097+0000","last_clean":"2023-10-08T16:08:36.544097+0000","last_became_active":"2023-10-08T16:08:36.535099+0000","last_became_peered":"2023-10-08T16:08:36.535099+0000","last_unstale":"2023-10-08T16:08:36.544097+0000","last_undegraded":"2023-10-08T16:08:36.544097+0000","last_fullsized":"2023-10-08T16:08:36.544097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:20.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.549227+0000","last_change":"2023-10-08T16:08:36.549227+0000","last_active":"2023-10-08T16:08:36.549227+0000","last_peered":"2023-10-08T16:08:36.549227+0000","last_clean":"2023-10-08T16:08:36.549227+0000","last_became_active":"2023-10-08T16:08:36.548595+0000","last_became_peered":"2023-10-08T16:08:36.548595+0000","last_unstale":"2023-10-08T16:08:36.549227+0000","last_undegraded":"2023-10-08T16:08:36.549227+0000","last_fullsized":"2023-10-08T16:08:36.549227+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:30.876454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.536735+0000","last_change":"2023-10-08T16:08:36.532009+0000","last_active":"2023-10-08T16:08:36.536735+0000","last_peered":"2023-10-08T16:08:36.536735+0000","last_clean":"2023-10-08T16:08:36.536735+0000","last_became_active":"2023-10-08T16:08:36.531636+0000","last_became_peered":"2023-10-08T16:08:36.531636+0000","last_unstale":"2023-10-08T16:08:36.536735+0000","last_undegraded":"2023-10-08T16:08:36.536735+0000","last_fullsized":"2023-10-08T16:08:36.536735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:15.728719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544956+0000","last_change":"2023-10-08T16:08:36.544956+0000","last_active":"2023-10-08T16:08:36.544956+0000","last_peered":"2023-10-08T16:08:36.544956+0000","last_clean":"2023-10-08T16:08:36.544956+0000","last_became_active":"2023-10-08T16:08:36.544643+0000","last_became_peered":"2023-10-08T16:08:36.544643+0000","last_unstale":"2023-10-08T16:08:36.544956+0000","last_undegraded":"2023-10-08T16:08:36.544956+0000","last_fullsized":"2023-10-08T16:08:36.544956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555140+0000","last_change":"2023-10-08T16:08:35.521058+0000","last_active":"2023-10-08T16:08:36.555140+0000","last_peered":"2023-10-08T16:08:36.555140+0000","last_clean":"2023-10-08T16:08:36.555140+0000","last_became_active":"2023-10-08T16:08:35.520522+0000","last_became_peered":"2023-10-08T16:08:35.520522+0000","last_unstale":"2023-10-08T16:08:36.555140+0000","last_undegraded":"2023-10-08T16:08:36.555140+0000","last_fullsized":"2023-10-08T16:08:36.555140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:16.352648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542604+0000","last_change":"2023-10-08T16:08:36.532967+0000","last_active":"2023-10-08T16:08:36.542604+0000","last_peered":"2023-10-08T16:08:36.542604+0000","last_clean":"2023-10-08T16:08:36.542604+0000","last_became_active":"2023-10-08T16:08:36.532686+0000","last_became_peered":"2023-10-08T16:08:36.532686+0000","last_unstale":"2023-10-08T16:08:36.542604+0000","last_undegraded":"2023-10-08T16:08:36.542604+0000","last_fullsized":"2023-10-08T16:08:36.542604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.552904+0000","last_change":"2023-10-08T16:08:35.522115+0000","last_active":"2023-10-08T16:08:36.552904+0000","last_peered":"2023-10-08T16:08:36.552904+0000","last_clean":"2023-10-08T16:08:36.552904+0000","last_became_active":"2023-10-08T16:08:35.521247+0000","last_became_peered":"2023-10-08T16:08:35.521247+0000","last_unstale":"2023-10-08T16:08:36.552904+0000","last_undegraded":"2023-10-08T16:08:36.552904+0000","last_fullsized":"2023-10-08T16:08:36.552904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:59.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546763+0000","last_change":"2023-10-08T16:08:36.546763+0000","last_active":"2023-10-08T16:08:36.546763+0000","last_peered":"2023-10-08T16:08:36.546763+0000","last_clean":"2023-10-08T16:08:36.546763+0000","last_became_active":"2023-10-08T16:08:36.546434+0000","last_became_peered":"2023-10-08T16:08:36.546434+0000","last_unstale":"2023-10-08T16:08:36.546763+0000","last_undegraded":"2023-10-08T16:08:36.546763+0000","last_fullsized":"2023-10-08T16:08:36.546763+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:58.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554383+0000","last_change":"2023-10-08T16:08:35.510252+0000","last_active":"2023-10-08T16:08:36.554383+0000","last_peered":"2023-10-08T16:08:36.554383+0000","last_clean":"2023-10-08T16:08:36.554383+0000","last_became_active":"2023-10-08T16:08:35.509941+0000","last_became_peered":"2023-10-08T16:08:35.509941+0000","last_unstale":"2023-10-08T16:08:36.554383+0000","last_undegraded":"2023-10-08T16:08:36.554383+0000","last_fullsized":"2023-10-08T16:08:36.554383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:48.813733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544467+0000","last_change":"2023-10-08T16:08:36.544467+0000","last_active":"2023-10-08T16:08:36.544467+0000","last_peered":"2023-10-08T16:08:36.544467+0000","last_clean":"2023-10-08T16:08:36.544467+0000","last_became_active":"2023-10-08T16:08:36.543754+0000","last_became_peered":"2023-10-08T16:08:36.543754+0000","last_unstale":"2023-10-08T16:08:36.544467+0000","last_undegraded":"2023-10-08T16:08:36.544467+0000","last_fullsized":"2023-10-08T16:08:36.544467+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:35.943755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554241+0000","last_change":"2023-10-08T16:08:35.517941+0000","last_active":"2023-10-08T16:08:36.554241+0000","last_peered":"2023-10-08T16:08:36.554241+0000","last_clean":"2023-10-08T16:08:36.554241+0000","last_became_active":"2023-10-08T16:08:35.517589+0000","last_became_peered":"2023-10-08T16:08:35.517589+0000","last_unstale":"2023-10-08T16:08:36.554241+0000","last_undegraded":"2023-10-08T16:08:36.554241+0000","last_fullsized":"2023-10-08T16:08:36.554241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:34.933116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543955+0000","last_change":"2023-10-08T16:08:36.532692+0000","last_active":"2023-10-08T16:08:36.543955+0000","last_peered":"2023-10-08T16:08:36.543955+0000","last_clean":"2023-10-08T16:08:36.543955+0000","last_became_active":"2023-10-08T16:08:36.531966+0000","last_became_peered":"2023-10-08T16:08:36.531966+0000","last_unstale":"2023-10-08T16:08:36.543955+0000","last_undegraded":"2023-10-08T16:08:36.543955+0000","last_fullsized":"2023-10-08T16:08:36.543955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:59.729958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541585+0000","last_change":"2023-10-08T16:08:35.522582+0000","last_active":"2023-10-08T16:08:36.541585+0000","last_peered":"2023-10-08T16:08:36.541585+0000","last_clean":"2023-10-08T16:08:36.541585+0000","last_became_active":"2023-10-08T16:08:35.522072+0000","last_became_peered":"2023-10-08T16:08:35.522072+0000","last_unstale":"2023-10-08T16:08:36.541585+0000","last_undegraded":"2023-10-08T16:08:36.541585+0000","last_fullsized":"2023-10-08T16:08:36.541585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:21.303189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558525+0000","last_change":"2023-10-08T16:08:36.558525+0000","last_active":"2023-10-08T16:08:36.558525+0000","last_peered":"2023-10-08T16:08:36.558525+0000","last_clean":"2023-10-08T16:08:36.558525+0000","last_became_active":"2023-10-08T16:08:36.557564+0000","last_became_peered":"2023-10-08T16:08:36.557564+0000","last_unstale":"2023-10-08T16:08:36.558525+0000","last_undegraded":"2023-10-08T16:08:36.558525+0000","last_fullsized":"2023-10-08T16:08:36.558525+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.552715+0000","last_change":"2023-10-08T16:08:35.512854+0000","last_active":"2023-10-08T16:08:36.552715+0000","last_peered":"2023-10-08T16:08:36.552715+0000","last_clean":"2023-10-08T16:08:36.552715+0000","last_became_active":"2023-10-08T16:08:35.512528+0000","last_became_peered":"2023-10-08T16:08:35.512528+0000","last_unstale":"2023-10-08T16:08:36.552715+0000","last_undegraded":"2023-10-08T16:08:36.552715+0000","last_fullsized":"2023-10-08T16:08:36.552715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:48.813733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557503+0000","last_change":"2023-10-08T16:08:36.557503+0000","last_active":"2023-10-08T16:08:36.557503+0000","last_peered":"2023-10-08T16:08:36.557503+0000","last_clean":"2023-10-08T16:08:36.557503+0000","last_became_active":"2023-10-08T16:08:36.555665+0000","last_became_peered":"2023-10-08T16:08:36.555665+0000","last_unstale":"2023-10-08T16:08:36.557503+0000","last_undegraded":"2023-10-08T16:08:36.557503+0000","last_fullsized":"2023-10-08T16:08:36.557503+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:20.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.517191+0000","last_change":"2023-10-08T16:08:35.513155+0000","last_active":"2023-10-08T16:08:35.517191+0000","last_peered":"2023-10-08T16:08:35.517191+0000","last_clean":"2023-10-08T16:08:35.517191+0000","last_became_active":"2023-10-08T16:08:35.512832+0000","last_became_peered":"2023-10-08T16:08:35.512832+0000","last_unstale":"2023-10-08T16:08:35.517191+0000","last_undegraded":"2023-10-08T16:08:35.517191+0000","last_fullsized":"2023-10-08T16:08:35.517191+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:40.178100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543121+0000","last_change":"2023-10-08T16:08:36.538419+0000","last_active":"2023-10-08T16:08:36.543121+0000","last_peered":"2023-10-08T16:08:36.543121+0000","last_clean":"2023-10-08T16:08:36.543121+0000","last_became_active":"2023-10-08T16:08:36.538007+0000","last_became_peered":"2023-10-08T16:08:36.538007+0000","last_unstale":"2023-10-08T16:08:36.543121+0000","last_undegraded":"2023-10-08T16:08:36.543121+0000","last_fullsized":"2023-10-08T16:08:36.543121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:35.943755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.522936+0000","last_change":"2023-10-08T16:08:35.520294+0000","last_active":"2023-10-08T16:08:35.522936+0000","last_peered":"2023-10-08T16:08:35.522936+0000","last_clean":"2023-10-08T16:08:35.522936+0000","last_became_active":"2023-10-08T16:08:35.519878+0000","last_became_peered":"2023-10-08T16:08:35.519878+0000","last_unstale":"2023-10-08T16:08:35.522936+0000","last_undegraded":"2023-10-08T16:08:35.522936+0000","last_fullsized":"2023-10-08T16:08:35.522936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:39.424960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564856+0000","last_change":"2023-10-08T16:08:36.561366+0000","last_active":"2023-10-08T16:08:36.564856+0000","last_peered":"2023-10-08T16:08:36.564856+0000","last_clean":"2023-10-08T16:08:36.564856+0000","last_became_active":"2023-10-08T16:08:36.560765+0000","last_became_peered":"2023-10-08T16:08:36.560765+0000","last_unstale":"2023-10-08T16:08:36.564856+0000","last_undegraded":"2023-10-08T16:08:36.564856+0000","last_fullsized":"2023-10-08T16:08:36.564856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.528174+0000","last_change":"2023-10-08T16:08:35.515126+0000","last_active":"2023-10-08T16:08:36.528174+0000","last_peered":"2023-10-08T16:08:36.528174+0000","last_clean":"2023-10-08T16:08:36.528174+0000","last_became_active":"2023-10-08T16:08:35.514743+0000","last_became_peered":"2023-10-08T16:08:35.514743+0000","last_unstale":"2023-10-08T16:08:36.528174+0000","last_undegraded":"2023-10-08T16:08:36.528174+0000","last_fullsized":"2023-10-08T16:08:36.528174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:58.720511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546675+0000","last_change":"2023-10-08T16:08:36.540043+0000","last_active":"2023-10-08T16:08:36.546675+0000","last_peered":"2023-10-08T16:08:36.546675+0000","last_clean":"2023-10-08T16:08:36.546675+0000","last_became_active":"2023-10-08T16:08:36.539758+0000","last_became_peered":"2023-10-08T16:08:36.539758+0000","last_unstale":"2023-10-08T16:08:36.546675+0000","last_undegraded":"2023-10-08T16:08:36.546675+0000","last_fullsized":"2023-10-08T16:08:36.546675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.521847+0000","last_change":"2023-10-08T16:08:35.517701+0000","last_active":"2023-10-08T16:08:35.521847+0000","last_peered":"2023-10-08T16:08:35.521847+0000","last_clean":"2023-10-08T16:08:35.521847+0000","last_became_active":"2023-10-08T16:08:35.517413+0000","last_became_peered":"2023-10-08T16:08:35.517413+0000","last_unstale":"2023-10-08T16:08:35.521847+0000","last_undegraded":"2023-10-08T16:08:35.521847+0000","last_fullsized":"2023-10-08T16:08:35.521847+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:23.956918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542337+0000","last_change":"2023-10-08T16:08:36.542337+0000","last_active":"2023-10-08T16:08:36.542337+0000","last_peered":"2023-10-08T16:08:36.542337+0000","last_clean":"2023-10-08T16:08:36.542337+0000","last_became_active":"2023-10-08T16:08:36.541961+0000","last_became_peered":"2023-10-08T16:08:36.541961+0000","last_unstale":"2023-10-08T16:08:36.542337+0000","last_undegraded":"2023-10-08T16:08:36.542337+0000","last_fullsized":"2023-10-08T16:08:36.542337+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:17.977708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553971+0000","last_change":"2023-10-08T16:08:35.522105+0000","last_active":"2023-10-08T16:08:36.553971+0000","last_peered":"2023-10-08T16:08:36.553971+0000","last_clean":"2023-10-08T16:08:36.553971+0000","last_became_active":"2023-10-08T16:08:35.521762+0000","last_became_peered":"2023-10-08T16:08:35.521762+0000","last_unstale":"2023-10-08T16:08:36.553971+0000","last_undegraded":"2023-10-08T16:08:36.553971+0000","last_fullsized":"2023-10-08T16:08:36.553971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:56.088335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547778+0000","last_change":"2023-10-08T16:08:36.545190+0000","last_active":"2023-10-08T16:08:36.547778+0000","last_peered":"2023-10-08T16:08:36.547778+0000","last_clean":"2023-10-08T16:08:36.547778+0000","last_became_active":"2023-10-08T16:08:36.543666+0000","last_became_peered":"2023-10-08T16:08:36.543666+0000","last_unstale":"2023-10-08T16:08:36.547778+0000","last_undegraded":"2023-10-08T16:08:36.547778+0000","last_fullsized":"2023-10-08T16:08:36.547778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.563771+0000","last_change":"2023-10-08T16:08:35.516486+0000","last_active":"2023-10-08T16:08:36.563771+0000","last_peered":"2023-10-08T16:08:36.563771+0000","last_clean":"2023-10-08T16:08:36.563771+0000","last_became_active":"2023-10-08T16:08:35.516109+0000","last_became_peered":"2023-10-08T16:08:35.516109+0000","last_unstale":"2023-10-08T16:08:36.563771+0000","last_undegraded":"2023-10-08T16:08:36.563771+0000","last_fullsized":"2023-10-08T16:08:36.563771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:24.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564142+0000","last_change":"2023-10-08T16:08:36.559963+0000","last_active":"2023-10-08T16:08:36.564142+0000","last_peered":"2023-10-08T16:08:36.564142+0000","last_clean":"2023-10-08T16:08:36.564142+0000","last_became_active":"2023-10-08T16:08:36.559511+0000","last_became_peered":"2023-10-08T16:08:36.559511+0000","last_unstale":"2023-10-08T16:08:36.564142+0000","last_undegraded":"2023-10-08T16:08:36.564142+0000","last_fullsized":"2023-10-08T16:08:36.564142+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:49.824371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.562594+0000","last_change":"2023-10-08T16:08:35.523780+0000","last_active":"2023-10-08T16:08:36.562594+0000","last_peered":"2023-10-08T16:08:36.562594+0000","last_clean":"2023-10-08T16:08:36.562594+0000","last_became_active":"2023-10-08T16:08:35.523585+0000","last_became_peered":"2023-10-08T16:08:35.523585+0000","last_unstale":"2023-10-08T16:08:36.562594+0000","last_undegraded":"2023-10-08T16:08:36.562594+0000","last_fullsized":"2023-10-08T16:08:36.562594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:44.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557893+0000","last_change":"2023-10-08T16:08:36.557893+0000","last_active":"2023-10-08T16:08:36.557893+0000","last_peered":"2023-10-08T16:08:36.557893+0000","last_clean":"2023-10-08T16:08:36.557893+0000","last_became_active":"2023-10-08T16:08:36.557458+0000","last_became_peered":"2023-10-08T16:08:36.557458+0000","last_unstale":"2023-10-08T16:08:36.557893+0000","last_undegraded":"2023-10-08T16:08:36.557893+0000","last_fullsized":"2023-10-08T16:08:36.557893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530051+0000","last_change":"2023-10-08T16:08:35.516225+0000","last_active":"2023-10-08T16:08:36.530051+0000","last_peered":"2023-10-08T16:08:36.530051+0000","last_clean":"2023-10-08T16:08:36.530051+0000","last_became_active":"2023-10-08T16:08:35.515923+0000","last_became_peered":"2023-10-08T16:08:35.515923+0000","last_unstale":"2023-10-08T16:08:36.530051+0000","last_undegraded":"2023-10-08T16:08:36.530051+0000","last_fullsized":"2023-10-08T16:08:36.530051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:13.398969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542022+0000","last_change":"2023-10-08T16:08:36.542022+0000","last_active":"2023-10-08T16:08:36.542022+0000","last_peered":"2023-10-08T16:08:36.542022+0000","last_clean":"2023-10-08T16:08:36.542022+0000","last_became_active":"2023-10-08T16:08:36.541615+0000","last_became_peered":"2023-10-08T16:08:36.541615+0000","last_unstale":"2023-10-08T16:08:36.542022+0000","last_undegraded":"2023-10-08T16:08:36.542022+0000","last_fullsized":"2023-10-08T16:08:36.542022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:57.935809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.525235+0000","last_change":"2023-10-08T16:08:35.522655+0000","last_active":"2023-10-08T16:08:35.525235+0000","last_peered":"2023-10-08T16:08:35.525235+0000","last_clean":"2023-10-08T16:08:35.525235+0000","last_became_active":"2023-10-08T16:08:35.522318+0000","last_became_peered":"2023-10-08T16:08:35.522318+0000","last_unstale":"2023-10-08T16:08:35.525235+0000","last_undegraded":"2023-10-08T16:08:35.525235+0000","last_fullsized":"2023-10-08T16:08:35.525235+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:20.308296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547604+0000","last_change":"2023-10-08T16:08:36.544673+0000","last_active":"2023-10-08T16:08:36.547604+0000","last_peered":"2023-10-08T16:08:36.547604+0000","last_clean":"2023-10-08T16:08:36.547604+0000","last_became_active":"2023-10-08T16:08:36.543264+0000","last_became_peered":"2023-10-08T16:08:36.543264+0000","last_unstale":"2023-10-08T16:08:36.547604+0000","last_undegraded":"2023-10-08T16:08:36.547604+0000","last_fullsized":"2023-10-08T16:08:36.547604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.561264+0000","last_change":"2023-10-08T16:08:35.519968+0000","last_active":"2023-10-08T16:08:36.561264+0000","last_peered":"2023-10-08T16:08:36.561264+0000","last_clean":"2023-10-08T16:08:36.561264+0000","last_became_active":"2023-10-08T16:08:35.519455+0000","last_became_peered":"2023-10-08T16:08:35.519455+0000","last_unstale":"2023-10-08T16:08:36.561264+0000","last_undegraded":"2023-10-08T16:08:36.561264+0000","last_fullsized":"2023-10-08T16:08:36.561264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:27.120538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551853+0000","last_change":"2023-10-08T16:08:36.539068+0000","last_active":"2023-10-08T16:08:36.551853+0000","last_peered":"2023-10-08T16:08:36.551853+0000","last_clean":"2023-10-08T16:08:36.551853+0000","last_became_active":"2023-10-08T16:08:36.538585+0000","last_became_peered":"2023-10-08T16:08:36.538585+0000","last_unstale":"2023-10-08T16:08:36.551853+0000","last_undegraded":"2023-10-08T16:08:36.551853+0000","last_fullsized":"2023-10-08T16:08:36.551853+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:30.743086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554023+0000","last_change":"2023-10-08T16:08:35.519081+0000","last_active":"2023-10-08T16:08:36.554023+0000","last_peered":"2023-10-08T16:08:36.554023+0000","last_clean":"2023-10-08T16:08:36.554023+0000","last_became_active":"2023-10-08T16:08:35.518676+0000","last_became_peered":"2023-10-08T16:08:35.518676+0000","last_unstale":"2023-10-08T16:08:36.554023+0000","last_undegraded":"2023-10-08T16:08:36.554023+0000","last_fullsized":"2023-10-08T16:08:36.554023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:13.319179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558694+0000","last_change":"2023-10-08T16:08:36.558694+0000","last_active":"2023-10-08T16:08:36.558694+0000","last_peered":"2023-10-08T16:08:36.558694+0000","last_clean":"2023-10-08T16:08:36.558694+0000","last_became_active":"2023-10-08T16:08:36.557406+0000","last_became_peered":"2023-10-08T16:08:36.557406+0000","last_unstale":"2023-10-08T16:08:36.558694+0000","last_undegraded":"2023-10-08T16:08:36.558694+0000","last_fullsized":"2023-10-08T16:08:36.558694+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555576+0000","last_change":"2023-10-08T16:08:35.513768+0000","last_active":"2023-10-08T16:08:36.555576+0000","last_peered":"2023-10-08T16:08:36.555576+0000","last_clean":"2023-10-08T16:08:36.555576+0000","last_became_active":"2023-10-08T16:08:35.513267+0000","last_became_peered":"2023-10-08T16:08:35.513267+0000","last_unstale":"2023-10-08T16:08:36.555576+0000","last_undegraded":"2023-10-08T16:08:36.555576+0000","last_fullsized":"2023-10-08T16:08:36.555576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:43.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547104+0000","last_change":"2023-10-08T16:08:36.544806+0000","last_active":"2023-10-08T16:08:36.547104+0000","last_peered":"2023-10-08T16:08:36.547104+0000","last_clean":"2023-10-08T16:08:36.547104+0000","last_became_active":"2023-10-08T16:08:36.544479+0000","last_became_peered":"2023-10-08T16:08:36.544479+0000","last_unstale":"2023-10-08T16:08:36.547104+0000","last_undegraded":"2023-10-08T16:08:36.547104+0000","last_fullsized":"2023-10-08T16:08:36.547104+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:24.175187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.531976+0000","last_change":"2023-10-08T16:08:35.510082+0000","last_active":"2023-10-08T16:08:36.531976+0000","last_peered":"2023-10-08T16:08:36.531976+0000","last_clean":"2023-10-08T16:08:36.531976+0000","last_became_active":"2023-10-08T16:08:35.509737+0000","last_became_peered":"2023-10-08T16:08:35.509737+0000","last_unstale":"2023-10-08T16:08:36.531976+0000","last_undegraded":"2023-10-08T16:08:36.531976+0000","last_fullsized":"2023-10-08T16:08:36.531976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:23.164548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546381+0000","last_change":"2023-10-08T16:08:36.544079+0000","last_active":"2023-10-08T16:08:36.546381+0000","last_peered":"2023-10-08T16:08:36.546381+0000","last_clean":"2023-10-08T16:08:36.546381+0000","last_became_active":"2023-10-08T16:08:36.543716+0000","last_became_peered":"2023-10-08T16:08:36.543716+0000","last_unstale":"2023-10-08T16:08:36.546381+0000","last_undegraded":"2023-10-08T16:08:36.546381+0000","last_fullsized":"2023-10-08T16:08:36.546381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:14.409607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.525098+0000","last_change":"2023-10-08T16:08:35.520720+0000","last_active":"2023-10-08T16:08:35.525098+0000","last_peered":"2023-10-08T16:08:35.525098+0000","last_clean":"2023-10-08T16:08:35.525098+0000","last_became_active":"2023-10-08T16:08:35.520373+0000","last_became_peered":"2023-10-08T16:08:35.520373+0000","last_unstale":"2023-10-08T16:08:35.525098+0000","last_undegraded":"2023-10-08T16:08:35.525098+0000","last_fullsized":"2023-10-08T16:08:35.525098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:28.856770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541391+0000","last_change":"2023-10-08T16:08:36.541391+0000","last_active":"2023-10-08T16:08:36.541391+0000","last_peered":"2023-10-08T16:08:36.541391+0000","last_clean":"2023-10-08T16:08:36.541391+0000","last_became_active":"2023-10-08T16:08:36.541053+0000","last_became_peered":"2023-10-08T16:08:36.541053+0000","last_unstale":"2023-10-08T16:08:36.541391+0000","last_undegraded":"2023-10-08T16:08:36.541391+0000","last_fullsized":"2023-10-08T16:08:36.541391+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:09.801025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558637+0000","last_change":"2023-10-08T16:08:35.522365+0000","last_active":"2023-10-08T16:08:36.558637+0000","last_peered":"2023-10-08T16:08:36.558637+0000","last_clean":"2023-10-08T16:08:36.558637+0000","last_became_active":"2023-10-08T16:08:35.521727+0000","last_became_peered":"2023-10-08T16:08:35.521727+0000","last_unstale":"2023-10-08T16:08:36.558637+0000","last_undegraded":"2023-10-08T16:08:36.558637+0000","last_fullsized":"2023-10-08T16:08:36.558637+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:31.609141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.536639+0000","last_change":"2023-10-08T16:08:36.536639+0000","last_active":"2023-10-08T16:08:36.536639+0000","last_peered":"2023-10-08T16:08:36.536639+0000","last_clean":"2023-10-08T16:08:36.536639+0000","last_became_active":"2023-10-08T16:08:36.536276+0000","last_became_peered":"2023-10-08T16:08:36.536276+0000","last_unstale":"2023-10-08T16:08:36.536639+0000","last_undegraded":"2023-10-08T16:08:36.536639+0000","last_fullsized":"2023-10-08T16:08:36.536639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:50.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.518556+0000","last_change":"2023-10-08T16:08:35.514659+0000","last_active":"2023-10-08T16:08:35.518556+0000","last_peered":"2023-10-08T16:08:35.518556+0000","last_clean":"2023-10-08T16:08:35.518556+0000","last_became_active":"2023-10-08T16:08:35.514144+0000","last_became_peered":"2023-10-08T16:08:35.514144+0000","last_unstale":"2023-10-08T16:08:35.518556+0000","last_undegraded":"2023-10-08T16:08:35.518556+0000","last_fullsized":"2023-10-08T16:08:35.518556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:49.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551624+0000","last_change":"2023-10-08T16:08:36.536849+0000","last_active":"2023-10-08T16:08:36.551624+0000","last_peered":"2023-10-08T16:08:36.551624+0000","last_clean":"2023-10-08T16:08:36.551624+0000","last_became_active":"2023-10-08T16:08:36.536445+0000","last_became_peered":"2023-10-08T16:08:36.536445+0000","last_unstale":"2023-10-08T16:08:36.551624+0000","last_undegraded":"2023-10-08T16:08:36.551624+0000","last_fullsized":"2023-10-08T16:08:36.551624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:42.144819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.522355+0000","last_change":"2023-10-08T16:08:35.519542+0000","last_active":"2023-10-08T16:08:35.522355+0000","last_peered":"2023-10-08T16:08:35.522355+0000","last_clean":"2023-10-08T16:08:35.522355+0000","last_became_active":"2023-10-08T16:08:35.519265+0000","last_became_peered":"2023-10-08T16:08:35.519265+0000","last_unstale":"2023-10-08T16:08:35.522355+0000","last_undegraded":"2023-10-08T16:08:35.522355+0000","last_fullsized":"2023-10-08T16:08:35.522355+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:14.718080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559389+0000","last_change":"2023-10-08T16:08:36.559389+0000","last_active":"2023-10-08T16:08:36.559389+0000","last_peered":"2023-10-08T16:08:36.559389+0000","last_clean":"2023-10-08T16:08:36.559389+0000","last_became_active":"2023-10-08T16:08:36.555801+0000","last_became_peered":"2023-10-08T16:08:36.555801+0000","last_unstale":"2023-10-08T16:08:36.559389+0000","last_undegraded":"2023-10-08T16:08:36.559389+0000","last_fullsized":"2023-10-08T16:08:36.559389+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:59.729958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529797+0000","last_change":"2023-10-08T16:08:35.518241+0000","last_active":"2023-10-08T16:08:36.529797+0000","last_peered":"2023-10-08T16:08:36.529797+0000","last_clean":"2023-10-08T16:08:36.529797+0000","last_became_active":"2023-10-08T16:08:35.517833+0000","last_became_peered":"2023-10-08T16:08:35.517833+0000","last_unstale":"2023-10-08T16:08:36.529797+0000","last_undegraded":"2023-10-08T16:08:36.529797+0000","last_fullsized":"2023-10-08T16:08:36.529797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:49.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564108+0000","last_change":"2023-10-08T16:08:36.559842+0000","last_active":"2023-10-08T16:08:36.564108+0000","last_peered":"2023-10-08T16:08:36.564108+0000","last_clean":"2023-10-08T16:08:36.564108+0000","last_became_active":"2023-10-08T16:08:36.559449+0000","last_became_peered":"2023-10-08T16:08:36.559449+0000","last_unstale":"2023-10-08T16:08:36.564108+0000","last_undegraded":"2023-10-08T16:08:36.564108+0000","last_fullsized":"2023-10-08T16:08:36.564108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:59.731149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.525205+0000","last_change":"2023-10-08T16:08:35.522506+0000","last_active":"2023-10-08T16:08:35.525205+0000","last_peered":"2023-10-08T16:08:35.525205+0000","last_clean":"2023-10-08T16:08:35.525205+0000","last_became_active":"2023-10-08T16:08:35.522155+0000","last_became_peered":"2023-10-08T16:08:35.522155+0000","last_unstale":"2023-10-08T16:08:35.525205+0000","last_undegraded":"2023-10-08T16:08:35.525205+0000","last_fullsized":"2023-10-08T16:08:35.525205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:57.717725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558910+0000","last_change":"2023-10-08T16:08:36.558910+0000","last_active":"2023-10-08T16:08:36.558910+0000","last_peered":"2023-10-08T16:08:36.558910+0000","last_clean":"2023-10-08T16:08:36.558910+0000","last_became_active":"2023-10-08T16:08:36.557485+0000","last_became_peered":"2023-10-08T16:08:36.557485+0000","last_unstale":"2023-10-08T16:08:36.558910+0000","last_undegraded":"2023-10-08T16:08:36.558910+0000","last_fullsized":"2023-10-08T16:08:36.558910+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.531556+0000","last_change":"2023-10-08T16:08:35.521984+0000","last_active":"2023-10-08T16:08:36.531556+0000","last_peered":"2023-10-08T16:08:36.531556+0000","last_clean":"2023-10-08T16:08:36.531556+0000","last_became_active":"2023-10-08T16:08:35.521663+0000","last_became_peered":"2023-10-08T16:08:35.521663+0000","last_unstale":"2023-10-08T16:08:36.531556+0000","last_undegraded":"2023-10-08T16:08:36.531556+0000","last_fullsized":"2023-10-08T16:08:36.531556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:59.047588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546705+0000","last_change":"2023-10-08T16:08:36.540944+0000","last_active":"2023-10-08T16:08:36.546705+0000","last_peered":"2023-10-08T16:08:36.546705+0000","last_clean":"2023-10-08T16:08:36.546705+0000","last_became_active":"2023-10-08T16:08:36.539103+0000","last_became_peered":"2023-10-08T16:08:36.539103+0000","last_unstale":"2023-10-08T16:08:36.546705+0000","last_undegraded":"2023-10-08T16:08:36.546705+0000","last_fullsized":"2023-10-08T16:08:36.546705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.516027+0000","last_change":"2023-10-08T16:08:35.509970+0000","last_active":"2023-10-08T16:08:35.516027+0000","last_peered":"2023-10-08T16:08:35.516027+0000","last_clean":"2023-10-08T16:08:35.516027+0000","last_became_active":"2023-10-08T16:08:35.509612+0000","last_became_peered":"2023-10-08T16:08:35.509612+0000","last_unstale":"2023-10-08T16:08:35.516027+0000","last_undegraded":"2023-10-08T16:08:35.516027+0000","last_fullsized":"2023-10-08T16:08:35.516027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:58.720511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545032+0000","last_change":"2023-10-08T16:08:36.545032+0000","last_active":"2023-10-08T16:08:36.545032+0000","last_peered":"2023-10-08T16:08:36.545032+0000","last_clean":"2023-10-08T16:08:36.545032+0000","last_became_active":"2023-10-08T16:08:36.542687+0000","last_became_peered":"2023-10-08T16:08:36.542687+0000","last_unstale":"2023-10-08T16:08:36.545032+0000","last_undegraded":"2023-10-08T16:08:36.545032+0000","last_fullsized":"2023-10-08T16:08:36.545032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:15.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530314+0000","last_change":"2023-10-08T16:08:35.518326+0000","last_active":"2023-10-08T16:08:36.530314+0000","last_peered":"2023-10-08T16:08:36.530314+0000","last_clean":"2023-10-08T16:08:36.530314+0000","last_became_active":"2023-10-08T16:08:35.517934+0000","last_became_peered":"2023-10-08T16:08:35.517934+0000","last_unstale":"2023-10-08T16:08:36.530314+0000","last_undegraded":"2023-10-08T16:08:36.530314+0000","last_fullsized":"2023-10-08T16:08:36.530314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:37.275172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553155+0000","last_change":"2023-10-08T16:08:36.553155+0000","last_active":"2023-10-08T16:08:36.553155+0000","last_peered":"2023-10-08T16:08:36.553155+0000","last_clean":"2023-10-08T16:08:36.553155+0000","last_became_active":"2023-10-08T16:08:36.552800+0000","last_became_peered":"2023-10-08T16:08:36.552800+0000","last_unstale":"2023-10-08T16:08:36.553155+0000","last_undegraded":"2023-10-08T16:08:36.553155+0000","last_fullsized":"2023-10-08T16:08:36.553155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:42.781613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.526829+0000","last_change":"2023-10-08T16:08:35.524120+0000","last_active":"2023-10-08T16:08:36.526829+0000","last_peered":"2023-10-08T16:08:36.526829+0000","last_clean":"2023-10-08T16:08:36.526829+0000","last_became_active":"2023-10-08T16:08:35.523720+0000","last_became_peered":"2023-10-08T16:08:35.523720+0000","last_unstale":"2023-10-08T16:08:36.526829+0000","last_undegraded":"2023-10-08T16:08:36.526829+0000","last_fullsized":"2023-10-08T16:08:36.526829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:05.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.538177+0000","last_change":"2023-10-08T16:08:36.538177+0000","last_active":"2023-10-08T16:08:36.538177+0000","last_peered":"2023-10-08T16:08:36.538177+0000","last_clean":"2023-10-08T16:08:36.538177+0000","last_became_active":"2023-10-08T16:08:36.537883+0000","last_became_peered":"2023-10-08T16:08:36.537883+0000","last_unstale":"2023-10-08T16:08:36.538177+0000","last_undegraded":"2023-10-08T16:08:36.538177+0000","last_fullsized":"2023-10-08T16:08:36.538177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.521717+0000","last_change":"2023-10-08T16:08:35.518176+0000","last_active":"2023-10-08T16:08:35.521717+0000","last_peered":"2023-10-08T16:08:35.521717+0000","last_clean":"2023-10-08T16:08:35.521717+0000","last_became_active":"2023-10-08T16:08:35.517664+0000","last_became_peered":"2023-10-08T16:08:35.517664+0000","last_unstale":"2023-10-08T16:08:35.521717+0000","last_undegraded":"2023-10-08T16:08:35.521717+0000","last_fullsized":"2023-10-08T16:08:35.521717+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:05.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555489+0000","last_change":"2023-10-08T16:08:36.551479+0000","last_active":"2023-10-08T16:08:36.555489+0000","last_peered":"2023-10-08T16:08:36.555489+0000","last_clean":"2023-10-08T16:08:36.555489+0000","last_became_active":"2023-10-08T16:08:36.551148+0000","last_became_peered":"2023-10-08T16:08:36.551148+0000","last_unstale":"2023-10-08T16:08:36.555489+0000","last_undegraded":"2023-10-08T16:08:36.555489+0000","last_fullsized":"2023-10-08T16:08:36.555489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.524952+0000","last_change":"2023-10-08T16:08:35.522819+0000","last_active":"2023-10-08T16:08:35.524952+0000","last_peered":"2023-10-08T16:08:35.524952+0000","last_clean":"2023-10-08T16:08:35.524952+0000","last_became_active":"2023-10-08T16:08:35.522486+0000","last_became_peered":"2023-10-08T16:08:35.522486+0000","last_unstale":"2023-10-08T16:08:35.524952+0000","last_undegraded":"2023-10-08T16:08:35.524952+0000","last_fullsized":"2023-10-08T16:08:35.524952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:49.985736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557866+0000","last_change":"2023-10-08T16:08:36.557866+0000","last_active":"2023-10-08T16:08:36.557866+0000","last_peered":"2023-10-08T16:08:36.557866+0000","last_clean":"2023-10-08T16:08:36.557866+0000","last_became_active":"2023-10-08T16:08:36.557264+0000","last_became_peered":"2023-10-08T16:08:36.557264+0000","last_unstale":"2023-10-08T16:08:36.557866+0000","last_undegraded":"2023-10-08T16:08:36.557866+0000","last_fullsized":"2023-10-08T16:08:36.557866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554658+0000","last_change":"2023-10-08T16:08:35.520787+0000","last_active":"2023-10-08T16:08:36.554658+0000","last_peered":"2023-10-08T16:08:36.554658+0000","last_clean":"2023-10-08T16:08:36.554658+0000","last_became_active":"2023-10-08T16:08:35.520356+0000","last_became_peered":"2023-10-08T16:08:35.520356+0000","last_unstale":"2023-10-08T16:08:36.554658+0000","last_undegraded":"2023-10-08T16:08:36.554658+0000","last_fullsized":"2023-10-08T16:08:36.554658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:34.933116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529767+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:08:36.529767+0000","last_peered":"2023-10-08T16:08:36.529767+0000","last_clean":"2023-10-08T16:08:36.529767+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:08:36.529767+0000","last_undegraded":"2023-10-08T16:08:36.529767+0000","last_fullsized":"2023-10-08T16:08:36.529767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":791550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.242,"5min":1.343,"15min":1.343},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2450000000000001,"5min":1.429,"15min":1.429},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.70999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.304}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.71899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1399999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.242},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.014,"15min":1.02},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.258,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.365}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.998,"15min":1.008},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2949999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1399999999999999,"15min":1.149},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.24,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.161}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0860000000000001,"15min":1.107},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.163,"5min":1.492,"15min":1.492},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.1100000000000001,"15min":1.129},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.702,"15min":1.702},"last":1.115}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.171,"15min":1.1830000000000001},"min":{"1min":0.68100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.355,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.016}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2330000000000001,"15min":1.2450000000000001},"min":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.429,"5min":1.75,"15min":1.75},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1899999999999999,"15min":1.206},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.401,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.329}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297788,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074052,"statfs":{"total":96636764160,"available":96331829248,"internally_reserved":0,"allocated":512000,"data_stored":201736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.99199999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.147,"5min":1.548,"15min":1.548},"last":1.006},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.012,"15min":1.0169999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.254,"5min":1.353,"15min":1.353},"last":1.254}]},{"osd":1,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.339,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.014,"15min":1.004},"min":{"1min":0.69599999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.472,"15min":1.472},"last":1.1499999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.97199999999999998,"15min":0.96699999999999997},"min":{"1min":0.73699999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2130000000000001,"5min":1.431,"15min":1.431},"last":1.056},{"interface":"front","average":{"1min":1.133,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.429,"5min":2.286,"15min":2.286},"last":1.1859999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.097,"15min":1.111},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2989999999999999,"5min":1.552,"15min":1.552},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.03,"5min":1.0229999999999999,"15min":1.022},"min":{"1min":0.77300000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.212}]},{"osd":4,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.127,"15min":1.137},"min":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.347,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":1.119},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.246,"15min":1.2490000000000001},"min":{"1min":0.90400000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5389999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1339999999999999,"15min":1.1319999999999999},"min":{"1min":0.751,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4219999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.3180000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.5409999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.3109999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.397,"15min":1.409},"min":{"1min":0.84399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.554,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.339},{"interface":"front","average":{"1min":1.331,"5min":1.3049999999999999,"15min":1.3009999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.591,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.288}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":201162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.302,"5min":1.377,"15min":1.377},"last":0.871},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.228,"15min":1.228},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.22,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3700000000000001,"5min":1.734,"15min":1.734},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96299999999999997},"min":{"1min":0.754,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.206,"5min":1.972,"15min":1.972},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.032,"15min":1.048},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.21,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.077,"15min":1.077},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4710000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.012,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.749,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3460000000000001,"5min":2.141,"15min":2.141},"last":1.032}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.018,"15min":1.038},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.139,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.89000000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7589999999999999,"5min":2.101,"15min":2.101},"last":1.012}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.401,"5min":2.383,"15min":2.383},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.224,"15min":1.248},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.3540000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9299999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.387,"15min":1.405},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4770000000000001,"5min":2.605,"15min":2.605},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":202628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":0.95999999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.03,"15min":1.0469999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.157}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.099,"15min":1.125},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.157,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.872}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1240000000000001,"15min":1.1479999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.113,"15min":1.127},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.284,"5min":1.607,"15min":1.607},"last":1.107}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.194,"15min":1.226},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.216,"15min":1.2430000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3340000000000001,"5min":1.702,"15min":1.702},"last":1.1830000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.157,"15min":1.1859999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.3640000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.177,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":2.347,"15min":2.347},"last":1.2450000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4810000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3600000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3680000000000001,"5min":1.95,"15min":1.95},"last":1.218}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":201702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77100000000000002,"15min":0.76500000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.27,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.103,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.61299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.92900000000000005},"min":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1120000000000001,"5min":1.403,"15min":1.403},"last":0.85999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.03,"15min":1.024},"min":{"1min":0.79800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5680000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6659999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.76500000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.54,"15min":1.54},"last":1.246},{"interface":"front","average":{"1min":1.135,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.268}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.85099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5049999999999999,"5min":1.575,"15min":1.575},"last":1.079},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.248},"min":{"1min":0.95999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5529999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.01}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2310000000000001,"15min":1.2270000000000001},"min":{"1min":0.94599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.113},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2549999999999999,"15min":1.262},"min":{"1min":0.97399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6180000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":202650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.69399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88500000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.44400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.034,"5min":1.556,"15min":1.556},"last":0.95699999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.504,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1719999999999999,"5min":1.21,"15min":1.21},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.48699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.006,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.085,"5min":1.272,"15min":1.272},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.67600000000000005,"5min":0.378,"15min":0.378},"max":{"1min":1.3640000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.3640000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.018,"15min":1.014},"min":{"1min":0.624,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3799999999999999,"5min":1.456,"15min":1.456},"last":1.093},{"interface":"front","average":{"1min":1.073,"5min":1.0629999999999999,"15min":1.0609999999999999},"min":{"1min":0.79700000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.72999999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.514,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.038},{"interface":"front","average":{"1min":1.202,"5min":1.1910000000000001,"15min":1.1890000000000001},"min":{"1min":0.86299999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.464,"5min":1.792,"15min":1.792},"last":1.2450000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1599999999999999,"15min":1.159},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.518,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.80800000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3400000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.1879999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.69599999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.89300000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.419,"5min":1.534,"15min":1.534},"last":1.3140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":201162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.49299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90700000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.755,"15min":0.74399999999999999},"min":{"1min":0.65900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":1.004,"15min":1.004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.83699999999999997,"15min":0.83199999999999996},"min":{"1min":0.59199999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0569999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.1399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.69399999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83099999999999996,"15min":0.81699999999999995},"min":{"1min":0.58099999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.21,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.095}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.97699999999999998,"15min":0.97299999999999998},"min":{"1min":0.79700000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.3999999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.012}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.008},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4119999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.117,"15min":1.117},"min":{"1min":0.91900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3580000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.252}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.548,"5min":1.768,"15min":1.768},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.84599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.169}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1659999999999999,"15min":1.1719999999999999},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.339,"5min":1.625,"15min":1.625},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.248,"15min":1.2529999999999999},"min":{"1min":1.022,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6379999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.45}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":791494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.54300000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.109,"5min":1.3,"15min":1.3},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.266,"15min":1.266},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.244,"15min":1.244},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.96699999999999997,"15min":0.96199999999999997},"min":{"1min":0.70299999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3740000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.79400000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0509999999999999,"15min":1.0389999999999999},"min":{"1min":0.78100000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.875}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.1299999999999999},"min":{"1min":0.76600000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.667,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.1990000000000001},"min":{"1min":0.95699999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.897,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.1559999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.875,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.228},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2450000000000001,"15min":1.234},"min":{"1min":0.94999999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.0109999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.238,"15min":1.234},"min":{"1min":0.97999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.115},{"interface":"front","average":{"1min":1.23,"5min":1.2,"15min":1.1950000000000001},"min":{"1min":1.0209999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.74,"5min":2.008,"15min":2.008},"last":1.323}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:08:40.435 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:08:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.541+0000 7f97deef1700 1 Processor -- start 2023-10-08T16:08:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.541+0000 7f97deef1700 1 -- start start 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f97d80b0fb0 0x7f97d8068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f97d80687c0 0x7f97d806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d806d1c0 con 0x7f97d81552c0 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80b01f0 con 0x7f97d80687c0 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d8068be0 con 0x7f97d80b0fb0 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f97d80687c0 0x7f97d806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97d7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f97d80b0fb0 0x7f97d8068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f97d80687c0 0x7f97d806d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33522/0 (socket says 172.21.15.3:33522) 2023-10-08T16:08:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dcc8d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f97d81552c0 0x7f97d80af170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:39568/0 (socket says 172.21.15.3:39568) 2023-10-08T16:08:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 -- 172.21.15.3:0/1624028571 learned_addr learned my addr 172.21.15.3:0/1624028571 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 -- 172.21.15.3:0/1624028571 >> v2:172.21.15.27:3300/0 conn(0x7f97d80b0fb0 msgr2=0x7f97d8068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 --2- 172.21.15.3:0/1624028571 >> v2:172.21.15.27:3300/0 conn(0x7f97d80b0fb0 0x7f97d8068280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 -- 172.21.15.3:0/1624028571 >> v1:172.21.15.27:6789/0 conn(0x7f97d81552c0 legacy=0x7f97d80af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97d77fe700 1 -- 172.21.15.3:0/1624028571 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290127529 0 0) 0x7f97d806d1c0 con 0x7f97d81552c0 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 -- 172.21.15.3:0/1624028571 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80af950 con 0x7f97d80687c0 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97dd48e700 1 --2- 172.21.15.3:0/1624028571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d806d650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f97d8069f50 tx=0x7f97c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b69616a1974910 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97d77fe700 1 -- 172.21.15.3:0/1624028571 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8009e70 con 0x7f97d80687c0 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97d77fe700 1 -- 172.21.15.3:0/1624028571 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c800b860 con 0x7f97d80687c0 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97d77fe700 1 -- 172.21.15.3:0/1624028571 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c800bc00 con 0x7f97d80687c0 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- 172.21.15.3:0/1624028571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 msgr2=0x7f97d806d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 --2- 172.21.15.3:0/1624028571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d806d650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f97d8069f50 tx=0x7f97c8009250 comp rx=0 tx=0).stop 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- 172.21.15.3:0/1624028571 shutdown_connections 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 --2- 172.21.15.3:0/1624028571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d806d650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 --2- 172.21.15.3:0/1624028571 >> v2:172.21.15.27:3300/0 conn(0x7f97d80b0fb0 0x7f97d8068280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- 172.21.15.3:0/1624028571 >> 172.21.15.3:0/1624028571 conn(0x7f97d806ade0 msgr2=0x7f97d806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- 172.21.15.3:0/1624028571 shutdown_connections 2023-10-08T16:08:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.545+0000 7f97deef1700 1 -- 172.21.15.3:0/1624028571 wait complete. 2023-10-08T16:08:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 Processor -- start 2023-10-08T16:08:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 -- start start 2023-10-08T16:08:40.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d8153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97d80b0fb0 0x7f97d8169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97d81552c0 0x7f97d80c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c3f10 con 0x7f97d80687c0 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c3020 con 0x7f97d80b0fb0 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97deef1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c3300 con 0x7f97d81552c0 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.549+0000 7f97dcc8d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d8153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d8153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33528/0 (socket says 172.21.15.3:33528) 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 -- 172.21.15.3:0/810843511 learned_addr learned my addr 172.21.15.3:0/810843511 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97d7fff700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97d80b0fb0 0x7f97d8169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dd48e700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97d81552c0 0x7f97d80c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 -- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97d81552c0 msgr2=0x7f97d80c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97d81552c0 0x7f97d80c1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 -- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97d80b0fb0 msgr2=0x7f97d8169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97d80b0fb0 0x7f97d8169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 -- 172.21.15.3:0/810843511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c80094f0 con 0x7f97d80687c0 2023-10-08T16:08:40.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dd48e700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97d81552c0 0x7f97d80c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:40.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97dcc8d700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d8153ab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f97d000cd30 tx=0x7f97d0001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000ce90 con 0x7f97d80687c0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0005df0 con 0x7f97d80687c0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000abb0 con 0x7f97d80687c0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d80c35e0 con 0x7f97d80687c0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d80c3ba0 con 0x7f97d80687c0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d804be40 con 0x7f97d80687c0 2023-10-08T16:08:40.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.553+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f97d00070f0 con 0x7f97d80687c0 2023-10-08T16:08:40.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.557+0000 7f97d4ff9700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97b8060550 0x7f97b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.557+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97d007c970 con 0x7f97d80687c0 2023-10-08T16:08:40.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.557+0000 7f97d7fff700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97b8060550 0x7f97b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.557+0000 7f97d7fff700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97b8060550 0x7f97b8062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97d816c8c0 tx=0x7f97c00091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.561+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97d004cf40 con 0x7f97d80687c0 2023-10-08T16:08:40.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.785+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f97d80afc30 con 0x7f97d80687c0 2023-10-08T16:08:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97d4ff9700 1 -- 172.21.15.3:0/810843511 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f97d0050560 con 0x7f97d80687c0 2023-10-08T16:08:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":145,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781187,"num_in_osds":8,"osd_in_since":1696781177,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2444861440,"bytes_avail":770649251840,"bytes_total":773094113280,"write_bytes_sec":2478,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":18,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5406}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-08T16:08:21.853539+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97b8060550 msgr2=0x7f97b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97b8060550 0x7f97b8062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97d816c8c0 tx=0x7f97c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 msgr2=0x7f97d8153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d8153ab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f97d000cd30 tx=0x7f97d0001af0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 shutdown_connections 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f97b8060550 0x7f97b8062a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f97d81552c0 0x7f97d80c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97d80b0fb0 0x7f97d8169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 --2- 172.21.15.3:0/810843511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97d80687c0 0x7f97d8153ab0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 >> 172.21.15.3:0/810843511 conn(0x7f97d806ade0 msgr2=0x7f97d80abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:40.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 shutdown_connections 2023-10-08T16:08:40.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.789+0000 7f97deef1700 1 -- 172.21.15.3:0/810843511 wait complete. 2023-10-08T16:08:40.843 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:08:40.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:08:40.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 Processor -- start 2023-10-08T16:08:40.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 -- start start 2023-10-08T16:08:40.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe98155ba0 0x7fbe980af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe980ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980c8fd0 con 0x7fbe98155f70 2023-10-08T16:08:40.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe980c83c0 con 0x7fbe98155ba0 2023-10-08T16:08:40.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9d4f1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c86a0 con 0x7fbe980afd60 2023-10-08T16:08:40.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe97fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe98155ba0 0x7fbe980af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe9ccf0700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe980ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe977fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbe98155f70 0x7fbe980c79a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:39572/0 (socket says 172.21.15.3:39572) 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe977fe700 1 -- 172.21.15.3:0/1096790538 learned_addr learned my addr 172.21.15.3:0/1096790538 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe97fff700 1 -- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 msgr2=0x7fbe980ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe97fff700 1 --2- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe980ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe97fff700 1 -- 172.21.15.3:0/1096790538 >> v1:172.21.15.27:6789/0 conn(0x7fbe98155f70 legacy=0x7fbe980c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe97fff700 1 -- 172.21.15.3:0/1096790538 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980c8980 con 0x7fbe98155ba0 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe96ffd700 1 -- 172.21.15.3:0/1096790538 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514925621 0 0) 0x7fbe980c8fd0 con 0x7fbe98155f70 2023-10-08T16:08:40.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe97fff700 1 --2- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe980af820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0098e0 tx=0x7fbe8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec003345524f26ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe96ffd700 1 -- 172.21.15.3:0/1096790538 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00b640 con 0x7fbe98155ba0 2023-10-08T16:08:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe96ffd700 1 -- 172.21.15.3:0/1096790538 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00b7a0 con 0x7fbe98155ba0 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.949+0000 7fbe96ffd700 1 -- 172.21.15.3:0/1096790538 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00bb40 con 0x7fbe98155ba0 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 msgr2=0x7fbe980af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe980af820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0098e0 tx=0x7fbe8c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1096790538 shutdown_connections 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe980ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1096790538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe980af820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1096790538 >> 172.21.15.3:0/1096790538 conn(0x7fbe9806b6b0 msgr2=0x7fbe9806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1096790538 shutdown_connections 2023-10-08T16:08:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1096790538 wait complete. 2023-10-08T16:08:40.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 Processor -- start 2023-10-08T16:08:40.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.953+0000 7fbe9d4f1700 1 -- start start 2023-10-08T16:08:40.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe98147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe9806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 0x7fbe9806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c5380 con 0x7fbe980c4290 2023-10-08T16:08:40.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98147960 con 0x7fbe98155ba0 2023-10-08T16:08:40.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98159830 con 0x7fbe980afd60 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 0x7fbe9806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe97fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe98147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe977fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe9806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 0x7fbe9806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33538/0 (socket says 172.21.15.3:33538) 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 -- 172.21.15.3:0/1147390409 learned_addr learned my addr 172.21.15.3:0/1147390409 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 -- 172.21.15.3:0/1147390409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 msgr2=0x7fbe98147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe98147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 -- 172.21.15.3:0/1147390409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 msgr2=0x7fbe9806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe9806d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:40.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 -- 172.21.15.3:0/1147390409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c009420 con 0x7fbe980c4290 2023-10-08T16:08:40.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9ccf0700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 0x7fbe9806d690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e8d0 tx=0x7fbe880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88013680 con 0x7fbe980c4290 2023-10-08T16:08:40.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880137e0 con 0x7fbe980c4290 2023-10-08T16:08:40.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe980c4770 con 0x7fbe980c4290 2023-10-08T16:08:40.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88013ba0 con 0x7fbe980c4290 2023-10-08T16:08:40.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.957+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe980c4d30 con 0x7fbe980c4290 2023-10-08T16:08:40.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.961+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe980c54f0 con 0x7fbe980c4290 2023-10-08T16:08:40.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.961+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbe880123d0 con 0x7fbe980c4290 2023-10-08T16:08:40.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.961+0000 7fbe7ffff700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbe84060550 0x7fbe84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:40.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.961+0000 7fbe97fff700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbe84060550 0x7fbe84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:40.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.961+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe8807c900 con 0x7fbe980c4290 2023-10-08T16:08:40.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.965+0000 7fbe97fff700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbe84060550 0x7fbe84062a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0093f0 tx=0x7fbe8c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:40.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:40.973+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe8804cef0 con 0x7fbe980c4290 2023-10-08T16:08:41.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.129+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe9804be40 con 0x7fbe84060550 2023-10-08T16:08:41.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.137+0000 7fbe7ffff700 1 -- 172.21.15.3:0/1147390409 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286964 (secure 0 0 0) 0x7fbe9804be40 con 0x7fbe84060550 2023-10-08T16:08:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbe84060550 msgr2=0x7fbe84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbe84060550 0x7fbe84062a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0093f0 tx=0x7fbe8c017000 comp rx=0 tx=0).stop 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 msgr2=0x7fbe9806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 0x7fbe9806d690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e8d0 tx=0x7fbe880091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 shutdown_connections 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbe84060550 0x7fbe84062a00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe980c4290 0x7fbe9806d690 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe98155ba0 0x7fbe9806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 --2- 172.21.15.3:0/1147390409 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbe980afd60 0x7fbe98147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 >> 172.21.15.3:0/1147390409 conn(0x7fbe9806b6b0 msgr2=0x7fbe980b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:41.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 shutdown_connections 2023-10-08T16:08:41.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:41.145+0000 7fbe9d4f1700 1 -- 172.21.15.3:0/1147390409 wait complete. 2023-10-08T16:08:41.151 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:08:41.161 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-08T16:08:39.858203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387560,"kb_used_data":5160,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587160,"statfs":{"total":773094113280,"available":770649251840,"internally_reserved":0,"allocated":5283840,"data_stored":2794084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.371727"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546580+0000","last_change":"2023-10-08T16:08:36.537783+0000","last_active":"2023-10-08T16:08:36.546580+0000","last_peered":"2023-10-08T16:08:36.546580+0000","last_clean":"2023-10-08T16:08:36.546580+0000","last_became_active":"2023-10-08T16:08:36.537482+0000","last_became_peered":"2023-10-08T16:08:36.537482+0000","last_unstale":"2023-10-08T16:08:36.546580+0000","last_undegraded":"2023-10-08T16:08:36.546580+0000","last_fullsized":"2023-10-08T16:08:36.546580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:45.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560369+0000","last_change":"2023-10-08T16:08:36.560369+0000","last_active":"2023-10-08T16:08:36.560369+0000","last_peered":"2023-10-08T16:08:36.560369+0000","last_clean":"2023-10-08T16:08:36.560369+0000","last_became_active":"2023-10-08T16:08:36.560022+0000","last_became_peered":"2023-10-08T16:08:36.560022+0000","last_unstale":"2023-10-08T16:08:36.560369+0000","last_undegraded":"2023-10-08T16:08:36.560369+0000","last_fullsized":"2023-10-08T16:08:36.560369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:45.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544130+0000","last_change":"2023-10-08T16:08:36.536039+0000","last_active":"2023-10-08T16:08:36.544130+0000","last_peered":"2023-10-08T16:08:36.544130+0000","last_clean":"2023-10-08T16:08:36.544130+0000","last_became_active":"2023-10-08T16:08:36.535764+0000","last_became_peered":"2023-10-08T16:08:36.535764+0000","last_unstale":"2023-10-08T16:08:36.544130+0000","last_undegraded":"2023-10-08T16:08:36.544130+0000","last_fullsized":"2023-10-08T16:08:36.544130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558796+0000","last_change":"2023-10-08T16:08:36.558796+0000","last_active":"2023-10-08T16:08:36.558796+0000","last_peered":"2023-10-08T16:08:36.558796+0000","last_clean":"2023-10-08T16:08:36.558796+0000","last_became_active":"2023-10-08T16:08:36.557899+0000","last_became_peered":"2023-10-08T16:08:36.557899+0000","last_unstale":"2023-10-08T16:08:36.558796+0000","last_undegraded":"2023-10-08T16:08:36.558796+0000","last_fullsized":"2023-10-08T16:08:36.558796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.562121+0000","last_change":"2023-10-08T16:08:36.562121+0000","last_active":"2023-10-08T16:08:36.562121+0000","last_peered":"2023-10-08T16:08:36.562121+0000","last_clean":"2023-10-08T16:08:36.562121+0000","last_became_active":"2023-10-08T16:08:36.561724+0000","last_became_peered":"2023-10-08T16:08:36.561724+0000","last_unstale":"2023-10-08T16:08:36.562121+0000","last_undegraded":"2023-10-08T16:08:36.562121+0000","last_fullsized":"2023-10-08T16:08:36.562121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:22.313827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543247+0000","last_change":"2023-10-08T16:08:36.543247+0000","last_active":"2023-10-08T16:08:36.543247+0000","last_peered":"2023-10-08T16:08:36.543247+0000","last_clean":"2023-10-08T16:08:36.543247+0000","last_became_active":"2023-10-08T16:08:36.541062+0000","last_became_peered":"2023-10-08T16:08:36.541062+0000","last_unstale":"2023-10-08T16:08:36.543247+0000","last_undegraded":"2023-10-08T16:08:36.543247+0000","last_fullsized":"2023-10-08T16:08:36.543247+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:29.287579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547618+0000","last_change":"2023-10-08T16:08:36.544885+0000","last_active":"2023-10-08T16:08:36.547618+0000","last_peered":"2023-10-08T16:08:36.547618+0000","last_clean":"2023-10-08T16:08:36.547618+0000","last_became_active":"2023-10-08T16:08:36.544384+0000","last_became_peered":"2023-10-08T16:08:36.544384+0000","last_unstale":"2023-10-08T16:08:36.547618+0000","last_undegraded":"2023-10-08T16:08:36.547618+0000","last_fullsized":"2023-10-08T16:08:36.547618+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559729+0000","last_change":"2023-10-08T16:08:36.559729+0000","last_active":"2023-10-08T16:08:36.559729+0000","last_peered":"2023-10-08T16:08:36.559729+0000","last_clean":"2023-10-08T16:08:36.559729+0000","last_became_active":"2023-10-08T16:08:36.557800+0000","last_became_peered":"2023-10-08T16:08:36.557800+0000","last_unstale":"2023-10-08T16:08:36.559729+0000","last_undegraded":"2023-10-08T16:08:36.559729+0000","last_fullsized":"2023-10-08T16:08:36.559729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:21.220985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560576+0000","last_change":"2023-10-08T16:08:36.560576+0000","last_active":"2023-10-08T16:08:36.560576+0000","last_peered":"2023-10-08T16:08:36.560576+0000","last_clean":"2023-10-08T16:08:36.560576+0000","last_became_active":"2023-10-08T16:08:36.558641+0000","last_became_peered":"2023-10-08T16:08:36.558641+0000","last_unstale":"2023-10-08T16:08:36.560576+0000","last_undegraded":"2023-10-08T16:08:36.560576+0000","last_fullsized":"2023-10-08T16:08:36.560576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:12.498531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558528+0000","last_change":"2023-10-08T16:08:36.558528+0000","last_active":"2023-10-08T16:08:36.558528+0000","last_peered":"2023-10-08T16:08:36.558528+0000","last_clean":"2023-10-08T16:08:36.558528+0000","last_became_active":"2023-10-08T16:08:36.557743+0000","last_became_peered":"2023-10-08T16:08:36.557743+0000","last_unstale":"2023-10-08T16:08:36.558528+0000","last_undegraded":"2023-10-08T16:08:36.558528+0000","last_fullsized":"2023-10-08T16:08:36.558528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:34.609360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560769+0000","last_change":"2023-10-08T16:08:36.560769+0000","last_active":"2023-10-08T16:08:36.560769+0000","last_peered":"2023-10-08T16:08:36.560769+0000","last_clean":"2023-10-08T16:08:36.560769+0000","last_became_active":"2023-10-08T16:08:36.557582+0000","last_became_peered":"2023-10-08T16:08:36.557582+0000","last_unstale":"2023-10-08T16:08:36.560769+0000","last_undegraded":"2023-10-08T16:08:36.560769+0000","last_fullsized":"2023-10-08T16:08:36.560769+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:06.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541723+0000","last_change":"2023-10-08T16:08:36.541723+0000","last_active":"2023-10-08T16:08:36.541723+0000","last_peered":"2023-10-08T16:08:36.541723+0000","last_clean":"2023-10-08T16:08:36.541723+0000","last_became_active":"2023-10-08T16:08:36.541289+0000","last_became_peered":"2023-10-08T16:08:36.541289+0000","last_unstale":"2023-10-08T16:08:36.541723+0000","last_undegraded":"2023-10-08T16:08:36.541723+0000","last_fullsized":"2023-10-08T16:08:36.541723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551852+0000","last_change":"2023-10-08T16:08:36.543404+0000","last_active":"2023-10-08T16:08:36.551852+0000","last_peered":"2023-10-08T16:08:36.551852+0000","last_clean":"2023-10-08T16:08:36.551852+0000","last_became_active":"2023-10-08T16:08:36.543088+0000","last_became_peered":"2023-10-08T16:08:36.543088+0000","last_unstale":"2023-10-08T16:08:36.551852+0000","last_undegraded":"2023-10-08T16:08:36.551852+0000","last_fullsized":"2023-10-08T16:08:36.551852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:28.131177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.560544+0000","last_change":"2023-10-08T16:08:36.560544+0000","last_active":"2023-10-08T16:08:36.560544+0000","last_peered":"2023-10-08T16:08:36.560544+0000","last_clean":"2023-10-08T16:08:36.560544+0000","last_became_active":"2023-10-08T16:08:36.559502+0000","last_became_peered":"2023-10-08T16:08:36.559502+0000","last_unstale":"2023-10-08T16:08:36.560544+0000","last_undegraded":"2023-10-08T16:08:36.560544+0000","last_fullsized":"2023-10-08T16:08:36.560544+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:38.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.548706+0000","last_change":"2023-10-08T16:08:36.548706+0000","last_active":"2023-10-08T16:08:36.548706+0000","last_peered":"2023-10-08T16:08:36.548706+0000","last_clean":"2023-10-08T16:08:36.548706+0000","last_became_active":"2023-10-08T16:08:36.548396+0000","last_became_peered":"2023-10-08T16:08:36.548396+0000","last_unstale":"2023-10-08T16:08:36.548706+0000","last_undegraded":"2023-10-08T16:08:36.548706+0000","last_fullsized":"2023-10-08T16:08:36.548706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:10:35.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564127+0000","last_change":"2023-10-08T16:08:36.560263+0000","last_active":"2023-10-08T16:08:36.564127+0000","last_peered":"2023-10-08T16:08:36.564127+0000","last_clean":"2023-10-08T16:08:36.564127+0000","last_became_active":"2023-10-08T16:08:36.559562+0000","last_became_peered":"2023-10-08T16:08:36.559562+0000","last_unstale":"2023-10-08T16:08:36.564127+0000","last_undegraded":"2023-10-08T16:08:36.564127+0000","last_fullsized":"2023-10-08T16:08:36.564127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:06.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545962+0000","last_change":"2023-10-08T16:08:36.540705+0000","last_active":"2023-10-08T16:08:36.545962+0000","last_peered":"2023-10-08T16:08:36.545962+0000","last_clean":"2023-10-08T16:08:36.545962+0000","last_became_active":"2023-10-08T16:08:36.540412+0000","last_became_peered":"2023-10-08T16:08:36.540412+0000","last_unstale":"2023-10-08T16:08:36.545962+0000","last_undegraded":"2023-10-08T16:08:36.545962+0000","last_fullsized":"2023-10-08T16:08:36.545962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:34.609360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564877+0000","last_change":"2023-10-08T16:08:36.561525+0000","last_active":"2023-10-08T16:08:36.564877+0000","last_peered":"2023-10-08T16:08:36.564877+0000","last_clean":"2023-10-08T16:08:36.564877+0000","last_became_active":"2023-10-08T16:08:36.561183+0000","last_became_peered":"2023-10-08T16:08:36.561183+0000","last_unstale":"2023-10-08T16:08:36.564877+0000","last_undegraded":"2023-10-08T16:08:36.564877+0000","last_fullsized":"2023-10-08T16:08:36.564877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559034+0000","last_change":"2023-10-08T16:08:36.557870+0000","last_active":"2023-10-08T16:08:36.559034+0000","last_peered":"2023-10-08T16:08:36.559034+0000","last_clean":"2023-10-08T16:08:36.559034+0000","last_became_active":"2023-10-08T16:08:36.557424+0000","last_became_peered":"2023-10-08T16:08:36.557424+0000","last_unstale":"2023-10-08T16:08:36.559034+0000","last_undegraded":"2023-10-08T16:08:36.559034+0000","last_fullsized":"2023-10-08T16:08:36.559034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:38.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.566761+0000","last_change":"2023-10-08T16:08:36.561425+0000","last_active":"2023-10-08T16:08:36.566761+0000","last_peered":"2023-10-08T16:08:36.566761+0000","last_clean":"2023-10-08T16:08:36.566761+0000","last_became_active":"2023-10-08T16:08:36.561176+0000","last_became_peered":"2023-10-08T16:08:36.561176+0000","last_unstale":"2023-10-08T16:08:36.566761+0000","last_undegraded":"2023-10-08T16:08:36.566761+0000","last_fullsized":"2023-10-08T16:08:36.566761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:24.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545304+0000","last_change":"2023-10-08T16:08:36.545304+0000","last_active":"2023-10-08T16:08:36.545304+0000","last_peered":"2023-10-08T16:08:36.545304+0000","last_clean":"2023-10-08T16:08:36.545304+0000","last_became_active":"2023-10-08T16:08:36.542670+0000","last_became_peered":"2023-10-08T16:08:36.542670+0000","last_unstale":"2023-10-08T16:08:36.545304+0000","last_undegraded":"2023-10-08T16:08:36.545304+0000","last_fullsized":"2023-10-08T16:08:36.545304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:52.518200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559310+0000","last_change":"2023-10-08T16:08:36.559310+0000","last_active":"2023-10-08T16:08:36.559310+0000","last_peered":"2023-10-08T16:08:36.559310+0000","last_clean":"2023-10-08T16:08:36.559310+0000","last_became_active":"2023-10-08T16:08:36.558942+0000","last_became_peered":"2023-10-08T16:08:36.558942+0000","last_unstale":"2023-10-08T16:08:36.559310+0000","last_undegraded":"2023-10-08T16:08:36.559310+0000","last_fullsized":"2023-10-08T16:08:36.559310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:24.175187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543105+0000","last_change":"2023-10-08T16:08:36.538289+0000","last_active":"2023-10-08T16:08:36.543105+0000","last_peered":"2023-10-08T16:08:36.543105+0000","last_clean":"2023-10-08T16:08:36.543105+0000","last_became_active":"2023-10-08T16:08:36.537624+0000","last_became_peered":"2023-10-08T16:08:36.537624+0000","last_unstale":"2023-10-08T16:08:36.543105+0000","last_undegraded":"2023-10-08T16:08:36.543105+0000","last_fullsized":"2023-10-08T16:08:36.543105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:50.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542923+0000","last_change":"2023-10-08T16:08:36.536157+0000","last_active":"2023-10-08T16:08:36.542923+0000","last_peered":"2023-10-08T16:08:36.542923+0000","last_clean":"2023-10-08T16:08:36.542923+0000","last_became_active":"2023-10-08T16:08:36.534874+0000","last_became_peered":"2023-10-08T16:08:36.534874+0000","last_unstale":"2023-10-08T16:08:36.542923+0000","last_undegraded":"2023-10-08T16:08:36.542923+0000","last_fullsized":"2023-10-08T16:08:36.542923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:44.701730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543075+0000","last_change":"2023-10-08T16:08:36.537921+0000","last_active":"2023-10-08T16:08:36.543075+0000","last_peered":"2023-10-08T16:08:36.543075+0000","last_clean":"2023-10-08T16:08:36.543075+0000","last_became_active":"2023-10-08T16:08:36.537569+0000","last_became_peered":"2023-10-08T16:08:36.537569+0000","last_unstale":"2023-10-08T16:08:36.543075+0000","last_undegraded":"2023-10-08T16:08:36.543075+0000","last_fullsized":"2023-10-08T16:08:36.543075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:57.098974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551876+0000","last_change":"2023-10-08T16:08:36.542986+0000","last_active":"2023-10-08T16:08:36.551876+0000","last_peered":"2023-10-08T16:08:36.551876+0000","last_clean":"2023-10-08T16:08:36.551876+0000","last_became_active":"2023-10-08T16:08:36.542676+0000","last_became_peered":"2023-10-08T16:08:36.542676+0000","last_unstale":"2023-10-08T16:08:36.551876+0000","last_undegraded":"2023-10-08T16:08:36.551876+0000","last_fullsized":"2023-10-08T16:08:36.551876+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:50.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545874+0000","last_change":"2023-10-08T16:08:36.538099+0000","last_active":"2023-10-08T16:08:36.545874+0000","last_peered":"2023-10-08T16:08:36.545874+0000","last_clean":"2023-10-08T16:08:36.545874+0000","last_became_active":"2023-10-08T16:08:36.537793+0000","last_became_peered":"2023-10-08T16:08:36.537793+0000","last_unstale":"2023-10-08T16:08:36.545874+0000","last_undegraded":"2023-10-08T16:08:36.545874+0000","last_fullsized":"2023-10-08T16:08:36.545874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:21.220985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541112+0000","last_change":"2023-10-08T16:08:36.541112+0000","last_active":"2023-10-08T16:08:36.541112+0000","last_peered":"2023-10-08T16:08:36.541112+0000","last_clean":"2023-10-08T16:08:36.541112+0000","last_became_active":"2023-10-08T16:08:36.540772+0000","last_became_peered":"2023-10-08T16:08:36.540772+0000","last_unstale":"2023-10-08T16:08:36.541112+0000","last_undegraded":"2023-10-08T16:08:36.541112+0000","last_fullsized":"2023-10-08T16:08:36.541112+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546235+0000","last_change":"2023-10-08T16:08:36.544270+0000","last_active":"2023-10-08T16:08:36.546235+0000","last_peered":"2023-10-08T16:08:36.546235+0000","last_clean":"2023-10-08T16:08:36.546235+0000","last_became_active":"2023-10-08T16:08:36.543763+0000","last_became_peered":"2023-10-08T16:08:36.543763+0000","last_unstale":"2023-10-08T16:08:36.546235+0000","last_undegraded":"2023-10-08T16:08:36.546235+0000","last_fullsized":"2023-10-08T16:08:36.546235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:00.058227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544097+0000","last_change":"2023-10-08T16:08:36.535436+0000","last_active":"2023-10-08T16:08:36.544097+0000","last_peered":"2023-10-08T16:08:36.544097+0000","last_clean":"2023-10-08T16:08:36.544097+0000","last_became_active":"2023-10-08T16:08:36.535099+0000","last_became_peered":"2023-10-08T16:08:36.535099+0000","last_unstale":"2023-10-08T16:08:36.544097+0000","last_undegraded":"2023-10-08T16:08:36.544097+0000","last_fullsized":"2023-10-08T16:08:36.544097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:20.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.549227+0000","last_change":"2023-10-08T16:08:36.549227+0000","last_active":"2023-10-08T16:08:36.549227+0000","last_peered":"2023-10-08T16:08:36.549227+0000","last_clean":"2023-10-08T16:08:36.549227+0000","last_became_active":"2023-10-08T16:08:36.548595+0000","last_became_peered":"2023-10-08T16:08:36.548595+0000","last_unstale":"2023-10-08T16:08:36.549227+0000","last_undegraded":"2023-10-08T16:08:36.549227+0000","last_fullsized":"2023-10-08T16:08:36.549227+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:30.876454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.536735+0000","last_change":"2023-10-08T16:08:36.532009+0000","last_active":"2023-10-08T16:08:36.536735+0000","last_peered":"2023-10-08T16:08:36.536735+0000","last_clean":"2023-10-08T16:08:36.536735+0000","last_became_active":"2023-10-08T16:08:36.531636+0000","last_became_peered":"2023-10-08T16:08:36.531636+0000","last_unstale":"2023-10-08T16:08:36.536735+0000","last_undegraded":"2023-10-08T16:08:36.536735+0000","last_fullsized":"2023-10-08T16:08:36.536735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:15.728719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544956+0000","last_change":"2023-10-08T16:08:36.544956+0000","last_active":"2023-10-08T16:08:36.544956+0000","last_peered":"2023-10-08T16:08:36.544956+0000","last_clean":"2023-10-08T16:08:36.544956+0000","last_became_active":"2023-10-08T16:08:36.544643+0000","last_became_peered":"2023-10-08T16:08:36.544643+0000","last_unstale":"2023-10-08T16:08:36.544956+0000","last_undegraded":"2023-10-08T16:08:36.544956+0000","last_fullsized":"2023-10-08T16:08:36.544956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555140+0000","last_change":"2023-10-08T16:08:35.521058+0000","last_active":"2023-10-08T16:08:36.555140+0000","last_peered":"2023-10-08T16:08:36.555140+0000","last_clean":"2023-10-08T16:08:36.555140+0000","last_became_active":"2023-10-08T16:08:35.520522+0000","last_became_peered":"2023-10-08T16:08:35.520522+0000","last_unstale":"2023-10-08T16:08:36.555140+0000","last_undegraded":"2023-10-08T16:08:36.555140+0000","last_fullsized":"2023-10-08T16:08:36.555140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:16.352648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542604+0000","last_change":"2023-10-08T16:08:36.532967+0000","last_active":"2023-10-08T16:08:36.542604+0000","last_peered":"2023-10-08T16:08:36.542604+0000","last_clean":"2023-10-08T16:08:36.542604+0000","last_became_active":"2023-10-08T16:08:36.532686+0000","last_became_peered":"2023-10-08T16:08:36.532686+0000","last_unstale":"2023-10-08T16:08:36.542604+0000","last_undegraded":"2023-10-08T16:08:36.542604+0000","last_fullsized":"2023-10-08T16:08:36.542604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.552904+0000","last_change":"2023-10-08T16:08:35.522115+0000","last_active":"2023-10-08T16:08:36.552904+0000","last_peered":"2023-10-08T16:08:36.552904+0000","last_clean":"2023-10-08T16:08:36.552904+0000","last_became_active":"2023-10-08T16:08:35.521247+0000","last_became_peered":"2023-10-08T16:08:35.521247+0000","last_unstale":"2023-10-08T16:08:36.552904+0000","last_undegraded":"2023-10-08T16:08:36.552904+0000","last_fullsized":"2023-10-08T16:08:36.552904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:59.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546763+0000","last_change":"2023-10-08T16:08:36.546763+0000","last_active":"2023-10-08T16:08:36.546763+0000","last_peered":"2023-10-08T16:08:36.546763+0000","last_clean":"2023-10-08T16:08:36.546763+0000","last_became_active":"2023-10-08T16:08:36.546434+0000","last_became_peered":"2023-10-08T16:08:36.546434+0000","last_unstale":"2023-10-08T16:08:36.546763+0000","last_undegraded":"2023-10-08T16:08:36.546763+0000","last_fullsized":"2023-10-08T16:08:36.546763+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:58.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554383+0000","last_change":"2023-10-08T16:08:35.510252+0000","last_active":"2023-10-08T16:08:36.554383+0000","last_peered":"2023-10-08T16:08:36.554383+0000","last_clean":"2023-10-08T16:08:36.554383+0000","last_became_active":"2023-10-08T16:08:35.509941+0000","last_became_peered":"2023-10-08T16:08:35.509941+0000","last_unstale":"2023-10-08T16:08:36.554383+0000","last_undegraded":"2023-10-08T16:08:36.554383+0000","last_fullsized":"2023-10-08T16:08:36.554383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:48.813733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544467+0000","last_change":"2023-10-08T16:08:36.544467+0000","last_active":"2023-10-08T16:08:36.544467+0000","last_peered":"2023-10-08T16:08:36.544467+0000","last_clean":"2023-10-08T16:08:36.544467+0000","last_became_active":"2023-10-08T16:08:36.543754+0000","last_became_peered":"2023-10-08T16:08:36.543754+0000","last_unstale":"2023-10-08T16:08:36.544467+0000","last_undegraded":"2023-10-08T16:08:36.544467+0000","last_fullsized":"2023-10-08T16:08:36.544467+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:35.943755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554241+0000","last_change":"2023-10-08T16:08:35.517941+0000","last_active":"2023-10-08T16:08:36.554241+0000","last_peered":"2023-10-08T16:08:36.554241+0000","last_clean":"2023-10-08T16:08:36.554241+0000","last_became_active":"2023-10-08T16:08:35.517589+0000","last_became_peered":"2023-10-08T16:08:35.517589+0000","last_unstale":"2023-10-08T16:08:36.554241+0000","last_undegraded":"2023-10-08T16:08:36.554241+0000","last_fullsized":"2023-10-08T16:08:36.554241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:34.933116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543955+0000","last_change":"2023-10-08T16:08:36.532692+0000","last_active":"2023-10-08T16:08:36.543955+0000","last_peered":"2023-10-08T16:08:36.543955+0000","last_clean":"2023-10-08T16:08:36.543955+0000","last_became_active":"2023-10-08T16:08:36.531966+0000","last_became_peered":"2023-10-08T16:08:36.531966+0000","last_unstale":"2023-10-08T16:08:36.543955+0000","last_undegraded":"2023-10-08T16:08:36.543955+0000","last_fullsized":"2023-10-08T16:08:36.543955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:59.729958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541585+0000","last_change":"2023-10-08T16:08:35.522582+0000","last_active":"2023-10-08T16:08:36.541585+0000","last_peered":"2023-10-08T16:08:36.541585+0000","last_clean":"2023-10-08T16:08:36.541585+0000","last_became_active":"2023-10-08T16:08:35.522072+0000","last_became_peered":"2023-10-08T16:08:35.522072+0000","last_unstale":"2023-10-08T16:08:36.541585+0000","last_undegraded":"2023-10-08T16:08:36.541585+0000","last_fullsized":"2023-10-08T16:08:36.541585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:21.303189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558525+0000","last_change":"2023-10-08T16:08:36.558525+0000","last_active":"2023-10-08T16:08:36.558525+0000","last_peered":"2023-10-08T16:08:36.558525+0000","last_clean":"2023-10-08T16:08:36.558525+0000","last_became_active":"2023-10-08T16:08:36.557564+0000","last_became_peered":"2023-10-08T16:08:36.557564+0000","last_unstale":"2023-10-08T16:08:36.558525+0000","last_undegraded":"2023-10-08T16:08:36.558525+0000","last_fullsized":"2023-10-08T16:08:36.558525+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.552715+0000","last_change":"2023-10-08T16:08:35.512854+0000","last_active":"2023-10-08T16:08:36.552715+0000","last_peered":"2023-10-08T16:08:36.552715+0000","last_clean":"2023-10-08T16:08:36.552715+0000","last_became_active":"2023-10-08T16:08:35.512528+0000","last_became_peered":"2023-10-08T16:08:35.512528+0000","last_unstale":"2023-10-08T16:08:36.552715+0000","last_undegraded":"2023-10-08T16:08:36.552715+0000","last_fullsized":"2023-10-08T16:08:36.552715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:48.813733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557503+0000","last_change":"2023-10-08T16:08:36.557503+0000","last_active":"2023-10-08T16:08:36.557503+0000","last_peered":"2023-10-08T16:08:36.557503+0000","last_clean":"2023-10-08T16:08:36.557503+0000","last_became_active":"2023-10-08T16:08:36.555665+0000","last_became_peered":"2023-10-08T16:08:36.555665+0000","last_unstale":"2023-10-08T16:08:36.557503+0000","last_undegraded":"2023-10-08T16:08:36.557503+0000","last_fullsized":"2023-10-08T16:08:36.557503+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:20.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.517191+0000","last_change":"2023-10-08T16:08:35.513155+0000","last_active":"2023-10-08T16:08:35.517191+0000","last_peered":"2023-10-08T16:08:35.517191+0000","last_clean":"2023-10-08T16:08:35.517191+0000","last_became_active":"2023-10-08T16:08:35.512832+0000","last_became_peered":"2023-10-08T16:08:35.512832+0000","last_unstale":"2023-10-08T16:08:35.517191+0000","last_undegraded":"2023-10-08T16:08:35.517191+0000","last_fullsized":"2023-10-08T16:08:35.517191+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:40.178100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543121+0000","last_change":"2023-10-08T16:08:36.538419+0000","last_active":"2023-10-08T16:08:36.543121+0000","last_peered":"2023-10-08T16:08:36.543121+0000","last_clean":"2023-10-08T16:08:36.543121+0000","last_became_active":"2023-10-08T16:08:36.538007+0000","last_became_peered":"2023-10-08T16:08:36.538007+0000","last_unstale":"2023-10-08T16:08:36.543121+0000","last_undegraded":"2023-10-08T16:08:36.543121+0000","last_fullsized":"2023-10-08T16:08:36.543121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:35.943755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.522936+0000","last_change":"2023-10-08T16:08:35.520294+0000","last_active":"2023-10-08T16:08:35.522936+0000","last_peered":"2023-10-08T16:08:35.522936+0000","last_clean":"2023-10-08T16:08:35.522936+0000","last_became_active":"2023-10-08T16:08:35.519878+0000","last_became_peered":"2023-10-08T16:08:35.519878+0000","last_unstale":"2023-10-08T16:08:35.522936+0000","last_undegraded":"2023-10-08T16:08:35.522936+0000","last_fullsized":"2023-10-08T16:08:35.522936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:39.424960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564856+0000","last_change":"2023-10-08T16:08:36.561366+0000","last_active":"2023-10-08T16:08:36.564856+0000","last_peered":"2023-10-08T16:08:36.564856+0000","last_clean":"2023-10-08T16:08:36.564856+0000","last_became_active":"2023-10-08T16:08:36.560765+0000","last_became_peered":"2023-10-08T16:08:36.560765+0000","last_unstale":"2023-10-08T16:08:36.564856+0000","last_undegraded":"2023-10-08T16:08:36.564856+0000","last_fullsized":"2023-10-08T16:08:36.564856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.528174+0000","last_change":"2023-10-08T16:08:35.515126+0000","last_active":"2023-10-08T16:08:36.528174+0000","last_peered":"2023-10-08T16:08:36.528174+0000","last_clean":"2023-10-08T16:08:36.528174+0000","last_became_active":"2023-10-08T16:08:35.514743+0000","last_became_peered":"2023-10-08T16:08:35.514743+0000","last_unstale":"2023-10-08T16:08:36.528174+0000","last_undegraded":"2023-10-08T16:08:36.528174+0000","last_fullsized":"2023-10-08T16:08:36.528174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:58.720511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546675+0000","last_change":"2023-10-08T16:08:36.540043+0000","last_active":"2023-10-08T16:08:36.546675+0000","last_peered":"2023-10-08T16:08:36.546675+0000","last_clean":"2023-10-08T16:08:36.546675+0000","last_became_active":"2023-10-08T16:08:36.539758+0000","last_became_peered":"2023-10-08T16:08:36.539758+0000","last_unstale":"2023-10-08T16:08:36.546675+0000","last_undegraded":"2023-10-08T16:08:36.546675+0000","last_fullsized":"2023-10-08T16:08:36.546675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.521847+0000","last_change":"2023-10-08T16:08:35.517701+0000","last_active":"2023-10-08T16:08:35.521847+0000","last_peered":"2023-10-08T16:08:35.521847+0000","last_clean":"2023-10-08T16:08:35.521847+0000","last_became_active":"2023-10-08T16:08:35.517413+0000","last_became_peered":"2023-10-08T16:08:35.517413+0000","last_unstale":"2023-10-08T16:08:35.521847+0000","last_undegraded":"2023-10-08T16:08:35.521847+0000","last_fullsized":"2023-10-08T16:08:35.521847+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:23.956918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542337+0000","last_change":"2023-10-08T16:08:36.542337+0000","last_active":"2023-10-08T16:08:36.542337+0000","last_peered":"2023-10-08T16:08:36.542337+0000","last_clean":"2023-10-08T16:08:36.542337+0000","last_became_active":"2023-10-08T16:08:36.541961+0000","last_became_peered":"2023-10-08T16:08:36.541961+0000","last_unstale":"2023-10-08T16:08:36.542337+0000","last_undegraded":"2023-10-08T16:08:36.542337+0000","last_fullsized":"2023-10-08T16:08:36.542337+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:17.977708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553971+0000","last_change":"2023-10-08T16:08:35.522105+0000","last_active":"2023-10-08T16:08:36.553971+0000","last_peered":"2023-10-08T16:08:36.553971+0000","last_clean":"2023-10-08T16:08:36.553971+0000","last_became_active":"2023-10-08T16:08:35.521762+0000","last_became_peered":"2023-10-08T16:08:35.521762+0000","last_unstale":"2023-10-08T16:08:36.553971+0000","last_undegraded":"2023-10-08T16:08:36.553971+0000","last_fullsized":"2023-10-08T16:08:36.553971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:56.088335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547778+0000","last_change":"2023-10-08T16:08:36.545190+0000","last_active":"2023-10-08T16:08:36.547778+0000","last_peered":"2023-10-08T16:08:36.547778+0000","last_clean":"2023-10-08T16:08:36.547778+0000","last_became_active":"2023-10-08T16:08:36.543666+0000","last_became_peered":"2023-10-08T16:08:36.543666+0000","last_unstale":"2023-10-08T16:08:36.547778+0000","last_undegraded":"2023-10-08T16:08:36.547778+0000","last_fullsized":"2023-10-08T16:08:36.547778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.563771+0000","last_change":"2023-10-08T16:08:35.516486+0000","last_active":"2023-10-08T16:08:36.563771+0000","last_peered":"2023-10-08T16:08:36.563771+0000","last_clean":"2023-10-08T16:08:36.563771+0000","last_became_active":"2023-10-08T16:08:35.516109+0000","last_became_peered":"2023-10-08T16:08:35.516109+0000","last_unstale":"2023-10-08T16:08:36.563771+0000","last_undegraded":"2023-10-08T16:08:36.563771+0000","last_fullsized":"2023-10-08T16:08:36.563771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:24.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564142+0000","last_change":"2023-10-08T16:08:36.559963+0000","last_active":"2023-10-08T16:08:36.564142+0000","last_peered":"2023-10-08T16:08:36.564142+0000","last_clean":"2023-10-08T16:08:36.564142+0000","last_became_active":"2023-10-08T16:08:36.559511+0000","last_became_peered":"2023-10-08T16:08:36.559511+0000","last_unstale":"2023-10-08T16:08:36.564142+0000","last_undegraded":"2023-10-08T16:08:36.564142+0000","last_fullsized":"2023-10-08T16:08:36.564142+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:49.824371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.562594+0000","last_change":"2023-10-08T16:08:35.523780+0000","last_active":"2023-10-08T16:08:36.562594+0000","last_peered":"2023-10-08T16:08:36.562594+0000","last_clean":"2023-10-08T16:08:36.562594+0000","last_became_active":"2023-10-08T16:08:35.523585+0000","last_became_peered":"2023-10-08T16:08:35.523585+0000","last_unstale":"2023-10-08T16:08:36.562594+0000","last_undegraded":"2023-10-08T16:08:36.562594+0000","last_fullsized":"2023-10-08T16:08:36.562594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:44.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557893+0000","last_change":"2023-10-08T16:08:36.557893+0000","last_active":"2023-10-08T16:08:36.557893+0000","last_peered":"2023-10-08T16:08:36.557893+0000","last_clean":"2023-10-08T16:08:36.557893+0000","last_became_active":"2023-10-08T16:08:36.557458+0000","last_became_peered":"2023-10-08T16:08:36.557458+0000","last_unstale":"2023-10-08T16:08:36.557893+0000","last_undegraded":"2023-10-08T16:08:36.557893+0000","last_fullsized":"2023-10-08T16:08:36.557893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530051+0000","last_change":"2023-10-08T16:08:35.516225+0000","last_active":"2023-10-08T16:08:36.530051+0000","last_peered":"2023-10-08T16:08:36.530051+0000","last_clean":"2023-10-08T16:08:36.530051+0000","last_became_active":"2023-10-08T16:08:35.515923+0000","last_became_peered":"2023-10-08T16:08:35.515923+0000","last_unstale":"2023-10-08T16:08:36.530051+0000","last_undegraded":"2023-10-08T16:08:36.530051+0000","last_fullsized":"2023-10-08T16:08:36.530051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:13.398969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542022+0000","last_change":"2023-10-08T16:08:36.542022+0000","last_active":"2023-10-08T16:08:36.542022+0000","last_peered":"2023-10-08T16:08:36.542022+0000","last_clean":"2023-10-08T16:08:36.542022+0000","last_became_active":"2023-10-08T16:08:36.541615+0000","last_became_peered":"2023-10-08T16:08:36.541615+0000","last_unstale":"2023-10-08T16:08:36.542022+0000","last_undegraded":"2023-10-08T16:08:36.542022+0000","last_fullsized":"2023-10-08T16:08:36.542022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:57.935809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.525235+0000","last_change":"2023-10-08T16:08:35.522655+0000","last_active":"2023-10-08T16:08:35.525235+0000","last_peered":"2023-10-08T16:08:35.525235+0000","last_clean":"2023-10-08T16:08:35.525235+0000","last_became_active":"2023-10-08T16:08:35.522318+0000","last_became_peered":"2023-10-08T16:08:35.522318+0000","last_unstale":"2023-10-08T16:08:35.525235+0000","last_undegraded":"2023-10-08T16:08:35.525235+0000","last_fullsized":"2023-10-08T16:08:35.525235+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:20.308296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547604+0000","last_change":"2023-10-08T16:08:36.544673+0000","last_active":"2023-10-08T16:08:36.547604+0000","last_peered":"2023-10-08T16:08:36.547604+0000","last_clean":"2023-10-08T16:08:36.547604+0000","last_became_active":"2023-10-08T16:08:36.543264+0000","last_became_peered":"2023-10-08T16:08:36.543264+0000","last_unstale":"2023-10-08T16:08:36.547604+0000","last_undegraded":"2023-10-08T16:08:36.547604+0000","last_fullsized":"2023-10-08T16:08:36.547604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.561264+0000","last_change":"2023-10-08T16:08:35.519968+0000","last_active":"2023-10-08T16:08:36.561264+0000","last_peered":"2023-10-08T16:08:36.561264+0000","last_clean":"2023-10-08T16:08:36.561264+0000","last_became_active":"2023-10-08T16:08:35.519455+0000","last_became_peered":"2023-10-08T16:08:35.519455+0000","last_unstale":"2023-10-08T16:08:36.561264+0000","last_undegraded":"2023-10-08T16:08:36.561264+0000","last_fullsized":"2023-10-08T16:08:36.561264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:27.120538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551853+0000","last_change":"2023-10-08T16:08:36.539068+0000","last_active":"2023-10-08T16:08:36.551853+0000","last_peered":"2023-10-08T16:08:36.551853+0000","last_clean":"2023-10-08T16:08:36.551853+0000","last_became_active":"2023-10-08T16:08:36.538585+0000","last_became_peered":"2023-10-08T16:08:36.538585+0000","last_unstale":"2023-10-08T16:08:36.551853+0000","last_undegraded":"2023-10-08T16:08:36.551853+0000","last_fullsized":"2023-10-08T16:08:36.551853+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:30.743086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554023+0000","last_change":"2023-10-08T16:08:35.519081+0000","last_active":"2023-10-08T16:08:36.554023+0000","last_peered":"2023-10-08T16:08:36.554023+0000","last_clean":"2023-10-08T16:08:36.554023+0000","last_became_active":"2023-10-08T16:08:35.518676+0000","last_became_peered":"2023-10-08T16:08:35.518676+0000","last_unstale":"2023-10-08T16:08:36.554023+0000","last_undegraded":"2023-10-08T16:08:36.554023+0000","last_fullsized":"2023-10-08T16:08:36.554023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:13.319179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558694+0000","last_change":"2023-10-08T16:08:36.558694+0000","last_active":"2023-10-08T16:08:36.558694+0000","last_peered":"2023-10-08T16:08:36.558694+0000","last_clean":"2023-10-08T16:08:36.558694+0000","last_became_active":"2023-10-08T16:08:36.557406+0000","last_became_peered":"2023-10-08T16:08:36.557406+0000","last_unstale":"2023-10-08T16:08:36.558694+0000","last_undegraded":"2023-10-08T16:08:36.558694+0000","last_fullsized":"2023-10-08T16:08:36.558694+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555576+0000","last_change":"2023-10-08T16:08:35.513768+0000","last_active":"2023-10-08T16:08:36.555576+0000","last_peered":"2023-10-08T16:08:36.555576+0000","last_clean":"2023-10-08T16:08:36.555576+0000","last_became_active":"2023-10-08T16:08:35.513267+0000","last_became_peered":"2023-10-08T16:08:35.513267+0000","last_unstale":"2023-10-08T16:08:36.555576+0000","last_undegraded":"2023-10-08T16:08:36.555576+0000","last_fullsized":"2023-10-08T16:08:36.555576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:43.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547104+0000","last_change":"2023-10-08T16:08:36.544806+0000","last_active":"2023-10-08T16:08:36.547104+0000","last_peered":"2023-10-08T16:08:36.547104+0000","last_clean":"2023-10-08T16:08:36.547104+0000","last_became_active":"2023-10-08T16:08:36.544479+0000","last_became_peered":"2023-10-08T16:08:36.544479+0000","last_unstale":"2023-10-08T16:08:36.547104+0000","last_undegraded":"2023-10-08T16:08:36.547104+0000","last_fullsized":"2023-10-08T16:08:36.547104+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:24.175187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.531976+0000","last_change":"2023-10-08T16:08:35.510082+0000","last_active":"2023-10-08T16:08:36.531976+0000","last_peered":"2023-10-08T16:08:36.531976+0000","last_clean":"2023-10-08T16:08:36.531976+0000","last_became_active":"2023-10-08T16:08:35.509737+0000","last_became_peered":"2023-10-08T16:08:35.509737+0000","last_unstale":"2023-10-08T16:08:36.531976+0000","last_undegraded":"2023-10-08T16:08:36.531976+0000","last_fullsized":"2023-10-08T16:08:36.531976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:23.164548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546381+0000","last_change":"2023-10-08T16:08:36.544079+0000","last_active":"2023-10-08T16:08:36.546381+0000","last_peered":"2023-10-08T16:08:36.546381+0000","last_clean":"2023-10-08T16:08:36.546381+0000","last_became_active":"2023-10-08T16:08:36.543716+0000","last_became_peered":"2023-10-08T16:08:36.543716+0000","last_unstale":"2023-10-08T16:08:36.546381+0000","last_undegraded":"2023-10-08T16:08:36.546381+0000","last_fullsized":"2023-10-08T16:08:36.546381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:14.409607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.525098+0000","last_change":"2023-10-08T16:08:35.520720+0000","last_active":"2023-10-08T16:08:35.525098+0000","last_peered":"2023-10-08T16:08:35.525098+0000","last_clean":"2023-10-08T16:08:35.525098+0000","last_became_active":"2023-10-08T16:08:35.520373+0000","last_became_peered":"2023-10-08T16:08:35.520373+0000","last_unstale":"2023-10-08T16:08:35.525098+0000","last_undegraded":"2023-10-08T16:08:35.525098+0000","last_fullsized":"2023-10-08T16:08:35.525098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:28.856770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541391+0000","last_change":"2023-10-08T16:08:36.541391+0000","last_active":"2023-10-08T16:08:36.541391+0000","last_peered":"2023-10-08T16:08:36.541391+0000","last_clean":"2023-10-08T16:08:36.541391+0000","last_became_active":"2023-10-08T16:08:36.541053+0000","last_became_peered":"2023-10-08T16:08:36.541053+0000","last_unstale":"2023-10-08T16:08:36.541391+0000","last_undegraded":"2023-10-08T16:08:36.541391+0000","last_fullsized":"2023-10-08T16:08:36.541391+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:09.801025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558637+0000","last_change":"2023-10-08T16:08:35.522365+0000","last_active":"2023-10-08T16:08:36.558637+0000","last_peered":"2023-10-08T16:08:36.558637+0000","last_clean":"2023-10-08T16:08:36.558637+0000","last_became_active":"2023-10-08T16:08:35.521727+0000","last_became_peered":"2023-10-08T16:08:35.521727+0000","last_unstale":"2023-10-08T16:08:36.558637+0000","last_undegraded":"2023-10-08T16:08:36.558637+0000","last_fullsized":"2023-10-08T16:08:36.558637+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:31.609141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.536639+0000","last_change":"2023-10-08T16:08:36.536639+0000","last_active":"2023-10-08T16:08:36.536639+0000","last_peered":"2023-10-08T16:08:36.536639+0000","last_clean":"2023-10-08T16:08:36.536639+0000","last_became_active":"2023-10-08T16:08:36.536276+0000","last_became_peered":"2023-10-08T16:08:36.536276+0000","last_unstale":"2023-10-08T16:08:36.536639+0000","last_undegraded":"2023-10-08T16:08:36.536639+0000","last_fullsized":"2023-10-08T16:08:36.536639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:50.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.518556+0000","last_change":"2023-10-08T16:08:35.514659+0000","last_active":"2023-10-08T16:08:35.518556+0000","last_peered":"2023-10-08T16:08:35.518556+0000","last_clean":"2023-10-08T16:08:35.518556+0000","last_became_active":"2023-10-08T16:08:35.514144+0000","last_became_peered":"2023-10-08T16:08:35.514144+0000","last_unstale":"2023-10-08T16:08:35.518556+0000","last_undegraded":"2023-10-08T16:08:35.518556+0000","last_fullsized":"2023-10-08T16:08:35.518556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:49.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551624+0000","last_change":"2023-10-08T16:08:36.536849+0000","last_active":"2023-10-08T16:08:36.551624+0000","last_peered":"2023-10-08T16:08:36.551624+0000","last_clean":"2023-10-08T16:08:36.551624+0000","last_became_active":"2023-10-08T16:08:36.536445+0000","last_became_peered":"2023-10-08T16:08:36.536445+0000","last_unstale":"2023-10-08T16:08:36.551624+0000","last_undegraded":"2023-10-08T16:08:36.551624+0000","last_fullsized":"2023-10-08T16:08:36.551624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:42.144819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.522355+0000","last_change":"2023-10-08T16:08:35.519542+0000","last_active":"2023-10-08T16:08:35.522355+0000","last_peered":"2023-10-08T16:08:35.522355+0000","last_clean":"2023-10-08T16:08:35.522355+0000","last_became_active":"2023-10-08T16:08:35.519265+0000","last_became_peered":"2023-10-08T16:08:35.519265+0000","last_unstale":"2023-10-08T16:08:35.522355+0000","last_undegraded":"2023-10-08T16:08:35.522355+0000","last_fullsized":"2023-10-08T16:08:35.522355+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:14.718080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559389+0000","last_change":"2023-10-08T16:08:36.559389+0000","last_active":"2023-10-08T16:08:36.559389+0000","last_peered":"2023-10-08T16:08:36.559389+0000","last_clean":"2023-10-08T16:08:36.559389+0000","last_became_active":"2023-10-08T16:08:36.555801+0000","last_became_peered":"2023-10-08T16:08:36.555801+0000","last_unstale":"2023-10-08T16:08:36.559389+0000","last_undegraded":"2023-10-08T16:08:36.559389+0000","last_fullsized":"2023-10-08T16:08:36.559389+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:59.729958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529797+0000","last_change":"2023-10-08T16:08:35.518241+0000","last_active":"2023-10-08T16:08:36.529797+0000","last_peered":"2023-10-08T16:08:36.529797+0000","last_clean":"2023-10-08T16:08:36.529797+0000","last_became_active":"2023-10-08T16:08:35.517833+0000","last_became_peered":"2023-10-08T16:08:35.517833+0000","last_unstale":"2023-10-08T16:08:36.529797+0000","last_undegraded":"2023-10-08T16:08:36.529797+0000","last_fullsized":"2023-10-08T16:08:36.529797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:49.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564108+0000","last_change":"2023-10-08T16:08:36.559842+0000","last_active":"2023-10-08T16:08:36.564108+0000","last_peered":"2023-10-08T16:08:36.564108+0000","last_clean":"2023-10-08T16:08:36.564108+0000","last_became_active":"2023-10-08T16:08:36.559449+0000","last_became_peered":"2023-10-08T16:08:36.559449+0000","last_unstale":"2023-10-08T16:08:36.564108+0000","last_undegraded":"2023-10-08T16:08:36.564108+0000","last_fullsized":"2023-10-08T16:08:36.564108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:59.731149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.525205+0000","last_change":"2023-10-08T16:08:35.522506+0000","last_active":"2023-10-08T16:08:35.525205+0000","last_peered":"2023-10-08T16:08:35.525205+0000","last_clean":"2023-10-08T16:08:35.525205+0000","last_became_active":"2023-10-08T16:08:35.522155+0000","last_became_peered":"2023-10-08T16:08:35.522155+0000","last_unstale":"2023-10-08T16:08:35.525205+0000","last_undegraded":"2023-10-08T16:08:35.525205+0000","last_fullsized":"2023-10-08T16:08:35.525205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:57.717725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558910+0000","last_change":"2023-10-08T16:08:36.558910+0000","last_active":"2023-10-08T16:08:36.558910+0000","last_peered":"2023-10-08T16:08:36.558910+0000","last_clean":"2023-10-08T16:08:36.558910+0000","last_became_active":"2023-10-08T16:08:36.557485+0000","last_became_peered":"2023-10-08T16:08:36.557485+0000","last_unstale":"2023-10-08T16:08:36.558910+0000","last_undegraded":"2023-10-08T16:08:36.558910+0000","last_fullsized":"2023-10-08T16:08:36.558910+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.531556+0000","last_change":"2023-10-08T16:08:35.521984+0000","last_active":"2023-10-08T16:08:36.531556+0000","last_peered":"2023-10-08T16:08:36.531556+0000","last_clean":"2023-10-08T16:08:36.531556+0000","last_became_active":"2023-10-08T16:08:35.521663+0000","last_became_peered":"2023-10-08T16:08:35.521663+0000","last_unstale":"2023-10-08T16:08:36.531556+0000","last_undegraded":"2023-10-08T16:08:36.531556+0000","last_fullsized":"2023-10-08T16:08:36.531556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:59.047588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546705+0000","last_change":"2023-10-08T16:08:36.540944+0000","last_active":"2023-10-08T16:08:36.546705+0000","last_peered":"2023-10-08T16:08:36.546705+0000","last_clean":"2023-10-08T16:08:36.546705+0000","last_became_active":"2023-10-08T16:08:36.539103+0000","last_became_peered":"2023-10-08T16:08:36.539103+0000","last_unstale":"2023-10-08T16:08:36.546705+0000","last_undegraded":"2023-10-08T16:08:36.546705+0000","last_fullsized":"2023-10-08T16:08:36.546705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.516027+0000","last_change":"2023-10-08T16:08:35.509970+0000","last_active":"2023-10-08T16:08:35.516027+0000","last_peered":"2023-10-08T16:08:35.516027+0000","last_clean":"2023-10-08T16:08:35.516027+0000","last_became_active":"2023-10-08T16:08:35.509612+0000","last_became_peered":"2023-10-08T16:08:35.509612+0000","last_unstale":"2023-10-08T16:08:35.516027+0000","last_undegraded":"2023-10-08T16:08:35.516027+0000","last_fullsized":"2023-10-08T16:08:35.516027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:58.720511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545032+0000","last_change":"2023-10-08T16:08:36.545032+0000","last_active":"2023-10-08T16:08:36.545032+0000","last_peered":"2023-10-08T16:08:36.545032+0000","last_clean":"2023-10-08T16:08:36.545032+0000","last_became_active":"2023-10-08T16:08:36.542687+0000","last_became_peered":"2023-10-08T16:08:36.542687+0000","last_unstale":"2023-10-08T16:08:36.545032+0000","last_undegraded":"2023-10-08T16:08:36.545032+0000","last_fullsized":"2023-10-08T16:08:36.545032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:15.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530314+0000","last_change":"2023-10-08T16:08:35.518326+0000","last_active":"2023-10-08T16:08:36.530314+0000","last_peered":"2023-10-08T16:08:36.530314+0000","last_clean":"2023-10-08T16:08:36.530314+0000","last_became_active":"2023-10-08T16:08:35.517934+0000","last_became_peered":"2023-10-08T16:08:35.517934+0000","last_unstale":"2023-10-08T16:08:36.530314+0000","last_undegraded":"2023-10-08T16:08:36.530314+0000","last_fullsized":"2023-10-08T16:08:36.530314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:37.275172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553155+0000","last_change":"2023-10-08T16:08:36.553155+0000","last_active":"2023-10-08T16:08:36.553155+0000","last_peered":"2023-10-08T16:08:36.553155+0000","last_clean":"2023-10-08T16:08:36.553155+0000","last_became_active":"2023-10-08T16:08:36.552800+0000","last_became_peered":"2023-10-08T16:08:36.552800+0000","last_unstale":"2023-10-08T16:08:36.553155+0000","last_undegraded":"2023-10-08T16:08:36.553155+0000","last_fullsized":"2023-10-08T16:08:36.553155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:42.781613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.526829+0000","last_change":"2023-10-08T16:08:35.524120+0000","last_active":"2023-10-08T16:08:36.526829+0000","last_peered":"2023-10-08T16:08:36.526829+0000","last_clean":"2023-10-08T16:08:36.526829+0000","last_became_active":"2023-10-08T16:08:35.523720+0000","last_became_peered":"2023-10-08T16:08:35.523720+0000","last_unstale":"2023-10-08T16:08:36.526829+0000","last_undegraded":"2023-10-08T16:08:36.526829+0000","last_fullsized":"2023-10-08T16:08:36.526829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:05.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.538177+0000","last_change":"2023-10-08T16:08:36.538177+0000","last_active":"2023-10-08T16:08:36.538177+0000","last_peered":"2023-10-08T16:08:36.538177+0000","last_clean":"2023-10-08T16:08:36.538177+0000","last_became_active":"2023-10-08T16:08:36.537883+0000","last_became_peered":"2023-10-08T16:08:36.537883+0000","last_unstale":"2023-10-08T16:08:36.538177+0000","last_undegraded":"2023-10-08T16:08:36.538177+0000","last_fullsized":"2023-10-08T16:08:36.538177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.521717+0000","last_change":"2023-10-08T16:08:35.518176+0000","last_active":"2023-10-08T16:08:35.521717+0000","last_peered":"2023-10-08T16:08:35.521717+0000","last_clean":"2023-10-08T16:08:35.521717+0000","last_became_active":"2023-10-08T16:08:35.517664+0000","last_became_peered":"2023-10-08T16:08:35.517664+0000","last_unstale":"2023-10-08T16:08:35.521717+0000","last_undegraded":"2023-10-08T16:08:35.521717+0000","last_fullsized":"2023-10-08T16:08:35.521717+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:05.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555489+0000","last_change":"2023-10-08T16:08:36.551479+0000","last_active":"2023-10-08T16:08:36.555489+0000","last_peered":"2023-10-08T16:08:36.555489+0000","last_clean":"2023-10-08T16:08:36.555489+0000","last_became_active":"2023-10-08T16:08:36.551148+0000","last_became_peered":"2023-10-08T16:08:36.551148+0000","last_unstale":"2023-10-08T16:08:36.555489+0000","last_undegraded":"2023-10-08T16:08:36.555489+0000","last_fullsized":"2023-10-08T16:08:36.555489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-08T16:08:35.524952+0000","last_change":"2023-10-08T16:08:35.522819+0000","last_active":"2023-10-08T16:08:35.524952+0000","last_peered":"2023-10-08T16:08:35.524952+0000","last_clean":"2023-10-08T16:08:35.524952+0000","last_became_active":"2023-10-08T16:08:35.522486+0000","last_became_peered":"2023-10-08T16:08:35.522486+0000","last_unstale":"2023-10-08T16:08:35.524952+0000","last_undegraded":"2023-10-08T16:08:35.524952+0000","last_fullsized":"2023-10-08T16:08:35.524952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:49.985736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557866+0000","last_change":"2023-10-08T16:08:36.557866+0000","last_active":"2023-10-08T16:08:36.557866+0000","last_peered":"2023-10-08T16:08:36.557866+0000","last_clean":"2023-10-08T16:08:36.557866+0000","last_became_active":"2023-10-08T16:08:36.557264+0000","last_became_peered":"2023-10-08T16:08:36.557264+0000","last_unstale":"2023-10-08T16:08:36.557866+0000","last_undegraded":"2023-10-08T16:08:36.557866+0000","last_fullsized":"2023-10-08T16:08:36.557866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554658+0000","last_change":"2023-10-08T16:08:35.520787+0000","last_active":"2023-10-08T16:08:36.554658+0000","last_peered":"2023-10-08T16:08:36.554658+0000","last_clean":"2023-10-08T16:08:36.554658+0000","last_became_active":"2023-10-08T16:08:35.520356+0000","last_became_peered":"2023-10-08T16:08:35.520356+0000","last_unstale":"2023-10-08T16:08:36.554658+0000","last_undegraded":"2023-10-08T16:08:36.554658+0000","last_fullsized":"2023-10-08T16:08:36.554658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:34.933116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529767+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:08:36.529767+0000","last_peered":"2023-10-08T16:08:36.529767+0000","last_clean":"2023-10-08T16:08:36.529767+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:08:36.529767+0000","last_undegraded":"2023-10-08T16:08:36.529767+0000","last_fullsized":"2023-10-08T16:08:36.529767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":791550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.242,"5min":1.343,"15min":1.343},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2450000000000001,"5min":1.429,"15min":1.429},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.70999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.304}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.71899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1399999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.242},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.014,"15min":1.02},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.258,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.365}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.998,"15min":1.008},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2949999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1399999999999999,"15min":1.149},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.24,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.161}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0860000000000001,"15min":1.107},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.163,"5min":1.492,"15min":1.492},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.1100000000000001,"15min":1.129},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.702,"15min":1.702},"last":1.115}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.171,"15min":1.1830000000000001},"min":{"1min":0.68100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.355,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.016}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2330000000000001,"15min":1.2450000000000001},"min":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.429,"5min":1.75,"15min":1.75},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1899999999999999,"15min":1.206},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.401,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.329}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297788,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074052,"statfs":{"total":96636764160,"available":96331829248,"internally_reserved":0,"allocated":512000,"data_stored":201736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.99199999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.147,"5min":1.548,"15min":1.548},"last":1.006},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.012,"15min":1.0169999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.254,"5min":1.353,"15min":1.353},"last":1.254}]},{"osd":1,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.339,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.014,"15min":1.004},"min":{"1min":0.69599999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.472,"15min":1.472},"last":1.1499999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.97199999999999998,"15min":0.96699999999999997},"min":{"1min":0.73699999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2130000000000001,"5min":1.431,"15min":1.431},"last":1.056},{"interface":"front","average":{"1min":1.133,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.429,"5min":2.286,"15min":2.286},"last":1.1859999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.097,"15min":1.111},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2989999999999999,"5min":1.552,"15min":1.552},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.03,"5min":1.0229999999999999,"15min":1.022},"min":{"1min":0.77300000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.212}]},{"osd":4,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.127,"15min":1.137},"min":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.347,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":1.119},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.246,"15min":1.2490000000000001},"min":{"1min":0.90400000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5389999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1339999999999999,"15min":1.1319999999999999},"min":{"1min":0.751,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4219999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.3180000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.5409999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.3109999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.397,"15min":1.409},"min":{"1min":0.84399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.554,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.339},{"interface":"front","average":{"1min":1.331,"5min":1.3049999999999999,"15min":1.3009999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.591,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.288}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":201162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.302,"5min":1.377,"15min":1.377},"last":0.871},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.228,"15min":1.228},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.22,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3700000000000001,"5min":1.734,"15min":1.734},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96299999999999997},"min":{"1min":0.754,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.206,"5min":1.972,"15min":1.972},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.032,"15min":1.048},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.21,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.077,"15min":1.077},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4710000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.012,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.749,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3460000000000001,"5min":2.141,"15min":2.141},"last":1.032}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.018,"15min":1.038},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.139,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.89000000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7589999999999999,"5min":2.101,"15min":2.101},"last":1.012}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.401,"5min":2.383,"15min":2.383},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.224,"15min":1.248},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.3540000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9299999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.387,"15min":1.405},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4770000000000001,"5min":2.605,"15min":2.605},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":202628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":0.95999999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.03,"15min":1.0469999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.157}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.099,"15min":1.125},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.157,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.872}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1240000000000001,"15min":1.1479999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.113,"15min":1.127},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.284,"5min":1.607,"15min":1.607},"last":1.107}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.194,"15min":1.226},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.216,"15min":1.2430000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3340000000000001,"5min":1.702,"15min":1.702},"last":1.1830000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.157,"15min":1.1859999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.3640000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.177,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":2.347,"15min":2.347},"last":1.2450000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4810000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3600000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3680000000000001,"5min":1.95,"15min":1.95},"last":1.218}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":201702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77100000000000002,"15min":0.76500000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.27,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.103,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.61299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.92900000000000005},"min":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1120000000000001,"5min":1.403,"15min":1.403},"last":0.85999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.03,"15min":1.024},"min":{"1min":0.79800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5680000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6659999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.76500000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.54,"15min":1.54},"last":1.246},{"interface":"front","average":{"1min":1.135,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.268}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.85099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5049999999999999,"5min":1.575,"15min":1.575},"last":1.079},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.248},"min":{"1min":0.95999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5529999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.01}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2310000000000001,"15min":1.2270000000000001},"min":{"1min":0.94599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.113},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2549999999999999,"15min":1.262},"min":{"1min":0.97399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6180000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":202650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.69399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88500000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.44400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.034,"5min":1.556,"15min":1.556},"last":0.95699999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.504,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1719999999999999,"5min":1.21,"15min":1.21},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.48699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.006,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.085,"5min":1.272,"15min":1.272},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.67600000000000005,"5min":0.378,"15min":0.378},"max":{"1min":1.3640000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.3640000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.018,"15min":1.014},"min":{"1min":0.624,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3799999999999999,"5min":1.456,"15min":1.456},"last":1.093},{"interface":"front","average":{"1min":1.073,"5min":1.0629999999999999,"15min":1.0609999999999999},"min":{"1min":0.79700000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.72999999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.514,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.038},{"interface":"front","average":{"1min":1.202,"5min":1.1910000000000001,"15min":1.1890000000000001},"min":{"1min":0.86299999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.464,"5min":1.792,"15min":1.792},"last":1.2450000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1599999999999999,"15min":1.159},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.518,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.80800000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3400000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.1879999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.69599999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.89300000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.419,"5min":1.534,"15min":1.534},"last":1.3140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":201162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.49299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90700000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.755,"15min":0.74399999999999999},"min":{"1min":0.65900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":1.004,"15min":1.004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.83699999999999997,"15min":0.83199999999999996},"min":{"1min":0.59199999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0569999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.1399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.69399999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83099999999999996,"15min":0.81699999999999995},"min":{"1min":0.58099999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.21,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.095}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.97699999999999998,"15min":0.97299999999999998},"min":{"1min":0.79700000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.3999999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.012}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.008},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4119999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.117,"15min":1.117},"min":{"1min":0.91900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3580000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.252}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.548,"5min":1.768,"15min":1.768},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.84599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.169}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1659999999999999,"15min":1.1719999999999999},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.339,"5min":1.625,"15min":1.625},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.248,"15min":1.2529999999999999},"min":{"1min":1.022,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6379999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.45}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":791494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.54300000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.109,"5min":1.3,"15min":1.3},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.266,"15min":1.266},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.244,"15min":1.244},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.96699999999999997,"15min":0.96199999999999997},"min":{"1min":0.70299999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3740000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.79400000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0509999999999999,"15min":1.0389999999999999},"min":{"1min":0.78100000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.875}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.1299999999999999},"min":{"1min":0.76600000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.667,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.1990000000000001},"min":{"1min":0.95699999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.897,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.1559999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.875,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.228},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2450000000000001,"15min":1.234},"min":{"1min":0.94999999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.0109999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.238,"15min":1.234},"min":{"1min":0.97999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.115},{"interface":"front","average":{"1min":1.23,"5min":1.2,"15min":1.1950000000000001},"min":{"1min":1.0209999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.74,"5min":2.008,"15min":2.008},"last":1.323}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:08:41.791 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-10-08T16:08:41.789+0000 7f164f9d3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:08:42.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:42.134 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:44.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:08:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.313+0000 7f2fdf59e700 1 Processor -- start 2023-10-08T16:08:44.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.313+0000 7f2fdf59e700 1 -- start start 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2fe00bfce0 0x7f2fe00c9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00cb250 con 0x7f2fe00c9860 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00cb530 con 0x7f2fe00bf910 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe00cc2f0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2fe00bfce0 0x7f2fe00c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2fe00bfce0 0x7f2fe00c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33552/0 (socket says 172.21.15.3:33552) 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 -- 172.21.15.3:0/1672524938 learned_addr learned my addr 172.21.15.3:0/1672524938 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 -- 172.21.15.3:0/1672524938 >> v1:172.21.15.27:6789/0 conn(0x7f2fe00bf910 legacy=0x7f2fe01619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 -- 172.21.15.3:0/1672524938 >> v1:172.21.15.3:6789/0 conn(0x7f2fe00c9860 legacy=0x7f2fe00ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 -- 172.21.15.3:0/1672524938 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00cb810 con 0x7f2fe00bfce0 2023-10-08T16:08:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fddd9b700 1 --2- 172.21.15.3:0/1672524938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c9320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009f20 tx=0x7f2fd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de9ab4bf835315e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdd59a700 1 -- 172.21.15.3:0/1672524938 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000e070 con 0x7f2fe00bfce0 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdd59a700 1 -- 172.21.15.3:0/1672524938 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd000ba80 con 0x7f2fe00bfce0 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdd59a700 1 -- 172.21.15.3:0/1672524938 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00092e0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- 172.21.15.3:0/1672524938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 msgr2=0x7f2fe00c9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/1672524938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c9320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009f20 tx=0x7f2fd0009840 comp rx=0 tx=0).stop 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- 172.21.15.3:0/1672524938 shutdown_connections 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/1672524938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c9320 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- 172.21.15.3:0/1672524938 >> 172.21.15.3:0/1672524938 conn(0x7f2fe006b6b0 msgr2=0x7f2fe006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- 172.21.15.3:0/1672524938 shutdown_connections 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.317+0000 7f2fdf59e700 1 -- 172.21.15.3:0/1672524938 wait complete. 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 Processor -- start 2023-10-08T16:08:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 -- start start 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fe00bf910 0x7f2fe00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2fe00c9860 0x7f2fe014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe015df20 con 0x7f2fe00bfce0 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00c6940 con 0x7f2fe00bf910 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00c6380 con 0x7f2fe00c9860 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33568/0 (socket says 172.21.15.3:33568) 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 -- 172.21.15.3:0/263964173 learned_addr learned my addr 172.21.15.3:0/263964173 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fded9d700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2fe00c9860 0x7f2fe014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fde59c700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fe00bf910 0x7f2fe00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 -- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2fe00c9860 msgr2=0x7f2fe014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2fe00c9860 0x7f2fe014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 -- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fe00bf910 msgr2=0x7f2fe00b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fe00bf910 0x7f2fe00b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 -- 172.21.15.3:0/263964173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd0009ae0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fddd9b700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c58c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2fe006e070 tx=0x7f2fd0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0008a80 con 0x7f2fe00bfce0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0008be0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe00c6660 con 0x7f2fe00bfce0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0026460 con 0x7f2fe00bfce0 2023-10-08T16:08:44.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.321+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe00c5260 con 0x7f2fe00bfce0 2023-10-08T16:08:44.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.325+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe015e0d0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.325+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2fd0003040 con 0x7f2fe00bfce0 2023-10-08T16:08:44.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.325+0000 7f2fd67fc700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2fc0060580 0x7f2fc0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.325+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fd007e7a0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.325+0000 7f2fde59c700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2fc0060580 0x7f2fc0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.325+0000 7f2fde59c700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2fc0060580 0x7f2fc0062a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80039e0 tx=0x7f2fc8007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.333+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2fd004eda0 con 0x7f2fe00bfce0 2023-10-08T16:08:44.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.489+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fe004be40 con 0x7f2fc0060580 2023-10-08T16:08:44.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.505+0000 7f2fd67fc700 1 -- 172.21.15.3:0/263964173 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286970 (secure 0 0 0) 0x7f2fe004be40 con 0x7f2fc0060580 2023-10-08T16:08:44.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2fc0060580 msgr2=0x7f2fc0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2fc0060580 0x7f2fc0062a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80039e0 tx=0x7f2fc8007ec0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 msgr2=0x7f2fe00c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c58c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2fe006e070 tx=0x7f2fd0018000 comp rx=0 tx=0).stop 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 shutdown_connections 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2fc0060580 0x7f2fc0062a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2fe00c9860 0x7f2fe014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe00bfce0 0x7f2fe00c58c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 --2- 172.21.15.3:0/263964173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fe00bf910 0x7f2fe00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 >> 172.21.15.3:0/263964173 conn(0x7f2fe006b6b0 msgr2=0x7f2fe006bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 shutdown_connections 2023-10-08T16:08:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.509+0000 7f2fdf59e700 1 -- 172.21.15.3:0/263964173 wait complete. 2023-10-08T16:08:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:08:44.528 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-10-08T16:08:43.859552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387656,"kb_used_data":5256,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587064,"statfs":{"total":773094113280,"available":770649153536,"internally_reserved":0,"allocated":5382144,"data_stored":2844388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002417"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546580+0000","last_change":"2023-10-08T16:08:36.537783+0000","last_active":"2023-10-08T16:08:36.546580+0000","last_peered":"2023-10-08T16:08:36.546580+0000","last_clean":"2023-10-08T16:08:36.546580+0000","last_became_active":"2023-10-08T16:08:36.537482+0000","last_became_peered":"2023-10-08T16:08:36.537482+0000","last_unstale":"2023-10-08T16:08:36.546580+0000","last_undegraded":"2023-10-08T16:08:36.546580+0000","last_fullsized":"2023-10-08T16:08:36.546580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:45.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.561413+0000","last_change":"2023-10-08T16:08:36.560369+0000","last_active":"2023-10-08T16:08:36.561413+0000","last_peered":"2023-10-08T16:08:36.561413+0000","last_clean":"2023-10-08T16:08:36.561413+0000","last_became_active":"2023-10-08T16:08:36.560022+0000","last_became_peered":"2023-10-08T16:08:36.560022+0000","last_unstale":"2023-10-08T16:08:36.561413+0000","last_undegraded":"2023-10-08T16:08:36.561413+0000","last_fullsized":"2023-10-08T16:08:36.561413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:45.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544130+0000","last_change":"2023-10-08T16:08:36.536039+0000","last_active":"2023-10-08T16:08:36.544130+0000","last_peered":"2023-10-08T16:08:36.544130+0000","last_clean":"2023-10-08T16:08:36.544130+0000","last_became_active":"2023-10-08T16:08:36.535764+0000","last_became_peered":"2023-10-08T16:08:36.535764+0000","last_unstale":"2023-10-08T16:08:36.544130+0000","last_undegraded":"2023-10-08T16:08:36.544130+0000","last_fullsized":"2023-10-08T16:08:36.544130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565700+0000","last_change":"2023-10-08T16:08:36.558796+0000","last_active":"2023-10-08T16:08:36.565700+0000","last_peered":"2023-10-08T16:08:36.565700+0000","last_clean":"2023-10-08T16:08:36.565700+0000","last_became_active":"2023-10-08T16:08:36.557899+0000","last_became_peered":"2023-10-08T16:08:36.557899+0000","last_unstale":"2023-10-08T16:08:36.565700+0000","last_undegraded":"2023-10-08T16:08:36.565700+0000","last_fullsized":"2023-10-08T16:08:36.565700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564081+0000","last_change":"2023-10-08T16:08:36.562121+0000","last_active":"2023-10-08T16:08:36.564081+0000","last_peered":"2023-10-08T16:08:36.564081+0000","last_clean":"2023-10-08T16:08:36.564081+0000","last_became_active":"2023-10-08T16:08:36.561724+0000","last_became_peered":"2023-10-08T16:08:36.561724+0000","last_unstale":"2023-10-08T16:08:36.564081+0000","last_undegraded":"2023-10-08T16:08:36.564081+0000","last_fullsized":"2023-10-08T16:08:36.564081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:22.313827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.549069+0000","last_change":"2023-10-08T16:08:36.543247+0000","last_active":"2023-10-08T16:08:36.549069+0000","last_peered":"2023-10-08T16:08:36.549069+0000","last_clean":"2023-10-08T16:08:36.549069+0000","last_became_active":"2023-10-08T16:08:36.541062+0000","last_became_peered":"2023-10-08T16:08:36.541062+0000","last_unstale":"2023-10-08T16:08:36.549069+0000","last_undegraded":"2023-10-08T16:08:36.549069+0000","last_fullsized":"2023-10-08T16:08:36.549069+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:29.287579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547618+0000","last_change":"2023-10-08T16:08:36.544885+0000","last_active":"2023-10-08T16:08:36.547618+0000","last_peered":"2023-10-08T16:08:36.547618+0000","last_clean":"2023-10-08T16:08:36.547618+0000","last_became_active":"2023-10-08T16:08:36.544384+0000","last_became_peered":"2023-10-08T16:08:36.544384+0000","last_unstale":"2023-10-08T16:08:36.547618+0000","last_undegraded":"2023-10-08T16:08:36.547618+0000","last_fullsized":"2023-10-08T16:08:36.547618+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.567129+0000","last_change":"2023-10-08T16:08:36.559729+0000","last_active":"2023-10-08T16:08:36.567129+0000","last_peered":"2023-10-08T16:08:36.567129+0000","last_clean":"2023-10-08T16:08:36.567129+0000","last_became_active":"2023-10-08T16:08:36.557800+0000","last_became_peered":"2023-10-08T16:08:36.557800+0000","last_unstale":"2023-10-08T16:08:36.567129+0000","last_undegraded":"2023-10-08T16:08:36.567129+0000","last_fullsized":"2023-10-08T16:08:36.567129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:21.220985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.567078+0000","last_change":"2023-10-08T16:08:36.560576+0000","last_active":"2023-10-08T16:08:36.567078+0000","last_peered":"2023-10-08T16:08:36.567078+0000","last_clean":"2023-10-08T16:08:36.567078+0000","last_became_active":"2023-10-08T16:08:36.558641+0000","last_became_peered":"2023-10-08T16:08:36.558641+0000","last_unstale":"2023-10-08T16:08:36.567078+0000","last_undegraded":"2023-10-08T16:08:36.567078+0000","last_fullsized":"2023-10-08T16:08:36.567078+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:12.498531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565635+0000","last_change":"2023-10-08T16:08:36.558528+0000","last_active":"2023-10-08T16:08:36.565635+0000","last_peered":"2023-10-08T16:08:36.565635+0000","last_clean":"2023-10-08T16:08:36.565635+0000","last_became_active":"2023-10-08T16:08:36.557743+0000","last_became_peered":"2023-10-08T16:08:36.557743+0000","last_unstale":"2023-10-08T16:08:36.565635+0000","last_undegraded":"2023-10-08T16:08:36.565635+0000","last_fullsized":"2023-10-08T16:08:36.565635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:34.609360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.567103+0000","last_change":"2023-10-08T16:08:36.560769+0000","last_active":"2023-10-08T16:08:36.567103+0000","last_peered":"2023-10-08T16:08:36.567103+0000","last_clean":"2023-10-08T16:08:36.567103+0000","last_became_active":"2023-10-08T16:08:36.557582+0000","last_became_peered":"2023-10-08T16:08:36.557582+0000","last_unstale":"2023-10-08T16:08:36.567103+0000","last_undegraded":"2023-10-08T16:08:36.567103+0000","last_fullsized":"2023-10-08T16:08:36.567103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:06.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545632+0000","last_change":"2023-10-08T16:08:36.541723+0000","last_active":"2023-10-08T16:08:36.545632+0000","last_peered":"2023-10-08T16:08:36.545632+0000","last_clean":"2023-10-08T16:08:36.545632+0000","last_became_active":"2023-10-08T16:08:36.541289+0000","last_became_peered":"2023-10-08T16:08:36.541289+0000","last_unstale":"2023-10-08T16:08:36.545632+0000","last_undegraded":"2023-10-08T16:08:36.545632+0000","last_fullsized":"2023-10-08T16:08:36.545632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551852+0000","last_change":"2023-10-08T16:08:36.543404+0000","last_active":"2023-10-08T16:08:36.551852+0000","last_peered":"2023-10-08T16:08:36.551852+0000","last_clean":"2023-10-08T16:08:36.551852+0000","last_became_active":"2023-10-08T16:08:36.543088+0000","last_became_peered":"2023-10-08T16:08:36.543088+0000","last_unstale":"2023-10-08T16:08:36.551852+0000","last_undegraded":"2023-10-08T16:08:36.551852+0000","last_fullsized":"2023-10-08T16:08:36.551852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:28.131177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.566997+0000","last_change":"2023-10-08T16:08:36.560544+0000","last_active":"2023-10-08T16:08:36.566997+0000","last_peered":"2023-10-08T16:08:36.566997+0000","last_clean":"2023-10-08T16:08:36.566997+0000","last_became_active":"2023-10-08T16:08:36.559502+0000","last_became_peered":"2023-10-08T16:08:36.559502+0000","last_unstale":"2023-10-08T16:08:36.566997+0000","last_undegraded":"2023-10-08T16:08:36.566997+0000","last_fullsized":"2023-10-08T16:08:36.566997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:38.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551411+0000","last_change":"2023-10-08T16:08:36.548706+0000","last_active":"2023-10-08T16:08:36.551411+0000","last_peered":"2023-10-08T16:08:36.551411+0000","last_clean":"2023-10-08T16:08:36.551411+0000","last_became_active":"2023-10-08T16:08:36.548396+0000","last_became_peered":"2023-10-08T16:08:36.548396+0000","last_unstale":"2023-10-08T16:08:36.551411+0000","last_undegraded":"2023-10-08T16:08:36.551411+0000","last_fullsized":"2023-10-08T16:08:36.551411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:10:35.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564127+0000","last_change":"2023-10-08T16:08:36.560263+0000","last_active":"2023-10-08T16:08:36.564127+0000","last_peered":"2023-10-08T16:08:36.564127+0000","last_clean":"2023-10-08T16:08:36.564127+0000","last_became_active":"2023-10-08T16:08:36.559562+0000","last_became_peered":"2023-10-08T16:08:36.559562+0000","last_unstale":"2023-10-08T16:08:36.564127+0000","last_undegraded":"2023-10-08T16:08:36.564127+0000","last_fullsized":"2023-10-08T16:08:36.564127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:06.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545962+0000","last_change":"2023-10-08T16:08:36.540705+0000","last_active":"2023-10-08T16:08:36.545962+0000","last_peered":"2023-10-08T16:08:36.545962+0000","last_clean":"2023-10-08T16:08:36.545962+0000","last_became_active":"2023-10-08T16:08:36.540412+0000","last_became_peered":"2023-10-08T16:08:36.540412+0000","last_unstale":"2023-10-08T16:08:36.545962+0000","last_undegraded":"2023-10-08T16:08:36.545962+0000","last_fullsized":"2023-10-08T16:08:36.545962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:34.609360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564877+0000","last_change":"2023-10-08T16:08:36.561525+0000","last_active":"2023-10-08T16:08:36.564877+0000","last_peered":"2023-10-08T16:08:36.564877+0000","last_clean":"2023-10-08T16:08:36.564877+0000","last_became_active":"2023-10-08T16:08:36.561183+0000","last_became_peered":"2023-10-08T16:08:36.561183+0000","last_unstale":"2023-10-08T16:08:36.564877+0000","last_undegraded":"2023-10-08T16:08:36.564877+0000","last_fullsized":"2023-10-08T16:08:36.564877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.559034+0000","last_change":"2023-10-08T16:08:36.557870+0000","last_active":"2023-10-08T16:08:36.559034+0000","last_peered":"2023-10-08T16:08:36.559034+0000","last_clean":"2023-10-08T16:08:36.559034+0000","last_became_active":"2023-10-08T16:08:36.557424+0000","last_became_peered":"2023-10-08T16:08:36.557424+0000","last_unstale":"2023-10-08T16:08:36.559034+0000","last_undegraded":"2023-10-08T16:08:36.559034+0000","last_fullsized":"2023-10-08T16:08:36.559034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:38.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.566761+0000","last_change":"2023-10-08T16:08:36.561425+0000","last_active":"2023-10-08T16:08:36.566761+0000","last_peered":"2023-10-08T16:08:36.566761+0000","last_clean":"2023-10-08T16:08:36.566761+0000","last_became_active":"2023-10-08T16:08:36.561176+0000","last_became_peered":"2023-10-08T16:08:36.561176+0000","last_unstale":"2023-10-08T16:08:36.566761+0000","last_undegraded":"2023-10-08T16:08:36.566761+0000","last_fullsized":"2023-10-08T16:08:36.566761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:24.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553029+0000","last_change":"2023-10-08T16:08:36.545304+0000","last_active":"2023-10-08T16:08:36.553029+0000","last_peered":"2023-10-08T16:08:36.553029+0000","last_clean":"2023-10-08T16:08:36.553029+0000","last_became_active":"2023-10-08T16:08:36.542670+0000","last_became_peered":"2023-10-08T16:08:36.542670+0000","last_unstale":"2023-10-08T16:08:36.553029+0000","last_undegraded":"2023-10-08T16:08:36.553029+0000","last_fullsized":"2023-10-08T16:08:36.553029+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:52.518200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565796+0000","last_change":"2023-10-08T16:08:36.559310+0000","last_active":"2023-10-08T16:08:36.565796+0000","last_peered":"2023-10-08T16:08:36.565796+0000","last_clean":"2023-10-08T16:08:36.565796+0000","last_became_active":"2023-10-08T16:08:36.558942+0000","last_became_peered":"2023-10-08T16:08:36.558942+0000","last_unstale":"2023-10-08T16:08:36.565796+0000","last_undegraded":"2023-10-08T16:08:36.565796+0000","last_fullsized":"2023-10-08T16:08:36.565796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:24.175187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543105+0000","last_change":"2023-10-08T16:08:36.538289+0000","last_active":"2023-10-08T16:08:36.543105+0000","last_peered":"2023-10-08T16:08:36.543105+0000","last_clean":"2023-10-08T16:08:36.543105+0000","last_became_active":"2023-10-08T16:08:36.537624+0000","last_became_peered":"2023-10-08T16:08:36.537624+0000","last_unstale":"2023-10-08T16:08:36.543105+0000","last_undegraded":"2023-10-08T16:08:36.543105+0000","last_fullsized":"2023-10-08T16:08:36.543105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:50.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542923+0000","last_change":"2023-10-08T16:08:36.536157+0000","last_active":"2023-10-08T16:08:36.542923+0000","last_peered":"2023-10-08T16:08:36.542923+0000","last_clean":"2023-10-08T16:08:36.542923+0000","last_became_active":"2023-10-08T16:08:36.534874+0000","last_became_peered":"2023-10-08T16:08:36.534874+0000","last_unstale":"2023-10-08T16:08:36.542923+0000","last_undegraded":"2023-10-08T16:08:36.542923+0000","last_fullsized":"2023-10-08T16:08:36.542923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:44.701730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543075+0000","last_change":"2023-10-08T16:08:36.537921+0000","last_active":"2023-10-08T16:08:36.543075+0000","last_peered":"2023-10-08T16:08:36.543075+0000","last_clean":"2023-10-08T16:08:36.543075+0000","last_became_active":"2023-10-08T16:08:36.537569+0000","last_became_peered":"2023-10-08T16:08:36.537569+0000","last_unstale":"2023-10-08T16:08:36.543075+0000","last_undegraded":"2023-10-08T16:08:36.543075+0000","last_fullsized":"2023-10-08T16:08:36.543075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:57.098974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551876+0000","last_change":"2023-10-08T16:08:36.542986+0000","last_active":"2023-10-08T16:08:36.551876+0000","last_peered":"2023-10-08T16:08:36.551876+0000","last_clean":"2023-10-08T16:08:36.551876+0000","last_became_active":"2023-10-08T16:08:36.542676+0000","last_became_peered":"2023-10-08T16:08:36.542676+0000","last_unstale":"2023-10-08T16:08:36.551876+0000","last_undegraded":"2023-10-08T16:08:36.551876+0000","last_fullsized":"2023-10-08T16:08:36.551876+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:50.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545874+0000","last_change":"2023-10-08T16:08:36.538099+0000","last_active":"2023-10-08T16:08:36.545874+0000","last_peered":"2023-10-08T16:08:36.545874+0000","last_clean":"2023-10-08T16:08:36.545874+0000","last_became_active":"2023-10-08T16:08:36.537793+0000","last_became_peered":"2023-10-08T16:08:36.537793+0000","last_unstale":"2023-10-08T16:08:36.545874+0000","last_undegraded":"2023-10-08T16:08:36.545874+0000","last_fullsized":"2023-10-08T16:08:36.545874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:21.220985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.545544+0000","last_change":"2023-10-08T16:08:36.541112+0000","last_active":"2023-10-08T16:08:36.545544+0000","last_peered":"2023-10-08T16:08:36.545544+0000","last_clean":"2023-10-08T16:08:36.545544+0000","last_became_active":"2023-10-08T16:08:36.540772+0000","last_became_peered":"2023-10-08T16:08:36.540772+0000","last_unstale":"2023-10-08T16:08:36.545544+0000","last_undegraded":"2023-10-08T16:08:36.545544+0000","last_fullsized":"2023-10-08T16:08:36.545544+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546235+0000","last_change":"2023-10-08T16:08:36.544270+0000","last_active":"2023-10-08T16:08:36.546235+0000","last_peered":"2023-10-08T16:08:36.546235+0000","last_clean":"2023-10-08T16:08:36.546235+0000","last_became_active":"2023-10-08T16:08:36.543763+0000","last_became_peered":"2023-10-08T16:08:36.543763+0000","last_unstale":"2023-10-08T16:08:36.546235+0000","last_undegraded":"2023-10-08T16:08:36.546235+0000","last_fullsized":"2023-10-08T16:08:36.546235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:00.058227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.544097+0000","last_change":"2023-10-08T16:08:36.535436+0000","last_active":"2023-10-08T16:08:36.544097+0000","last_peered":"2023-10-08T16:08:36.544097+0000","last_clean":"2023-10-08T16:08:36.544097+0000","last_became_active":"2023-10-08T16:08:36.535099+0000","last_became_peered":"2023-10-08T16:08:36.535099+0000","last_unstale":"2023-10-08T16:08:36.544097+0000","last_undegraded":"2023-10-08T16:08:36.544097+0000","last_fullsized":"2023-10-08T16:08:36.544097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:20.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553372+0000","last_change":"2023-10-08T16:08:36.549227+0000","last_active":"2023-10-08T16:08:36.553372+0000","last_peered":"2023-10-08T16:08:36.553372+0000","last_clean":"2023-10-08T16:08:36.553372+0000","last_became_active":"2023-10-08T16:08:36.548595+0000","last_became_peered":"2023-10-08T16:08:36.548595+0000","last_unstale":"2023-10-08T16:08:36.553372+0000","last_undegraded":"2023-10-08T16:08:36.553372+0000","last_fullsized":"2023-10-08T16:08:36.553372+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:30.876454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.536735+0000","last_change":"2023-10-08T16:08:36.532009+0000","last_active":"2023-10-08T16:08:36.536735+0000","last_peered":"2023-10-08T16:08:36.536735+0000","last_clean":"2023-10-08T16:08:36.536735+0000","last_became_active":"2023-10-08T16:08:36.531636+0000","last_became_peered":"2023-10-08T16:08:36.531636+0000","last_unstale":"2023-10-08T16:08:36.536735+0000","last_undegraded":"2023-10-08T16:08:36.536735+0000","last_fullsized":"2023-10-08T16:08:36.536735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:15.728719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551190+0000","last_change":"2023-10-08T16:08:36.544956+0000","last_active":"2023-10-08T16:08:36.551190+0000","last_peered":"2023-10-08T16:08:36.551190+0000","last_clean":"2023-10-08T16:08:36.551190+0000","last_became_active":"2023-10-08T16:08:36.544643+0000","last_became_peered":"2023-10-08T16:08:36.544643+0000","last_unstale":"2023-10-08T16:08:36.551190+0000","last_undegraded":"2023-10-08T16:08:36.551190+0000","last_fullsized":"2023-10-08T16:08:36.551190+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.557658+0000","last_change":"2023-10-08T16:08:35.521058+0000","last_active":"2023-10-08T16:08:36.557658+0000","last_peered":"2023-10-08T16:08:36.557658+0000","last_clean":"2023-10-08T16:08:36.557658+0000","last_became_active":"2023-10-08T16:08:35.520522+0000","last_became_peered":"2023-10-08T16:08:35.520522+0000","last_unstale":"2023-10-08T16:08:36.557658+0000","last_undegraded":"2023-10-08T16:08:36.557658+0000","last_fullsized":"2023-10-08T16:08:36.557658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:16.352648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542604+0000","last_change":"2023-10-08T16:08:36.532967+0000","last_active":"2023-10-08T16:08:36.542604+0000","last_peered":"2023-10-08T16:08:36.542604+0000","last_clean":"2023-10-08T16:08:36.542604+0000","last_became_active":"2023-10-08T16:08:36.532686+0000","last_became_peered":"2023-10-08T16:08:36.532686+0000","last_unstale":"2023-10-08T16:08:36.542604+0000","last_undegraded":"2023-10-08T16:08:36.542604+0000","last_fullsized":"2023-10-08T16:08:36.542604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:41.188739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.552904+0000","last_change":"2023-10-08T16:08:35.522115+0000","last_active":"2023-10-08T16:08:36.552904+0000","last_peered":"2023-10-08T16:08:36.552904+0000","last_clean":"2023-10-08T16:08:36.552904+0000","last_became_active":"2023-10-08T16:08:35.521247+0000","last_became_peered":"2023-10-08T16:08:35.521247+0000","last_unstale":"2023-10-08T16:08:36.552904+0000","last_undegraded":"2023-10-08T16:08:36.552904+0000","last_fullsized":"2023-10-08T16:08:36.552904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:59.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547501+0000","last_change":"2023-10-08T16:08:36.546763+0000","last_active":"2023-10-08T16:08:36.547501+0000","last_peered":"2023-10-08T16:08:36.547501+0000","last_clean":"2023-10-08T16:08:36.547501+0000","last_became_active":"2023-10-08T16:08:36.546434+0000","last_became_peered":"2023-10-08T16:08:36.546434+0000","last_unstale":"2023-10-08T16:08:36.547501+0000","last_undegraded":"2023-10-08T16:08:36.547501+0000","last_fullsized":"2023-10-08T16:08:36.547501+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:58.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554530+0000","last_change":"2023-10-08T16:08:35.510252+0000","last_active":"2023-10-08T16:08:36.554530+0000","last_peered":"2023-10-08T16:08:36.554530+0000","last_clean":"2023-10-08T16:08:36.554530+0000","last_became_active":"2023-10-08T16:08:35.509941+0000","last_became_peered":"2023-10-08T16:08:35.509941+0000","last_unstale":"2023-10-08T16:08:36.554530+0000","last_undegraded":"2023-10-08T16:08:36.554530+0000","last_fullsized":"2023-10-08T16:08:36.554530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:48.813733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.550298+0000","last_change":"2023-10-08T16:08:36.544467+0000","last_active":"2023-10-08T16:08:36.550298+0000","last_peered":"2023-10-08T16:08:36.550298+0000","last_clean":"2023-10-08T16:08:36.550298+0000","last_became_active":"2023-10-08T16:08:36.543754+0000","last_became_peered":"2023-10-08T16:08:36.543754+0000","last_unstale":"2023-10-08T16:08:36.550298+0000","last_undegraded":"2023-10-08T16:08:36.550298+0000","last_fullsized":"2023-10-08T16:08:36.550298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:35.943755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554241+0000","last_change":"2023-10-08T16:08:35.517941+0000","last_active":"2023-10-08T16:08:36.554241+0000","last_peered":"2023-10-08T16:08:36.554241+0000","last_clean":"2023-10-08T16:08:36.554241+0000","last_became_active":"2023-10-08T16:08:35.517589+0000","last_became_peered":"2023-10-08T16:08:35.517589+0000","last_unstale":"2023-10-08T16:08:36.554241+0000","last_undegraded":"2023-10-08T16:08:36.554241+0000","last_fullsized":"2023-10-08T16:08:36.554241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:34.933116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543955+0000","last_change":"2023-10-08T16:08:36.532692+0000","last_active":"2023-10-08T16:08:36.543955+0000","last_peered":"2023-10-08T16:08:36.543955+0000","last_clean":"2023-10-08T16:08:36.543955+0000","last_became_active":"2023-10-08T16:08:36.531966+0000","last_became_peered":"2023-10-08T16:08:36.531966+0000","last_unstale":"2023-10-08T16:08:36.543955+0000","last_undegraded":"2023-10-08T16:08:36.543955+0000","last_fullsized":"2023-10-08T16:08:36.543955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:59.729958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558694+0000","last_change":"2023-10-08T16:08:35.522582+0000","last_active":"2023-10-08T16:08:36.558694+0000","last_peered":"2023-10-08T16:08:36.558694+0000","last_clean":"2023-10-08T16:08:36.558694+0000","last_became_active":"2023-10-08T16:08:35.522072+0000","last_became_peered":"2023-10-08T16:08:35.522072+0000","last_unstale":"2023-10-08T16:08:36.558694+0000","last_undegraded":"2023-10-08T16:08:36.558694+0000","last_fullsized":"2023-10-08T16:08:36.558694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:21.303189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565628+0000","last_change":"2023-10-08T16:08:36.558525+0000","last_active":"2023-10-08T16:08:36.565628+0000","last_peered":"2023-10-08T16:08:36.565628+0000","last_clean":"2023-10-08T16:08:36.565628+0000","last_became_active":"2023-10-08T16:08:36.557564+0000","last_became_peered":"2023-10-08T16:08:36.557564+0000","last_unstale":"2023-10-08T16:08:36.565628+0000","last_undegraded":"2023-10-08T16:08:36.565628+0000","last_fullsized":"2023-10-08T16:08:36.565628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.552715+0000","last_change":"2023-10-08T16:08:35.512854+0000","last_active":"2023-10-08T16:08:36.552715+0000","last_peered":"2023-10-08T16:08:36.552715+0000","last_clean":"2023-10-08T16:08:36.552715+0000","last_became_active":"2023-10-08T16:08:35.512528+0000","last_became_peered":"2023-10-08T16:08:35.512528+0000","last_unstale":"2023-10-08T16:08:36.552715+0000","last_undegraded":"2023-10-08T16:08:36.552715+0000","last_fullsized":"2023-10-08T16:08:36.552715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:48.813733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565464+0000","last_change":"2023-10-08T16:08:36.557503+0000","last_active":"2023-10-08T16:08:36.565464+0000","last_peered":"2023-10-08T16:08:36.565464+0000","last_clean":"2023-10-08T16:08:36.565464+0000","last_became_active":"2023-10-08T16:08:36.555665+0000","last_became_peered":"2023-10-08T16:08:36.555665+0000","last_unstale":"2023-10-08T16:08:36.565464+0000","last_undegraded":"2023-10-08T16:08:36.565464+0000","last_fullsized":"2023-10-08T16:08:36.565464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:20.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530062+0000","last_change":"2023-10-08T16:08:35.513155+0000","last_active":"2023-10-08T16:08:36.530062+0000","last_peered":"2023-10-08T16:08:36.530062+0000","last_clean":"2023-10-08T16:08:36.530062+0000","last_became_active":"2023-10-08T16:08:35.512832+0000","last_became_peered":"2023-10-08T16:08:35.512832+0000","last_unstale":"2023-10-08T16:08:36.530062+0000","last_undegraded":"2023-10-08T16:08:36.530062+0000","last_fullsized":"2023-10-08T16:08:36.530062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:40.178100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543121+0000","last_change":"2023-10-08T16:08:36.538419+0000","last_active":"2023-10-08T16:08:36.543121+0000","last_peered":"2023-10-08T16:08:36.543121+0000","last_clean":"2023-10-08T16:08:36.543121+0000","last_became_active":"2023-10-08T16:08:36.538007+0000","last_became_peered":"2023-10-08T16:08:36.538007+0000","last_unstale":"2023-10-08T16:08:36.543121+0000","last_undegraded":"2023-10-08T16:08:36.543121+0000","last_fullsized":"2023-10-08T16:08:36.543121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:35.943755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.527913+0000","last_change":"2023-10-08T16:08:35.520294+0000","last_active":"2023-10-08T16:08:36.527913+0000","last_peered":"2023-10-08T16:08:36.527913+0000","last_clean":"2023-10-08T16:08:36.527913+0000","last_became_active":"2023-10-08T16:08:35.519878+0000","last_became_peered":"2023-10-08T16:08:35.519878+0000","last_unstale":"2023-10-08T16:08:36.527913+0000","last_undegraded":"2023-10-08T16:08:36.527913+0000","last_fullsized":"2023-10-08T16:08:36.527913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:39.424960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564856+0000","last_change":"2023-10-08T16:08:36.561366+0000","last_active":"2023-10-08T16:08:36.564856+0000","last_peered":"2023-10-08T16:08:36.564856+0000","last_clean":"2023-10-08T16:08:36.564856+0000","last_became_active":"2023-10-08T16:08:36.560765+0000","last_became_peered":"2023-10-08T16:08:36.560765+0000","last_unstale":"2023-10-08T16:08:36.564856+0000","last_undegraded":"2023-10-08T16:08:36.564856+0000","last_fullsized":"2023-10-08T16:08:36.564856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.528174+0000","last_change":"2023-10-08T16:08:35.515126+0000","last_active":"2023-10-08T16:08:36.528174+0000","last_peered":"2023-10-08T16:08:36.528174+0000","last_clean":"2023-10-08T16:08:36.528174+0000","last_became_active":"2023-10-08T16:08:35.514743+0000","last_became_peered":"2023-10-08T16:08:35.514743+0000","last_unstale":"2023-10-08T16:08:36.528174+0000","last_undegraded":"2023-10-08T16:08:36.528174+0000","last_fullsized":"2023-10-08T16:08:36.528174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:58.720511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546675+0000","last_change":"2023-10-08T16:08:36.540043+0000","last_active":"2023-10-08T16:08:36.546675+0000","last_peered":"2023-10-08T16:08:36.546675+0000","last_clean":"2023-10-08T16:08:36.546675+0000","last_became_active":"2023-10-08T16:08:36.539758+0000","last_became_peered":"2023-10-08T16:08:36.539758+0000","last_unstale":"2023-10-08T16:08:36.546675+0000","last_undegraded":"2023-10-08T16:08:36.546675+0000","last_fullsized":"2023-10-08T16:08:36.546675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.531156+0000","last_change":"2023-10-08T16:08:35.517701+0000","last_active":"2023-10-08T16:08:36.531156+0000","last_peered":"2023-10-08T16:08:36.531156+0000","last_clean":"2023-10-08T16:08:36.531156+0000","last_became_active":"2023-10-08T16:08:35.517413+0000","last_became_peered":"2023-10-08T16:08:35.517413+0000","last_unstale":"2023-10-08T16:08:36.531156+0000","last_undegraded":"2023-10-08T16:08:36.531156+0000","last_fullsized":"2023-10-08T16:08:36.531156+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:23.956918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546534+0000","last_change":"2023-10-08T16:08:36.542337+0000","last_active":"2023-10-08T16:08:36.546534+0000","last_peered":"2023-10-08T16:08:36.546534+0000","last_clean":"2023-10-08T16:08:36.546534+0000","last_became_active":"2023-10-08T16:08:36.541961+0000","last_became_peered":"2023-10-08T16:08:36.541961+0000","last_unstale":"2023-10-08T16:08:36.546534+0000","last_undegraded":"2023-10-08T16:08:36.546534+0000","last_fullsized":"2023-10-08T16:08:36.546534+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:17.977708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.553971+0000","last_change":"2023-10-08T16:08:35.522105+0000","last_active":"2023-10-08T16:08:36.553971+0000","last_peered":"2023-10-08T16:08:36.553971+0000","last_clean":"2023-10-08T16:08:36.553971+0000","last_became_active":"2023-10-08T16:08:35.521762+0000","last_became_peered":"2023-10-08T16:08:35.521762+0000","last_unstale":"2023-10-08T16:08:36.553971+0000","last_undegraded":"2023-10-08T16:08:36.553971+0000","last_fullsized":"2023-10-08T16:08:36.553971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:56.088335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547778+0000","last_change":"2023-10-08T16:08:36.545190+0000","last_active":"2023-10-08T16:08:36.547778+0000","last_peered":"2023-10-08T16:08:36.547778+0000","last_clean":"2023-10-08T16:08:36.547778+0000","last_became_active":"2023-10-08T16:08:36.543666+0000","last_became_peered":"2023-10-08T16:08:36.543666+0000","last_unstale":"2023-10-08T16:08:36.547778+0000","last_undegraded":"2023-10-08T16:08:36.547778+0000","last_fullsized":"2023-10-08T16:08:36.547778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.563771+0000","last_change":"2023-10-08T16:08:35.516486+0000","last_active":"2023-10-08T16:08:36.563771+0000","last_peered":"2023-10-08T16:08:36.563771+0000","last_clean":"2023-10-08T16:08:36.563771+0000","last_became_active":"2023-10-08T16:08:35.516109+0000","last_became_peered":"2023-10-08T16:08:35.516109+0000","last_unstale":"2023-10-08T16:08:36.563771+0000","last_undegraded":"2023-10-08T16:08:36.563771+0000","last_fullsized":"2023-10-08T16:08:36.563771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:24.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564142+0000","last_change":"2023-10-08T16:08:36.559963+0000","last_active":"2023-10-08T16:08:36.564142+0000","last_peered":"2023-10-08T16:08:36.564142+0000","last_clean":"2023-10-08T16:08:36.564142+0000","last_became_active":"2023-10-08T16:08:36.559511+0000","last_became_peered":"2023-10-08T16:08:36.559511+0000","last_unstale":"2023-10-08T16:08:36.564142+0000","last_undegraded":"2023-10-08T16:08:36.564142+0000","last_fullsized":"2023-10-08T16:08:36.564142+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:49.824371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.562746+0000","last_change":"2023-10-08T16:08:35.523780+0000","last_active":"2023-10-08T16:08:36.562746+0000","last_peered":"2023-10-08T16:08:36.562746+0000","last_clean":"2023-10-08T16:08:36.562746+0000","last_became_active":"2023-10-08T16:08:35.523585+0000","last_became_peered":"2023-10-08T16:08:35.523585+0000","last_unstale":"2023-10-08T16:08:36.562746+0000","last_undegraded":"2023-10-08T16:08:36.562746+0000","last_fullsized":"2023-10-08T16:08:36.562746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:44.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565579+0000","last_change":"2023-10-08T16:08:36.557893+0000","last_active":"2023-10-08T16:08:36.565579+0000","last_peered":"2023-10-08T16:08:36.565579+0000","last_clean":"2023-10-08T16:08:36.565579+0000","last_became_active":"2023-10-08T16:08:36.557458+0000","last_became_peered":"2023-10-08T16:08:36.557458+0000","last_unstale":"2023-10-08T16:08:36.565579+0000","last_undegraded":"2023-10-08T16:08:36.565579+0000","last_fullsized":"2023-10-08T16:08:36.565579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530051+0000","last_change":"2023-10-08T16:08:35.516225+0000","last_active":"2023-10-08T16:08:36.530051+0000","last_peered":"2023-10-08T16:08:36.530051+0000","last_clean":"2023-10-08T16:08:36.530051+0000","last_became_active":"2023-10-08T16:08:35.515923+0000","last_became_peered":"2023-10-08T16:08:35.515923+0000","last_unstale":"2023-10-08T16:08:36.530051+0000","last_undegraded":"2023-10-08T16:08:36.530051+0000","last_fullsized":"2023-10-08T16:08:36.530051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:13.398969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546421+0000","last_change":"2023-10-08T16:08:36.542022+0000","last_active":"2023-10-08T16:08:36.546421+0000","last_peered":"2023-10-08T16:08:36.546421+0000","last_clean":"2023-10-08T16:08:36.546421+0000","last_became_active":"2023-10-08T16:08:36.541615+0000","last_became_peered":"2023-10-08T16:08:36.541615+0000","last_unstale":"2023-10-08T16:08:36.546421+0000","last_undegraded":"2023-10-08T16:08:36.546421+0000","last_fullsized":"2023-10-08T16:08:36.546421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:57.935809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.542449+0000","last_change":"2023-10-08T16:08:35.522655+0000","last_active":"2023-10-08T16:08:36.542449+0000","last_peered":"2023-10-08T16:08:36.542449+0000","last_clean":"2023-10-08T16:08:36.542449+0000","last_became_active":"2023-10-08T16:08:35.522318+0000","last_became_peered":"2023-10-08T16:08:35.522318+0000","last_unstale":"2023-10-08T16:08:36.542449+0000","last_undegraded":"2023-10-08T16:08:36.542449+0000","last_fullsized":"2023-10-08T16:08:36.542449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:20.308296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547604+0000","last_change":"2023-10-08T16:08:36.544673+0000","last_active":"2023-10-08T16:08:36.547604+0000","last_peered":"2023-10-08T16:08:36.547604+0000","last_clean":"2023-10-08T16:08:36.547604+0000","last_became_active":"2023-10-08T16:08:36.543264+0000","last_became_peered":"2023-10-08T16:08:36.543264+0000","last_unstale":"2023-10-08T16:08:36.547604+0000","last_undegraded":"2023-10-08T16:08:36.547604+0000","last_fullsized":"2023-10-08T16:08:36.547604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.561331+0000","last_change":"2023-10-08T16:08:35.519968+0000","last_active":"2023-10-08T16:08:36.561331+0000","last_peered":"2023-10-08T16:08:36.561331+0000","last_clean":"2023-10-08T16:08:36.561331+0000","last_became_active":"2023-10-08T16:08:35.519455+0000","last_became_peered":"2023-10-08T16:08:35.519455+0000","last_unstale":"2023-10-08T16:08:36.561331+0000","last_undegraded":"2023-10-08T16:08:36.561331+0000","last_fullsized":"2023-10-08T16:08:36.561331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:27.120538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551853+0000","last_change":"2023-10-08T16:08:36.539068+0000","last_active":"2023-10-08T16:08:36.551853+0000","last_peered":"2023-10-08T16:08:36.551853+0000","last_clean":"2023-10-08T16:08:36.551853+0000","last_became_active":"2023-10-08T16:08:36.538585+0000","last_became_peered":"2023-10-08T16:08:36.538585+0000","last_unstale":"2023-10-08T16:08:36.551853+0000","last_undegraded":"2023-10-08T16:08:36.551853+0000","last_fullsized":"2023-10-08T16:08:36.551853+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:30.743086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554023+0000","last_change":"2023-10-08T16:08:35.519081+0000","last_active":"2023-10-08T16:08:36.554023+0000","last_peered":"2023-10-08T16:08:36.554023+0000","last_clean":"2023-10-08T16:08:36.554023+0000","last_became_active":"2023-10-08T16:08:35.518676+0000","last_became_peered":"2023-10-08T16:08:35.518676+0000","last_unstale":"2023-10-08T16:08:36.554023+0000","last_undegraded":"2023-10-08T16:08:36.554023+0000","last_fullsized":"2023-10-08T16:08:36.554023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:13.319179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565693+0000","last_change":"2023-10-08T16:08:36.558694+0000","last_active":"2023-10-08T16:08:36.565693+0000","last_peered":"2023-10-08T16:08:36.565693+0000","last_clean":"2023-10-08T16:08:36.565693+0000","last_became_active":"2023-10-08T16:08:36.557406+0000","last_became_peered":"2023-10-08T16:08:36.557406+0000","last_unstale":"2023-10-08T16:08:36.565693+0000","last_undegraded":"2023-10-08T16:08:36.565693+0000","last_fullsized":"2023-10-08T16:08:36.565693+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:32.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555576+0000","last_change":"2023-10-08T16:08:35.513768+0000","last_active":"2023-10-08T16:08:36.555576+0000","last_peered":"2023-10-08T16:08:36.555576+0000","last_clean":"2023-10-08T16:08:36.555576+0000","last_became_active":"2023-10-08T16:08:35.513267+0000","last_became_peered":"2023-10-08T16:08:35.513267+0000","last_unstale":"2023-10-08T16:08:36.555576+0000","last_undegraded":"2023-10-08T16:08:36.555576+0000","last_fullsized":"2023-10-08T16:08:36.555576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:43.691091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.547104+0000","last_change":"2023-10-08T16:08:36.544806+0000","last_active":"2023-10-08T16:08:36.547104+0000","last_peered":"2023-10-08T16:08:36.547104+0000","last_clean":"2023-10-08T16:08:36.547104+0000","last_became_active":"2023-10-08T16:08:36.544479+0000","last_became_peered":"2023-10-08T16:08:36.544479+0000","last_unstale":"2023-10-08T16:08:36.547104+0000","last_undegraded":"2023-10-08T16:08:36.547104+0000","last_fullsized":"2023-10-08T16:08:36.547104+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:24.175187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.554448+0000","last_change":"2023-10-08T16:08:35.510082+0000","last_active":"2023-10-08T16:08:36.554448+0000","last_peered":"2023-10-08T16:08:36.554448+0000","last_clean":"2023-10-08T16:08:36.554448+0000","last_became_active":"2023-10-08T16:08:35.509737+0000","last_became_peered":"2023-10-08T16:08:35.509737+0000","last_unstale":"2023-10-08T16:08:36.554448+0000","last_undegraded":"2023-10-08T16:08:36.554448+0000","last_fullsized":"2023-10-08T16:08:36.554448+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:23.164548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546381+0000","last_change":"2023-10-08T16:08:36.544079+0000","last_active":"2023-10-08T16:08:36.546381+0000","last_peered":"2023-10-08T16:08:36.546381+0000","last_clean":"2023-10-08T16:08:36.546381+0000","last_became_active":"2023-10-08T16:08:36.543716+0000","last_became_peered":"2023-10-08T16:08:36.543716+0000","last_unstale":"2023-10-08T16:08:36.546381+0000","last_undegraded":"2023-10-08T16:08:36.546381+0000","last_fullsized":"2023-10-08T16:08:36.546381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:14.409607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.541680+0000","last_change":"2023-10-08T16:08:35.520720+0000","last_active":"2023-10-08T16:08:36.541680+0000","last_peered":"2023-10-08T16:08:36.541680+0000","last_clean":"2023-10-08T16:08:36.541680+0000","last_became_active":"2023-10-08T16:08:35.520373+0000","last_became_peered":"2023-10-08T16:08:35.520373+0000","last_unstale":"2023-10-08T16:08:36.541680+0000","last_undegraded":"2023-10-08T16:08:36.541680+0000","last_fullsized":"2023-10-08T16:08:36.541680+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:28.856770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546449+0000","last_change":"2023-10-08T16:08:36.541391+0000","last_active":"2023-10-08T16:08:36.546449+0000","last_peered":"2023-10-08T16:08:36.546449+0000","last_clean":"2023-10-08T16:08:36.546449+0000","last_became_active":"2023-10-08T16:08:36.541053+0000","last_became_peered":"2023-10-08T16:08:36.541053+0000","last_unstale":"2023-10-08T16:08:36.546449+0000","last_undegraded":"2023-10-08T16:08:36.546449+0000","last_fullsized":"2023-10-08T16:08:36.546449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:09.801025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.558754+0000","last_change":"2023-10-08T16:08:35.522365+0000","last_active":"2023-10-08T16:08:36.558754+0000","last_peered":"2023-10-08T16:08:36.558754+0000","last_clean":"2023-10-08T16:08:36.558754+0000","last_became_active":"2023-10-08T16:08:35.521727+0000","last_became_peered":"2023-10-08T16:08:35.521727+0000","last_unstale":"2023-10-08T16:08:36.558754+0000","last_undegraded":"2023-10-08T16:08:36.558754+0000","last_fullsized":"2023-10-08T16:08:36.558754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:31.609141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.549846+0000","last_change":"2023-10-08T16:08:36.536639+0000","last_active":"2023-10-08T16:08:36.549846+0000","last_peered":"2023-10-08T16:08:36.549846+0000","last_clean":"2023-10-08T16:08:36.549846+0000","last_became_active":"2023-10-08T16:08:36.536276+0000","last_became_peered":"2023-10-08T16:08:36.536276+0000","last_unstale":"2023-10-08T16:08:36.549846+0000","last_undegraded":"2023-10-08T16:08:36.549846+0000","last_fullsized":"2023-10-08T16:08:36.549846+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:50.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.533029+0000","last_change":"2023-10-08T16:08:35.514659+0000","last_active":"2023-10-08T16:08:36.533029+0000","last_peered":"2023-10-08T16:08:36.533029+0000","last_clean":"2023-10-08T16:08:36.533029+0000","last_became_active":"2023-10-08T16:08:35.514144+0000","last_became_peered":"2023-10-08T16:08:35.514144+0000","last_unstale":"2023-10-08T16:08:36.533029+0000","last_undegraded":"2023-10-08T16:08:36.533029+0000","last_fullsized":"2023-10-08T16:08:36.533029+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:49.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.551624+0000","last_change":"2023-10-08T16:08:36.536849+0000","last_active":"2023-10-08T16:08:36.551624+0000","last_peered":"2023-10-08T16:08:36.551624+0000","last_clean":"2023-10-08T16:08:36.551624+0000","last_became_active":"2023-10-08T16:08:36.536445+0000","last_became_peered":"2023-10-08T16:08:36.536445+0000","last_unstale":"2023-10-08T16:08:36.551624+0000","last_undegraded":"2023-10-08T16:08:36.551624+0000","last_fullsized":"2023-10-08T16:08:36.551624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:42.144819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.528811+0000","last_change":"2023-10-08T16:08:35.519542+0000","last_active":"2023-10-08T16:08:36.528811+0000","last_peered":"2023-10-08T16:08:36.528811+0000","last_clean":"2023-10-08T16:08:36.528811+0000","last_became_active":"2023-10-08T16:08:35.519265+0000","last_became_peered":"2023-10-08T16:08:35.519265+0000","last_unstale":"2023-10-08T16:08:36.528811+0000","last_undegraded":"2023-10-08T16:08:36.528811+0000","last_fullsized":"2023-10-08T16:08:36.528811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:14.718080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565791+0000","last_change":"2023-10-08T16:08:36.559389+0000","last_active":"2023-10-08T16:08:36.565791+0000","last_peered":"2023-10-08T16:08:36.565791+0000","last_clean":"2023-10-08T16:08:36.565791+0000","last_became_active":"2023-10-08T16:08:36.555801+0000","last_became_peered":"2023-10-08T16:08:36.555801+0000","last_unstale":"2023-10-08T16:08:36.565791+0000","last_undegraded":"2023-10-08T16:08:36.565791+0000","last_fullsized":"2023-10-08T16:08:36.565791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:59.729958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529797+0000","last_change":"2023-10-08T16:08:35.518241+0000","last_active":"2023-10-08T16:08:36.529797+0000","last_peered":"2023-10-08T16:08:36.529797+0000","last_clean":"2023-10-08T16:08:36.529797+0000","last_became_active":"2023-10-08T16:08:35.517833+0000","last_became_peered":"2023-10-08T16:08:35.517833+0000","last_unstale":"2023-10-08T16:08:36.529797+0000","last_undegraded":"2023-10-08T16:08:36.529797+0000","last_fullsized":"2023-10-08T16:08:36.529797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:49.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.564108+0000","last_change":"2023-10-08T16:08:36.559842+0000","last_active":"2023-10-08T16:08:36.564108+0000","last_peered":"2023-10-08T16:08:36.564108+0000","last_clean":"2023-10-08T16:08:36.564108+0000","last_became_active":"2023-10-08T16:08:36.559449+0000","last_became_peered":"2023-10-08T16:08:36.559449+0000","last_unstale":"2023-10-08T16:08:36.564108+0000","last_undegraded":"2023-10-08T16:08:36.564108+0000","last_fullsized":"2023-10-08T16:08:36.564108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:59.731149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T16:08:39.335618+0000","last_change":"2023-10-08T16:08:35.522506+0000","last_active":"2023-10-08T16:08:39.335618+0000","last_peered":"2023-10-08T16:08:39.335618+0000","last_clean":"2023-10-08T16:08:39.335618+0000","last_became_active":"2023-10-08T16:08:35.522155+0000","last_became_peered":"2023-10-08T16:08:35.522155+0000","last_unstale":"2023-10-08T16:08:39.335618+0000","last_undegraded":"2023-10-08T16:08:39.335618+0000","last_fullsized":"2023-10-08T16:08:39.335618+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:57.717725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565713+0000","last_change":"2023-10-08T16:08:36.558910+0000","last_active":"2023-10-08T16:08:36.565713+0000","last_peered":"2023-10-08T16:08:36.565713+0000","last_clean":"2023-10-08T16:08:36.565713+0000","last_became_active":"2023-10-08T16:08:36.557485+0000","last_became_peered":"2023-10-08T16:08:36.557485+0000","last_unstale":"2023-10-08T16:08:36.565713+0000","last_undegraded":"2023-10-08T16:08:36.565713+0000","last_fullsized":"2023-10-08T16:08:36.565713+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.531556+0000","last_change":"2023-10-08T16:08:35.521984+0000","last_active":"2023-10-08T16:08:36.531556+0000","last_peered":"2023-10-08T16:08:36.531556+0000","last_clean":"2023-10-08T16:08:36.531556+0000","last_became_active":"2023-10-08T16:08:35.521663+0000","last_became_peered":"2023-10-08T16:08:35.521663+0000","last_unstale":"2023-10-08T16:08:36.531556+0000","last_undegraded":"2023-10-08T16:08:36.531556+0000","last_fullsized":"2023-10-08T16:08:36.531556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:59.047588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.546705+0000","last_change":"2023-10-08T16:08:36.540944+0000","last_active":"2023-10-08T16:08:36.546705+0000","last_peered":"2023-10-08T16:08:36.546705+0000","last_clean":"2023-10-08T16:08:36.546705+0000","last_became_active":"2023-10-08T16:08:36.539103+0000","last_became_peered":"2023-10-08T16:08:36.539103+0000","last_unstale":"2023-10-08T16:08:36.546705+0000","last_undegraded":"2023-10-08T16:08:36.546705+0000","last_fullsized":"2023-10-08T16:08:36.546705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:39.973620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529987+0000","last_change":"2023-10-08T16:08:35.509970+0000","last_active":"2023-10-08T16:08:36.529987+0000","last_peered":"2023-10-08T16:08:36.529987+0000","last_clean":"2023-10-08T16:08:36.529987+0000","last_became_active":"2023-10-08T16:08:35.509612+0000","last_became_peered":"2023-10-08T16:08:35.509612+0000","last_unstale":"2023-10-08T16:08:36.529987+0000","last_undegraded":"2023-10-08T16:08:36.529987+0000","last_fullsized":"2023-10-08T16:08:36.529987+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:58.720511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.549901+0000","last_change":"2023-10-08T16:08:36.545032+0000","last_active":"2023-10-08T16:08:36.549901+0000","last_peered":"2023-10-08T16:08:36.549901+0000","last_clean":"2023-10-08T16:08:36.549901+0000","last_became_active":"2023-10-08T16:08:36.542687+0000","last_became_peered":"2023-10-08T16:08:36.542687+0000","last_unstale":"2023-10-08T16:08:36.549901+0000","last_undegraded":"2023-10-08T16:08:36.549901+0000","last_fullsized":"2023-10-08T16:08:36.549901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:15.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.530314+0000","last_change":"2023-10-08T16:08:35.518326+0000","last_active":"2023-10-08T16:08:36.530314+0000","last_peered":"2023-10-08T16:08:36.530314+0000","last_clean":"2023-10-08T16:08:36.530314+0000","last_became_active":"2023-10-08T16:08:35.517934+0000","last_became_peered":"2023-10-08T16:08:35.517934+0000","last_unstale":"2023-10-08T16:08:36.530314+0000","last_undegraded":"2023-10-08T16:08:36.530314+0000","last_fullsized":"2023-10-08T16:08:36.530314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:37.275172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555329+0000","last_change":"2023-10-08T16:08:36.553155+0000","last_active":"2023-10-08T16:08:36.555329+0000","last_peered":"2023-10-08T16:08:36.555329+0000","last_clean":"2023-10-08T16:08:36.555329+0000","last_became_active":"2023-10-08T16:08:36.552800+0000","last_became_peered":"2023-10-08T16:08:36.552800+0000","last_unstale":"2023-10-08T16:08:36.555329+0000","last_undegraded":"2023-10-08T16:08:36.555329+0000","last_fullsized":"2023-10-08T16:08:36.555329+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:42.781613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.526829+0000","last_change":"2023-10-08T16:08:35.524120+0000","last_active":"2023-10-08T16:08:36.526829+0000","last_peered":"2023-10-08T16:08:36.526829+0000","last_clean":"2023-10-08T16:08:36.526829+0000","last_became_active":"2023-10-08T16:08:35.523720+0000","last_became_peered":"2023-10-08T16:08:35.523720+0000","last_unstale":"2023-10-08T16:08:36.526829+0000","last_undegraded":"2023-10-08T16:08:36.526829+0000","last_fullsized":"2023-10-08T16:08:36.526829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:05.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.543078+0000","last_change":"2023-10-08T16:08:36.538177+0000","last_active":"2023-10-08T16:08:36.543078+0000","last_peered":"2023-10-08T16:08:36.543078+0000","last_clean":"2023-10-08T16:08:36.543078+0000","last_became_active":"2023-10-08T16:08:36.537883+0000","last_became_peered":"2023-10-08T16:08:36.537883+0000","last_unstale":"2023-10-08T16:08:36.543078+0000","last_undegraded":"2023-10-08T16:08:36.543078+0000","last_fullsized":"2023-10-08T16:08:36.543078+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.880747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529918+0000","last_change":"2023-10-08T16:08:35.518176+0000","last_active":"2023-10-08T16:08:36.529918+0000","last_peered":"2023-10-08T16:08:36.529918+0000","last_clean":"2023-10-08T16:08:36.529918+0000","last_became_active":"2023-10-08T16:08:35.517664+0000","last_became_peered":"2023-10-08T16:08:35.517664+0000","last_unstale":"2023-10-08T16:08:36.529918+0000","last_undegraded":"2023-10-08T16:08:36.529918+0000","last_fullsized":"2023-10-08T16:08:36.529918+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:05.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.555489+0000","last_change":"2023-10-08T16:08:36.551479+0000","last_active":"2023-10-08T16:08:36.555489+0000","last_peered":"2023-10-08T16:08:36.555489+0000","last_clean":"2023-10-08T16:08:36.555489+0000","last_became_active":"2023-10-08T16:08:36.551148+0000","last_became_peered":"2023-10-08T16:08:36.551148+0000","last_unstale":"2023-10-08T16:08:36.555489+0000","last_undegraded":"2023-10-08T16:08:36.555489+0000","last_fullsized":"2023-10-08T16:08:36.555489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:17.363286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.528121+0000","last_change":"2023-10-08T16:08:35.522819+0000","last_active":"2023-10-08T16:08:36.528121+0000","last_peered":"2023-10-08T16:08:36.528121+0000","last_clean":"2023-10-08T16:08:36.528121+0000","last_became_active":"2023-10-08T16:08:35.522486+0000","last_became_peered":"2023-10-08T16:08:35.522486+0000","last_unstale":"2023-10-08T16:08:36.528121+0000","last_undegraded":"2023-10-08T16:08:36.528121+0000","last_fullsized":"2023-10-08T16:08:36.528121+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:49.985736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.565560+0000","last_change":"2023-10-08T16:08:36.557866+0000","last_active":"2023-10-08T16:08:36.565560+0000","last_peered":"2023-10-08T16:08:36.565560+0000","last_clean":"2023-10-08T16:08:36.565560+0000","last_became_active":"2023-10-08T16:08:36.557264+0000","last_became_peered":"2023-10-08T16:08:36.557264+0000","last_unstale":"2023-10-08T16:08:36.565560+0000","last_undegraded":"2023-10-08T16:08:36.565560+0000","last_fullsized":"2023-10-08T16:08:36.565560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:35.485037+0000","last_clean_scrub_stamp":"2023-10-08T16:08:35.485037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:29.867409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.556631+0000","last_change":"2023-10-08T16:08:35.520787+0000","last_active":"2023-10-08T16:08:36.556631+0000","last_peered":"2023-10-08T16:08:36.556631+0000","last_clean":"2023-10-08T16:08:36.556631+0000","last_became_active":"2023-10-08T16:08:35.520356+0000","last_became_peered":"2023-10-08T16:08:35.520356+0000","last_unstale":"2023-10-08T16:08:36.556631+0000","last_undegraded":"2023-10-08T16:08:36.556631+0000","last_fullsized":"2023-10-08T16:08:36.556631+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:34.474399+0000","last_clean_scrub_stamp":"2023-10-08T16:08:34.474399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:34.933116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-08T16:08:36.529767+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:08:36.529767+0000","last_peered":"2023-10-08T16:08:36.529767+0000","last_clean":"2023-10-08T16:08:36.529767+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:08:36.529767+0000","last_undegraded":"2023-10-08T16:08:36.529767+0000","last_fullsized":"2023-10-08T16:08:36.529767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1114112,"data_stored":797838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.242,"5min":1.343,"15min":1.343},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2450000000000001,"5min":1.429,"15min":1.429},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.70999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.073}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.71899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1399999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.014,"15min":1.02},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.258,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.115}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.998,"15min":1.008},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2949999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.05},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1399999999999999,"15min":1.149},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.24,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.212}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0860000000000001,"15min":1.107},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.163,"5min":1.492,"15min":1.492},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.1100000000000001,"15min":1.129},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.702,"15min":1.702},"last":1.1559999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.171,"15min":1.1830000000000001},"min":{"1min":0.68100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.355,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2529999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2330000000000001,"15min":1.2450000000000001},"min":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.429,"5min":1.75,"15min":1.75},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1899999999999999,"15min":1.206},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.401,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.3009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297800,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074040,"statfs":{"total":96636764160,"available":96331816960,"internally_reserved":0,"allocated":524288,"data_stored":208024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.99199999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.147,"5min":1.548,"15min":1.548},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.012,"15min":1.0169999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.254,"5min":1.353,"15min":1.353},"last":0.73799999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.339,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.014,"15min":1.004},"min":{"1min":0.69599999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.472,"15min":1.472},"last":1.117}]},{"osd":2,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.97199999999999998,"15min":0.96699999999999997},"min":{"1min":0.73699999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2130000000000001,"5min":1.431,"15min":1.431},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.133,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.429,"5min":2.286,"15min":2.286},"last":1.1639999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.097,"15min":1.111},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2989999999999999,"5min":1.552,"15min":1.552},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.0229999999999999,"15min":1.022},"min":{"1min":0.77300000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0269999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.127,"15min":1.137},"min":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.347,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.246,"15min":1.2490000000000001},"min":{"1min":0.90400000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5389999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2450000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1339999999999999,"15min":1.1319999999999999},"min":{"1min":0.751,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4219999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.196},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.3180000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.5409999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.397,"15min":1.409},"min":{"1min":0.84399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.554,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.339},{"interface":"front","average":{"1min":1.331,"5min":1.3049999999999999,"15min":1.3009999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.591,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.268}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":207450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.302,"5min":1.377,"15min":1.377},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.228,"15min":1.228},"last":1.1200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.22,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3700000000000001,"5min":1.734,"15min":1.734},"last":0.82299999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96299999999999997},"min":{"1min":0.754,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.206,"5min":1.972,"15min":1.972},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.032,"15min":1.048},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.21,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.876}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.077,"15min":1.077},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4710000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.749,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3460000000000001,"5min":2.141,"15min":2.141},"last":1.4179999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.018,"15min":1.038},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.139,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.89000000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7589999999999999,"5min":2.101,"15min":2.101},"last":1.367}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.401,"5min":2.383,"15min":2.383},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.224,"15min":1.248},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.3540000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.3240000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9299999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.591},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.387,"15min":1.405},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4770000000000001,"5min":2.605,"15min":2.605},"last":1.72}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":208916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.75},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":0.95999999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.218}]},{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.159},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.03,"15min":1.0469999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.099,"15min":1.125},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.157,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.84299999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1240000000000001,"15min":1.1479999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.113,"15min":1.127},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.284,"5min":1.607,"15min":1.607},"last":0.95299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.194,"15min":1.226},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.216,"15min":1.2430000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3340000000000001,"5min":1.702,"15min":1.702},"last":1.0429999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.157,"15min":1.1859999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.3640000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.177,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":2.347,"15min":2.347},"last":1.0089999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4810000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.266},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3600000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3680000000000001,"5min":1.95,"15min":1.95},"last":1.0940000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":207990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77100000000000002,"15min":0.76500000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.27,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.103,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.61299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.92900000000000005},"min":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1120000000000001,"5min":1.403,"15min":1.403},"last":0.98699999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.03,"15min":1.024},"min":{"1min":0.79800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5680000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.875},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6659999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.117}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.76500000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.54,"15min":1.54},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.135,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.181}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.85099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5049999999999999,"5min":1.575,"15min":1.575},"last":1.274},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.248},"min":{"1min":0.95999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5529999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.304}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2310000000000001,"15min":1.2270000000000001},"min":{"1min":0.94599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2549999999999999,"15min":1.262},"min":{"1min":0.97399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6180000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.246}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":208938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.69399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88500000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.44400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.034,"5min":1.556,"15min":1.556},"last":0.72299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.504,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1719999999999999,"5min":1.21,"15min":1.21},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.48699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.006,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.038}]},{"osd":3,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.085,"5min":1.272,"15min":1.272},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.67600000000000005,"5min":0.378,"15min":0.378},"max":{"1min":1.3640000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.018,"15min":1.014},"min":{"1min":0.624,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3799999999999999,"5min":1.456,"15min":1.456},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.073,"5min":1.0629999999999999,"15min":1.0609999999999999},"min":{"1min":0.79700000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.90600000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.72999999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.514,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.873},{"interface":"front","average":{"1min":1.202,"5min":1.1910000000000001,"15min":1.1890000000000001},"min":{"1min":0.86299999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.464,"5min":1.792,"15min":1.792},"last":0.93999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1599999999999999,"15min":1.159},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.518,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.80800000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3400000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.69599999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.89300000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.419,"5min":1.534,"15min":1.534},"last":1.103}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":207450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.49299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90700000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.755,"15min":0.74399999999999999},"min":{"1min":0.65900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.67200000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":1.004,"15min":1.004},"last":1.008},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.83699999999999997,"15min":0.83199999999999996},"min":{"1min":0.59199999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0569999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.034}]},{"osd":3,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.69399999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83099999999999996,"15min":0.81699999999999995},"min":{"1min":0.58099999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.21,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.115}]},{"osd":4,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.97699999999999998,"15min":0.97299999999999998},"min":{"1min":0.79700000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.3999999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.222},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.008},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4119999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.117,"15min":1.117},"min":{"1min":0.91900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3580000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.161}]},{"osd":6,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.548,"5min":1.768,"15min":1.768},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.84599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.083}]},{"osd":7,"last update":"Sun Oct 8 16:08:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1659999999999999,"15min":1.1719999999999999},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.339,"5min":1.625,"15min":1.625},"last":1.323},{"interface":"front","average":{"1min":1.22,"5min":1.248,"15min":1.2529999999999999},"min":{"1min":1.022,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6379999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.27}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298376,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073464,"statfs":{"total":96636764160,"available":96331227136,"internally_reserved":0,"allocated":1114112,"data_stored":797782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.54300000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.109,"5min":1.3,"15min":1.3},"last":0.70599999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.266,"15min":1.266},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.91700000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.244,"15min":1.244},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.96699999999999997,"15min":0.96199999999999997},"min":{"1min":0.70299999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3740000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.95899999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0509999999999999,"15min":1.0389999999999999},"min":{"1min":0.78100000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.014},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.98699999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.1299999999999999},"min":{"1min":0.76600000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.667,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.1990000000000001},"min":{"1min":0.95699999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.897,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.0820000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.875,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2450000000000001,"15min":1.234},"min":{"1min":0.94999999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:30 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.238,"15min":1.234},"min":{"1min":0.97999999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.2,"15min":1.1950000000000001},"min":{"1min":1.0209999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.74,"5min":2.008,"15min":2.008},"last":1.175}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:08:44.553 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:08:44.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:08:44.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 Processor -- start 2023-10-08T16:08:44.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 -- start start 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fedec0ce3f0 0x7fedec0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fedec06b640 0x7fedec06d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec06b1b0 con 0x7fedec06dd70 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec06e180 con 0x7fedec0ce3f0 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedf230e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec06a610 con 0x7fedec06b640 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.685+0000 7fedebfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fedec0ce3f0 0x7fedec0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fedec0ce3f0 0x7fedec0ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33578/0 (socket says 172.21.15.3:33578) 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 -- 172.21.15.3:0/3316234674 learned_addr learned my addr 172.21.15.3:0/3316234674 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:44.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedeb7fe700 1 --2- 172.21.15.3:0/3316234674 >> v2:172.21.15.27:3300/0 conn(0x7fedec06b640 0x7fedec06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 -- 172.21.15.3:0/3316234674 >> v2:172.21.15.27:3300/0 conn(0x7fedec06b640 msgr2=0x7fedec06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 --2- 172.21.15.3:0/3316234674 >> v2:172.21.15.27:3300/0 conn(0x7fedec06b640 0x7fedec06d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 -- 172.21.15.3:0/3316234674 >> v1:172.21.15.27:6789/0 conn(0x7fedec06dd70 legacy=0x7fedec0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 -- 172.21.15.3:0/3316234674 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec06a880 con 0x7fedec0ce3f0 2023-10-08T16:08:44.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedeb7fe700 1 --2- 172.21.15.3:0/3316234674 >> v2:172.21.15.27:3300/0 conn(0x7fedec06b640 0x7fedec06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:44.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedebfff700 1 --2- 172.21.15.3:0/3316234674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec0ce3f0 0x7fedec0ce7c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fedec0696e0 tx=0x7fedd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e596d6160d2ae1ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedeaffd700 1 -- 172.21.15.3:0/3316234674 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400b8f0 con 0x7fedec0ce3f0 2023-10-08T16:08:44.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedeaffd700 1 -- 172.21.15.3:0/3316234674 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400ba50 con 0x7fedec0ce3f0 2023-10-08T16:08:44.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedeaffd700 1 -- 172.21.15.3:0/3316234674 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400bdf0 con 0x7fedec0ce3f0 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 -- 172.21.15.3:0/3316234674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec0ce3f0 msgr2=0x7fedec0ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 --2- 172.21.15.3:0/3316234674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec0ce3f0 0x7fedec0ce7c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fedec0696e0 tx=0x7fedd4009250 comp rx=0 tx=0).stop 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 -- 172.21.15.3:0/3316234674 shutdown_connections 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 --2- 172.21.15.3:0/3316234674 >> v2:172.21.15.27:3300/0 conn(0x7fedec06b640 0x7fedec06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 --2- 172.21.15.3:0/3316234674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec0ce3f0 0x7fedec0ce7c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 -- 172.21.15.3:0/3316234674 >> 172.21.15.3:0/3316234674 conn(0x7fedec067af0 msgr2=0x7fedec0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 -- 172.21.15.3:0/3316234674 shutdown_connections 2023-10-08T16:08:44.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.689+0000 7fedf230e700 1 -- 172.21.15.3:0/3316234674 wait complete. 2023-10-08T16:08:44.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 Processor -- start 2023-10-08T16:08:44.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 -- start start 2023-10-08T16:08:44.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedec06b640 0x7fedec154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 0x7fedec157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fedec0ce3f0 0x7fedec157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec15ad40 con 0x7fedec06dd70 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c8580 con 0x7fedec06b640 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec154e60 con 0x7fedec0ce3f0 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 0x7fedec157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 0x7fedec157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33590/0 (socket says 172.21.15.3:33590) 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 -- 172.21.15.3:0/547280008 learned_addr learned my addr 172.21.15.3:0/547280008 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf08ab700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fedec0ce3f0 0x7fedec157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedebfff700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedec06b640 0x7fedec154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 -- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fedec0ce3f0 msgr2=0x7fedec157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fedec0ce3f0 0x7fedec157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 -- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedec06b640 msgr2=0x7fedec154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedec06b640 0x7fedec154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 -- 172.21.15.3:0/547280008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40094f0 con 0x7fedec06dd70 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf08ab700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fedec0ce3f0 0x7fedec157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedeb7fe700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 0x7fedec157900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e900 tx=0x7feddc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc013410 con 0x7fedec06dd70 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc013570 con 0x7fedec06dd70 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc013910 con 0x7fedec06dd70 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec15a4a0 con 0x7fedec06dd70 2023-10-08T16:08:44.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.693+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec15aa60 con 0x7fedec06dd70 2023-10-08T16:08:44.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.697+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec0c8350 con 0x7fedec06dd70 2023-10-08T16:08:44.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.697+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7feddc013d00 con 0x7fedec06dd70 2023-10-08T16:08:44.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.697+0000 7fede3fff700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedcc060580 0x7fedcc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.697+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feddc07c4e0 con 0x7fedec06dd70 2023-10-08T16:08:44.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.697+0000 7fedebfff700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedcc060580 0x7fedcc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.697+0000 7fedebfff700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedcc060580 0x7fedcc062a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedec0696e0 tx=0x7fedd4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.709+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fedec0c8350 con 0x7fedec06dd70 2023-10-08T16:08:44.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.921+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fedec0c8350 con 0x7fedec06dd70 2023-10-08T16:08:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fede3fff700 1 -- 172.21.15.3:0/547280008 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fedec0c8350 con 0x7fedec06dd70 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedcc060580 msgr2=0x7fedcc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedcc060580 0x7fedcc062a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedec0696e0 tx=0x7fedd4017000 comp rx=0 tx=0).stop 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 msgr2=0x7fedec157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 0x7fedec157900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e900 tx=0x7feddc008040 comp rx=0 tx=0).stop 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 shutdown_connections 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fedcc060580 0x7fedcc062a30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fedec0ce3f0 0x7fedec157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedec06dd70 0x7fedec157900 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 --2- 172.21.15.3:0/547280008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedec06b640 0x7fedec154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 >> 172.21.15.3:0/547280008 conn(0x7fedec067af0 msgr2=0x7fedec0c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 shutdown_connections 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:44.933+0000 7fedf230e700 1 -- 172.21.15.3:0/547280008 wait complete. 2023-10-08T16:08:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-10-08T16:08:44.954 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:45.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4db499c700 1 Processor -- start 2023-10-08T16:08:45.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4db499c700 1 -- start start 2023-10-08T16:08:45.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4db499c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4db0159650 0x7f4db0067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4db499c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00677b0 con 0x7f4db006e6b0 2023-10-08T16:08:45.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4db499c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db0067a90 con 0x7f4db0159a20 2023-10-08T16:08:45.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4db499c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db00675a0 con 0x7f4db0159650 2023-10-08T16:08:45.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4daf59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4db006e6b0 0x7f4db00c6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36306/0 (socket says 172.21.15.3:36306) 2023-10-08T16:08:45.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.057+0000 7f4daf59e700 1 -- 172.21.15.3:0/651436843 learned_addr learned my addr 172.21.15.3:0/651436843 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 --2- 172.21.15.3:0/651436843 >> v2:172.21.15.27:3300/0 conn(0x7f4db0159650 0x7f4db0067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612963811 0 0) 0x7f4db00677b0 con 0x7f4db006e6b0 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c003570 con 0x7f4db006e6b0 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609982976 0 0) 0x7f4d9c003570 con 0x7f4db006e6b0 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 >> v2:172.21.15.27:3300/0 conn(0x7f4db0159650 msgr2=0x7f4db0067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 --2- 172.21.15.3:0/651436843 >> v2:172.21.15.27:3300/0 conn(0x7f4db0159650 0x7f4db0067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 >> v1:172.21.15.27:6789/0 conn(0x7f4db0159a20 legacy=0x7f4db006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0067d70 con 0x7f4db006e6b0 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f4da80017f0 con 0x7f4db006e6b0 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 >> v1:172.21.15.3:6789/0 conn(0x7f4db006e6b0 legacy=0x7f4db00c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d9c003a60 0x7f4d9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c004810 0x7f4d9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4d9c0051c0 0x7f4d9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00675a0 con 0x7f4d9c003a60 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c00c080 con 0x7f4d9c004810 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c00c240 con 0x7f4d9c0051c0 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d9c003a60 0x7f4d9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daf59e700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4d9c0051c0 0x7f4d9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dae59c700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c004810 0x7f4d9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 -- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4d9c0051c0 msgr2=0x7f4d9c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4d9c0051c0 0x7f4d9c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 -- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c004810 msgr2=0x7f4d9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c004810 0x7f4d9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 -- 172.21.15.3:0/651436843 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c003570 con 0x7f4d9c003a60 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daf59e700 1 -- 172.21.15.3:0/651436843 reap_dead start 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4daed9d700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d9c003a60 0x7f4d9c003e30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4da0006f00 tx=0x7f4da00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e18854c5f6a9c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000e710 con 0x7f4d9c003a60 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da000e870 con 0x7f4d9c003a60 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4dadd9b700 1 -- 172.21.15.3:0/651436843 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000ec30 con 0x7f4d9c003a60 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 -- 172.21.15.3:0/651436843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d9c003a60 msgr2=0x7f4d9c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d9c003a60 0x7f4d9c003e30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4da0006f00 tx=0x7f4da00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 -- 172.21.15.3:0/651436843 shutdown_connections 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 --2- 172.21.15.3:0/651436843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d9c003a60 0x7f4d9c003e30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 -- 172.21.15.3:0/651436843 >> 172.21.15.3:0/651436843 conn(0x7f4db006ada0 msgr2=0x7f4db006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 -- 172.21.15.3:0/651436843 shutdown_connections 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.061+0000 7f4db499c700 1 -- 172.21.15.3:0/651436843 wait complete. 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.065+0000 7f4db499c700 1 Processor -- start 2023-10-08T16:08:45.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.065+0000 7f4db499c700 1 -- start start 2023-10-08T16:08:45.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c003a60 0x7f4db00aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 0x7f4db00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4db00c6f40 0x7f4db01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db01693f0 con 0x7f4db00c4290 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00aad00 con 0x7f4d9c003a60 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00aafe0 con 0x7f4db00c6f40 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 0x7f4db00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 0x7f4db00c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33600/0 (socket says 172.21.15.3:33600) 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 -- 172.21.15.3:0/3912416904 learned_addr learned my addr 172.21.15.3:0/3912416904 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4daf59e700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4db00c6f40 0x7f4db01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4daed9d700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c003a60 0x7f4db00aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 -- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4db00c6f40 msgr2=0x7f4db01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4db00c6f40 0x7f4db01573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 -- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c003a60 msgr2=0x7f4db00aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c003a60 0x7f4db00aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 -- 172.21.15.3:0/3912416904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00ab2c0 con 0x7f4db00c4290 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4daf59e700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4db00c6f40 0x7f4db01573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4dae59c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 0x7f4db00c6a00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800e5f0 tx=0x7f4d98009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d980115c0 con 0x7f4db00c4290 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98011740 con 0x7f4db00c4290 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db00ab5a0 con 0x7f4db00c4290 2023-10-08T16:08:45.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98011b00 con 0x7f4db00c4290 2023-10-08T16:08:45.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db01578e0 con 0x7f4db00c4290 2023-10-08T16:08:45.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.069+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db004be40 con 0x7f4db00c4290 2023-10-08T16:08:45.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.073+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4d98014480 con 0x7f4db00c4290 2023-10-08T16:08:45.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.073+0000 7f4da6ffd700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4d90060550 0x7f4d90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.073+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d9807c470 con 0x7f4db00c4290 2023-10-08T16:08:45.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.073+0000 7f4daed9d700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4d90060550 0x7f4d90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.073+0000 7f4daed9d700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4d90060550 0x7f4d90062a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4da00091e0 tx=0x7f4da001a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.081+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4d980505a0 con 0x7f4db00c4290 2023-10-08T16:08:45.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.281+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4db0068050 con 0x7f4db00c4290 2023-10-08T16:08:45.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.285+0000 7f4da6ffd700 1 -- 172.21.15.3:0/3912416904 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f4d98019090 con 0x7f4db00c4290 2023-10-08T16:08:45.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:08:45.291 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:08:38.537902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:08:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4d90060550 msgr2=0x7f4d90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4d90060550 0x7f4d90062a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4da00091e0 tx=0x7f4da001a000 comp rx=0 tx=0).stop 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 msgr2=0x7f4db00c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 0x7f4db00c6a00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800e5f0 tx=0x7f4d98009040 comp rx=0 tx=0).stop 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 shutdown_connections 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4d90060550 0x7f4d90062a00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f4db00c6f40 0x7f4db01573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4db00c4290 0x7f4db00c6a00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 --2- 172.21.15.3:0/3912416904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c003a60 0x7f4db00aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 >> 172.21.15.3:0/3912416904 conn(0x7f4db006ada0 msgr2=0x7f4db00abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 shutdown_connections 2023-10-08T16:08:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.289+0000 7f4db499c700 1 -- 172.21.15.3:0/3912416904 wait complete. 2023-10-08T16:08:45.296 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 18 2023-10-08T16:08:45.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:08:35.863860+0000', 'modified': '2023-10-08T16:08:38.537902+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5406}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5406': {'gid': 5406, 'name': 'c', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6837/1848134842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6836', 'nonce': 1848134842}, {'type': 'v1', 'addr': '172.21.15.3:6837', 'nonce': 1848134842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:08:45.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:08:45.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:08:45.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 Processor -- start 2023-10-08T16:08:45.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 -- start start 2023-10-08T16:08:45.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8ce406e0d0 0x7f8ce406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4159a40 0x7f8ce40c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40c9f00 con 0x7f8ce4155830 2023-10-08T16:08:45.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce406c9c0 con 0x7f8ce406e0d0 2023-10-08T16:08:45.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8cea82e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40c8170 con 0x7f8ce4159a40 2023-10-08T16:08:45.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8ce3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8ce406e0d0 0x7f8ce406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4159a40 0x7f8ce40c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8ce8dcb700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8ce4155830 0x7f8ce4155c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:39592/0 (socket says 172.21.15.3:39592) 2023-10-08T16:08:45.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.829+0000 7f8ce8dcb700 1 -- 172.21.15.3:0/3775448891 learned_addr learned my addr 172.21.15.3:0/3775448891 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:45.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4159a40 msgr2=0x7f8ce40c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4159a40 0x7f8ce40c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3775448891 >> v1:172.21.15.27:6789/0 conn(0x7f8ce4155830 legacy=0x7f8ce4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3775448891 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40c8410 con 0x7f8ce406e0d0 2023-10-08T16:08:45.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce2ffd700 1 -- 172.21.15.3:0/3775448891 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503583947 0 0) 0x7f8ce40c9f00 con 0x7f8ce4155830 2023-10-08T16:08:45.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4159a40 0x7f8ce40c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:45.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce406e0d0 0x7f8ce406e4a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40098d0 tx=0x7f8cd4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77453b7ae774e524 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce2ffd700 1 -- 172.21.15.3:0/3775448891 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4005c10 con 0x7f8ce406e0d0 2023-10-08T16:08:45.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce2ffd700 1 -- 172.21.15.3:0/3775448891 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4005d70 con 0x7f8ce406e0d0 2023-10-08T16:08:45.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8ce2ffd700 1 -- 172.21.15.3:0/3775448891 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4006280 con 0x7f8ce406e0d0 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 -- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce406e0d0 msgr2=0x7f8ce406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 --2- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce406e0d0 0x7f8ce406e4a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40098d0 tx=0x7f8cd4009120 comp rx=0 tx=0).stop 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 -- 172.21.15.3:0/3775448891 shutdown_connections 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 --2- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4159a40 0x7f8ce40c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 --2- 172.21.15.3:0/3775448891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce406e0d0 0x7f8ce406e4a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 -- 172.21.15.3:0/3775448891 >> 172.21.15.3:0/3775448891 conn(0x7f8ce40c8da0 msgr2=0x7f8ce40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 -- 172.21.15.3:0/3775448891 shutdown_connections 2023-10-08T16:08:45.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.833+0000 7f8cea82e700 1 -- 172.21.15.3:0/3775448891 wait complete. 2023-10-08T16:08:45.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 Processor -- start 2023-10-08T16:08:45.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 -- start start 2023-10-08T16:08:45.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 0x7f8ce4168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4155830 0x7f8ce416b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce4159a40 0x7f8ce40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4152e70 con 0x7f8ce406e0d0 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce416b660 con 0x7f8ce4159a40 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8cea82e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce416b900 con 0x7f8ce4155830 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 0x7f8ce4168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 0x7f8ce4168680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33606/0 (socket says 172.21.15.3:33606) 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 -- 172.21.15.3:0/962330206 learned_addr learned my addr 172.21.15.3:0/962330206 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4155830 0x7f8ce416b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce4159a40 0x7f8ce40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 -- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4155830 msgr2=0x7f8ce416b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4155830 0x7f8ce416b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 -- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce4159a40 msgr2=0x7f8ce40cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce4159a40 0x7f8ce40cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 -- 172.21.15.3:0/962330206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009420 con 0x7f8ce406e0d0 2023-10-08T16:08:45.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce4159a40 0x7f8ce40cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:45.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.837+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 0x7f8ce4168680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009f70 tx=0x7f8cd4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ccbfff700 1 -- 172.21.15.3:0/962330206 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd401d880 con 0x7f8ce406e0d0 2023-10-08T16:08:45.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ccbfff700 1 -- 172.21.15.3:0/962330206 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd401da00 con 0x7f8ce406e0d0 2023-10-08T16:08:45.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd40093c0 con 0x7f8ce406e0d0 2023-10-08T16:08:45.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ccbfff700 1 -- 172.21.15.3:0/962330206 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd401ddc0 con 0x7f8ce406e0d0 2023-10-08T16:08:45.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce416bec0 con 0x7f8ce406e0d0 2023-10-08T16:08:45.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ccbfff700 1 -- 172.21.15.3:0/962330206 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8cd401b690 con 0x7f8ce406e0d0 2023-10-08T16:08:45.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ccbfff700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8cd0060550 0x7f8cd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8cd0060550 0x7f8cd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.841+0000 7f8ccbfff700 1 -- 172.21.15.3:0/962330206 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cd407e550 con 0x7f8ce406e0d0 2023-10-08T16:08:45.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8cd0060550 0x7f8cd0062a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80093f0 tx=0x7f8cd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 Processor -- start 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 -- start start 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2ae0 0x2334500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x2334a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20fd790 0x2334f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x225df30 con 0x20b2710 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x2259ed0 con 0x20fd790 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.845+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x22200b0 con 0x20b2ae0 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x2334a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x2334a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33614/0 (socket says 172.21.15.3:33614) 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2ae0 0x2334500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2348150912 learned_addr learned my addr 172.21.15.3:0/2348150912 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20fd790 0x2334f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2ae0 msgr2=0x2334500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2ae0 0x2334500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20fd790 msgr2=0x2334f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20fd790 0x2334f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 -- 172.21.15.3:0/2348150912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20fe9e0 con 0x20b2710 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20fd790 0x2334f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x2334a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8011f30 tx=0x7f8cd8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea66f741f24e01a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cc97fa700 1 -- 172.21.15.3:0/2348150912 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8015c60 con 0x20b2710 2023-10-08T16:08:45.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cc97fa700 1 -- 172.21.15.3:0/2348150912 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8015dc0 con 0x20b2710 2023-10-08T16:08:45.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cc97fa700 1 -- 172.21.15.3:0/2348150912 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8021440 con 0x20b2710 2023-10-08T16:08:45.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 -- 172.21.15.3:0/2348150912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 msgr2=0x2334a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x2334a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8011f30 tx=0x7f8cd8018000 comp rx=0 tx=0).stop 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 -- 172.21.15.3:0/2348150912 shutdown_connections 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20fd790 0x2334f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x2334a40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2348150912 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2ae0 0x2334500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 -- 172.21.15.3:0/2348150912 >> 172.21.15.3:0/2348150912 conn(0x20b2eb0 msgr2=0x22ec930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 -- 172.21.15.3:0/2348150912 shutdown_connections 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 -- 172.21.15.3:0/2348150912 wait complete. 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.849+0000 7f8cecad7740 1 -- start start 2023-10-08T16:08:45.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 Processor -- start 2023-10-08T16:08:45.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2710 0x22ec860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x2315cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 0x23161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x221fd50 con 0x20fd790 2023-10-08T16:08:45.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x21f8970 con 0x20b2ae0 2023-10-08T16:08:45.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x2222920 con 0x20b2710 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 10 client.0 _ll_register_callbacks cb 0x22a36a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 0x23161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce3fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2710 0x22ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 0x23161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33626/0 (socket says 172.21.15.3:33626) 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 -- 172.21.15.3:0/2485723388 learned_addr learned my addr 172.21.15.3:0/2485723388 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x2315cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 -- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2710 msgr2=0x22ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2710 0x22ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 -- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 msgr2=0x2315cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x2315cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 -- 172.21.15.3:0/2485723388 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8011b60 con 0x20fd790 2023-10-08T16:08:45.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 0x23161f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0078c0 tx=0x7f8cdc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ef55ca3215e1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cc27fc700 1 -- 172.21.15.3:0/2485723388 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc004bb0 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cc27fc700 1 -- 172.21.15.3:0/2485723388 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cdc004d10 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21f8cc0 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cc27fc700 1 -- 172.21.15.3:0/2485723388 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cdc010bc0 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 10 client.5565 fetch_fsmap learned FSMap version 18 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x2228370 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.853+0000 7f8cc27fc700 1 -- 172.21.15.3:0/2485723388 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21f8cc0 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cc27fc700 1 -- 172.21.15.3:0/2485723388 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8cdc010d20 con 0x20fd790 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 10 client.5565 fetch_fsmap finished waiting for FSMap version 18 2023-10-08T16:08:45.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 10 client.5565 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:08:45.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 20 client.5565 populate_metadata read hostname 'smithi003' 2023-10-08T16:08:45.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2338a30 0x2338e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 4 client.5565 mds_command: new command op to 5406 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:08:45.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 --> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21fc3e0 con 0x2338a30 2023-10-08T16:08:45.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2338a30 0x2338e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2338a30 0x2338e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58147a717094da41 server_cookie=62e43b1ce03a596b in_seq=0 out_seq=0 2023-10-08T16:08:45.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cc27fc700 10 client.5565 ms_handle_connect on v2:172.21.15.3:6836/1848134842 2023-10-08T16:08:45.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cc27fc700 1 -- 172.21.15.3:0/2485723388 <== mds.0 v2:172.21.15.3:6836/1848134842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x21fc3e0 con 0x2338a30 2023-10-08T16:08:45.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cc27fc700 10 client.5565 handle_command_reply: tid=0 2023-10-08T16:08:45.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 client.5565 shutdown 2023-10-08T16:08:45.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 msgr2=0x23161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 0x23161f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0078c0 tx=0x7f8cdc009040 comp rx=0 tx=0).stop 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 shutdown_connections 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2338a30 0x2338e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20fd790 0x23161f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x2315cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 --2- 172.21.15.3:0/2485723388 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20b2710 0x22ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 >> 172.21.15.3:0/2485723388 conn(0x20b2eb0 msgr2=0x22e86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cc27fc700 0 client.5565 ms_handle_reset on v2:172.21.15.3:6836/1848134842 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 shutdown_connections 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 1 -- 172.21.15.3:0/2485723388 wait complete. 2023-10-08T16:08:45.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.857+0000 7f8cecad7740 20 client.5565 trim_cache size 0 max 16384 2023-10-08T16:08:45.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 Processor -- start 2023-10-08T16:08:45.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 -- start start 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2710 0x2337520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 0x2337a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x22ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2257890 con 0x20b2ae0 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x225a770 con 0x20b2710 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x2203510 con 0x20fd790 2023-10-08T16:08:45.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 0x2337a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 0x2337a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33628/0 (socket says 172.21.15.3:33628) 2023-10-08T16:08:45.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 -- 172.21.15.3:0/3028393738 learned_addr learned my addr 172.21.15.3:0/3028393738 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:45.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2710 0x2337520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x22ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 -- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 msgr2=0x22ea6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x22ea6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 -- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2710 msgr2=0x2337520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2710 0x2337520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 -- 172.21.15.3:0/3028393738 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x220ed80 con 0x20b2ae0 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2710 0x2337520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:45.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 0x2337a60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8011dd0 tx=0x7f8cd801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d71dc60c6afb6e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cc9ffb700 1 -- 172.21.15.3:0/3028393738 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8030070 con 0x20b2ae0 2023-10-08T16:08:45.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cc9ffb700 1 -- 172.21.15.3:0/3028393738 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8021440 con 0x20b2ae0 2023-10-08T16:08:45.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.881+0000 7f8cc9ffb700 1 -- 172.21.15.3:0/3028393738 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8021a80 con 0x20b2ae0 2023-10-08T16:08:45.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 -- 172.21.15.3:0/3028393738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 msgr2=0x2337a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 0x2337a60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8011dd0 tx=0x7f8cd801b000 comp rx=0 tx=0).stop 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 -- 172.21.15.3:0/3028393738 shutdown_connections 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x22ea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2ae0 0x2337a60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3028393738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2710 0x2337520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 -- 172.21.15.3:0/3028393738 >> 172.21.15.3:0/3028393738 conn(0x20b2eb0 msgr2=0x2315f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 -- 172.21.15.3:0/3028393738 shutdown_connections 2023-10-08T16:08:45.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 -- 172.21.15.3:0/3028393738 wait complete. 2023-10-08T16:08:45.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 -- start start 2023-10-08T16:08:45.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.885+0000 7f8cecad7740 1 Processor -- start 2023-10-08T16:08:45.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x238df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x238e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x2344a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x225eef0 con 0x20b2710 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x220b550 con 0x20b2ae0 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d4410 con 0x20fd790 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 10 client.0 _ll_register_callbacks cb 0x207e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x238df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x238df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33636/0 (socket says 172.21.15.3:33636) 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3963554278 learned_addr learned my addr 172.21.15.3:0/3963554278 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce8dcb700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x2344a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x238e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 msgr2=0x2344a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x2344a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 msgr2=0x238e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x238e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 -- 172.21.15.3:0/3963554278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce416bec0 con 0x20b2710 2023-10-08T16:08:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce3fff700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x238df70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40526f0 tx=0x7f8cd4030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44eda5fb88daa04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T16:08:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cc27fc700 1 -- 172.21.15.3:0/3963554278 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4050970 con 0x20b2710 2023-10-08T16:08:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cc27fc700 1 -- 172.21.15.3:0/3963554278 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cd4050b00 con 0x20b2710 2023-10-08T16:08:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cd8015dc0 con 0x20b2710 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cc27fc700 1 -- 172.21.15.3:0/3963554278 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cd4051e60 con 0x20b2710 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 10 client.5571 fetch_fsmap learned FSMap version 18 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x20fe9e0 con 0x20b2710 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cc27fc700 1 -- 172.21.15.3:0/3963554278 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8015dc0 con 0x20b2710 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cc27fc700 1 -- 172.21.15.3:0/3963554278 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8cd40592b0 con 0x20b2710 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 10 client.5571 fetch_fsmap finished waiting for FSMap version 18 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 10 client.5571 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 20 client.5571 populate_metadata read hostname 'smithi003' 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2394e00 0x23971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 4 client.5571 mds_command: new command op to 5406 tid=0[{"prefix": "status"}] 2023-10-08T16:08:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 --> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] -- command(tid 0: {"prefix": "status"}) v1 -- 0x222e410 con 0x2394e00 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.889+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2394e00 0x23971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cc27fc700 10 client.5571 ms_handle_connect on v2:172.21.15.3:6836/1848134842 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8ce37fe700 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2394e00 0x23971e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fecc64c03ebf105 server_cookie=dfc7d74572f0409f in_seq=0 out_seq=0 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cc27fc700 1 -- 172.21.15.3:0/3963554278 <== mds.0 v2:172.21.15.3:6836/1848134842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x222e410 con 0x2394e00 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cc27fc700 10 client.5571 handle_command_reply: tid=0 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 client.5571 shutdown 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 msgr2=0x238df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x238df70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40526f0 tx=0x7f8cd4030040 comp rx=0 tx=0).stop 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 shutdown_connections 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:6836/1848134842,v1:172.21.15.3:6837/1848134842] conn(0x2394e00 0x23971e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x20fd790 0x2344a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cc27fc700 0 client.5571 ms_handle_reset on v2:172.21.15.3:6836/1848134842 2023-10-08T16:08:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x20b2ae0 0x238e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 --2- 172.21.15.3:0/3963554278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x20b2710 0x238df70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 >> 172.21.15.3:0/3963554278 conn(0x20b2eb0 msgr2=0x2332ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 shutdown_connections 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 1 -- 172.21.15.3:0/3963554278 wait complete. 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cecad7740 20 client.5571 trim_cache size 0 max 16384 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3007c8b5-937d-4f26-8e83-7370fb7a9cb4", 2023-10-08T16:08:45.901 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5406, 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 9.3610958360000005, 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 18, 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 44, 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 44, 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 14.618114024 2023-10-08T16:08:45.902 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:08:45.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8cd0060550 msgr2=0x7f8cd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8cd0060550 0x7f8cd0062a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80093f0 tx=0x7f8cd8008040 comp rx=0 tx=0).stop 2023-10-08T16:08:45.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 msgr2=0x7f8ce4168680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 0x7f8ce4168680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009f70 tx=0x7f8cd4016000 comp rx=0 tx=0).stop 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 shutdown_connections 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8cd0060550 0x7f8cd0062a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ce4159a40 0x7f8ce40cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ce4155830 0x7f8ce416b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 --2- 172.21.15.3:0/962330206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ce406e0d0 0x7f8ce4168680 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 >> 172.21.15.3:0/962330206 conn(0x7f8ce40c8da0 msgr2=0x7f8ce40c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 shutdown_connections 2023-10-08T16:08:45.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:45.893+0000 7f8cea82e700 1 -- 172.21.15.3:0/962330206 wait complete. 2023-10-08T16:08:45.916 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:08:46.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c6135d700 1 Processor -- start 2023-10-08T16:08:46.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c6135d700 1 -- start start 2023-10-08T16:08:46.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c6135d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3c5c06ab00 0x7f3c5c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c6135d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c06cae0 con 0x7f3c5c0ca810 2023-10-08T16:08:46.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c6135d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c06cdc0 con 0x7f3c5c0adc30 2023-10-08T16:08:46.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c6135d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c06d0a0 con 0x7f3c5c06ab00 2023-10-08T16:08:46.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3c5c0ca810 0x7f3c5c0c68e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:36310/0 (socket says 172.21.15.3:36310) 2023-10-08T16:08:46.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5b7fe700 1 -- 172.21.15.3:0/1344715347 learned_addr learned my addr 172.21.15.3:0/1344715347 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:46.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5a7fc700 1 --2- 172.21.15.3:0/1344715347 >> v2:172.21.15.27:3300/0 conn(0x7f3c5c06ab00 0x7f3c5c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c59ffb700 1 -- 172.21.15.3:0/1344715347 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678575837 0 0) 0x7f3c5c06cae0 con 0x7f3c5c0ca810 2023-10-08T16:08:46.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c59ffb700 1 -- 172.21.15.3:0/1344715347 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c48003570 con 0x7f3c5c0ca810 2023-10-08T16:08:46.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/1344715347 >> v1:172.21.15.27:6789/0 conn(0x7f3c5c0adc30 legacy=0x7f3c5c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/1344715347 >> v1:172.21.15.3:6789/0 conn(0x7f3c5c0ca810 legacy=0x7f3c5c0c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/1344715347 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c06d380 con 0x7f3c5c06ab00 2023-10-08T16:08:46.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.021+0000 7f3c5a7fc700 1 --2- 172.21.15.3:0/1344715347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c06ab00 0x7f3c5c06db80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0098e0 tx=0x7f3c4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603477d8a8801902 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:46.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c59ffb700 1 -- 172.21.15.3:0/1344715347 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00b640 con 0x7f3c5c06ab00 2023-10-08T16:08:46.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c59ffb700 1 -- 172.21.15.3:0/1344715347 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00b7a0 con 0x7f3c5c06ab00 2023-10-08T16:08:46.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c59ffb700 1 -- 172.21.15.3:0/1344715347 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00bb40 con 0x7f3c5c06ab00 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 -- 172.21.15.3:0/1344715347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c06ab00 msgr2=0x7f3c5c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 --2- 172.21.15.3:0/1344715347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c06ab00 0x7f3c5c06db80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0098e0 tx=0x7f3c4c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 -- 172.21.15.3:0/1344715347 shutdown_connections 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 --2- 172.21.15.3:0/1344715347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c06ab00 0x7f3c5c06db80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 -- 172.21.15.3:0/1344715347 >> 172.21.15.3:0/1344715347 conn(0x7f3c5c0cc5d0 msgr2=0x7f3c5c0c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 -- 172.21.15.3:0/1344715347 shutdown_connections 2023-10-08T16:08:46.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.025+0000 7f3c6135d700 1 -- 172.21.15.3:0/1344715347 wait complete. 2023-10-08T16:08:46.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 Processor -- start 2023-10-08T16:08:46.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 -- start start 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c0adc30 0x7f3c5c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 0x7f3c5c0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c5c0c4b30 0x7f3c5c171580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c172520 con 0x7f3c5c0ca810 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0c4160 con 0x7f3c5c0adc30 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c16e9b0 con 0x7f3c5c0c4b30 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 0x7f3c5c0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 0x7f3c5c0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33652/0 (socket says 172.21.15.3:33652) 2023-10-08T16:08:46.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/3118288848 learned_addr learned my addr 172.21.15.3:0/3118288848 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5affd700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c0adc30 0x7f3c5c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5b7fe700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c5c0c4b30 0x7f3c5c171580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c5c0c4b30 msgr2=0x7f3c5c171580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c5c0c4b30 0x7f3c5c171580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c0adc30 msgr2=0x7f3c5c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c0adc30 0x7f3c5c15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 -- 172.21.15.3:0/3118288848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c009420 con 0x7f3c5c0ca810 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5affd700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c0adc30 0x7f3c5c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5b7fe700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c5c0c4b30 0x7f3c5c171580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c5a7fc700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 0x7f3c5c0c45f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0097b0 tx=0x7f3c4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:46.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00bb20 con 0x7f3c5c0ca810 2023-10-08T16:08:46.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c011420 con 0x7f3c5c0ca810 2023-10-08T16:08:46.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c171f60 con 0x7f3c5c0ca810 2023-10-08T16:08:46.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0117e0 con 0x7f3c5c0ca810 2023-10-08T16:08:46.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.029+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0c3df0 con 0x7f3c5c0ca810 2023-10-08T16:08:46.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.033+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c0c3c50 con 0x7f3c5c0ca810 2023-10-08T16:08:46.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.033+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3c4c011b90 con 0x7f3c5c0ca810 2023-10-08T16:08:46.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.033+0000 7f3c52ffd700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c3c060550 0x7f3c3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.033+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c4c07e080 con 0x7f3c5c0ca810 2023-10-08T16:08:46.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.033+0000 7f3c5affd700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c3c060550 0x7f3c3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.033+0000 7f3c5affd700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c3c060550 0x7f3c3c062a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c44007fd0 tx=0x7f3c44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:46.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.045+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3c5c0c3c50 con 0x7f3c5c0ca810 2023-10-08T16:08:46.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c5c0c3c50 con 0x7f3c5c0ca810 2023-10-08T16:08:46.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c52ffd700 1 -- 172.21.15.3:0/3118288848 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3c5c0c3c50 con 0x7f3c5c0ca810 2023-10-08T16:08:46.250 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:08:46.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c3c060550 msgr2=0x7f3c3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c3c060550 0x7f3c3c062a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c44007fd0 tx=0x7f3c44009040 comp rx=0 tx=0).stop 2023-10-08T16:08:46.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 msgr2=0x7f3c5c0c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 0x7f3c5c0c45f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0097b0 tx=0x7f3c4c017000 comp rx=0 tx=0).stop 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 shutdown_connections 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c3c060550 0x7f3c3c062a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c5c0c4b30 0x7f3c5c171580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c5c0ca810 0x7f3c5c0c45f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 --2- 172.21.15.3:0/3118288848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c5c0adc30 0x7f3c5c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 >> 172.21.15.3:0/3118288848 conn(0x7f3c5c0cc5d0 msgr2=0x7f3c5c0c0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 shutdown_connections 2023-10-08T16:08:46.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:46.245+0000 7f3c6135d700 1 -- 172.21.15.3:0/3118288848 wait complete. 2023-10-08T16:08:46.264 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:08:46.265 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:08:46.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:46.265 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-10-08T16:08:46.273 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:08:46.273 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:08:46.273 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42390sec preferred_lft 42390sec 2023-10-08T16:08:46.274 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:23:c8:a3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.275 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec2d:51ff:fe60:39b2/64 scope link 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::10d3:e4ff:fe73:f282/64 scope link 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether be:9c:c5:92:be:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::bc9c:c5ff:fe92:be4a/64 scope link 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:46.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:46.277 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:08:46.331 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-10-08T16:08:46.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:46.333 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-10-08T16:08:46.340 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-10-08T16:08:46.340 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:08:46.340 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:08:46.340 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:08:46.340 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:08:46.340 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:08:46.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:08:46.341 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:46.377 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:08:46.427 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:08:46.427 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:08:46.428 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:08:46.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:46.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-10-08T16:08:46.443 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T16:08:46.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:08:46.443 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:46.449 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:08:46.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:08:46.450 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:46.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:08:46.468 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:46.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:46.483 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:46.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:46.484 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:08:46.535 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:08:46.536 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T16:08:46.538 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:08:46.555 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:46.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:46.612 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:46.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:46.613 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:08:46.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-10-08T16:08:46.617+0000 7fdd303a2380 -1 init, newargv = 0x5575f0783130 newargc=15 2023-10-08T16:08:46.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44541]: starting ceph client 2023-10-08T16:08:46.631 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44541]: starting fuse 2023-10-08T16:08:47.718 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:08:47.738 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:47.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:47.797 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:47.798 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:47.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:47.798 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:08:47.805 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:08:47.805 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T16:08:47.806 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-10-08T16:08:47.807 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:08:47.808 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:47.808 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-10-08T16:08:47.808 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:08:47.888 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.44541.asok 2023-10-08T16:08:48.071 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44541.asok 2023-10-08T16:08:48.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:48.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44541.asok status 2023-10-08T16:08:48.209 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:08:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "44541", 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5583, 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 5583 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1186398630 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1186398630 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.5583 192.168.0.1:0/1186398630", 2023-10-08T16:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/1186398630", 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 18, 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 44, 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-10-08T16:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:08:48.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:48.218 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-10-08T16:08:48.218 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:48.226 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-10-08T16:08:48.226 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:48.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:48.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:48.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:08:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.385+0000 7f8b4b59e700 1 Processor -- start 2023-10-08T16:08:48.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.385+0000 7f8b4b59e700 1 -- start start 2023-10-08T16:08:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0ae230 0x7f8b4c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8b4c0c7ba0 0x7f8b4c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c1562c0 con 0x7f8b4c0ade60 2023-10-08T16:08:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c06b0b0 con 0x7f8b4c0c7ba0 2023-10-08T16:08:48.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c06b390 con 0x7f8b4c0ae230 2023-10-08T16:08:48.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8b4c0c7ba0 0x7f8b4c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b49d9b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0ae230 0x7f8b4c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8b4c0ade60 0x7f8b4c0cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:39610/0 (socket says 172.21.15.3:39610) 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4a59c700 1 -- 172.21.15.3:0/355444553 learned_addr learned my addr 172.21.15.3:0/355444553 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b49d9b700 1 --2- 172.21.15.3:0/355444553 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0ae230 0x7f8b4c0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:60462/0 (socket says 172.21.15.3:60462) 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8b4c0c7ba0 0x7f8b4c0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33654/0 (socket says 172.21.15.3:33654) 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4959a700 1 -- 172.21.15.3:0/355444553 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338846794 0 0) 0x7f8b4c1562c0 con 0x7f8b4c0ade60 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4959a700 1 -- 172.21.15.3:0/355444553 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b38003570 con 0x7f8b4c0ade60 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 -- 172.21.15.3:0/355444553 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0ae230 msgr2=0x7f8b4c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 --2- 172.21.15.3:0/355444553 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0ae230 0x7f8b4c0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 -- 172.21.15.3:0/355444553 >> v1:172.21.15.27:6789/0 conn(0x7f8b4c0ade60 legacy=0x7f8b4c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 -- 172.21.15.3:0/355444553 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c06b670 con 0x7f8b4c0c7ba0 2023-10-08T16:08:48.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4ad9d700 1 --2- 172.21.15.3:0/355444553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0ae870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098e0 tx=0x7f8b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67ea5762f4a9234 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4959a700 1 -- 172.21.15.3:0/355444553 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011630 con 0x7f8b4c0c7ba0 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4959a700 1 -- 172.21.15.3:0/355444553 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44011790 con 0x7f8b4c0c7ba0 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4959a700 1 -- 172.21.15.3:0/355444553 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011b10 con 0x7f8b4c0c7ba0 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- 172.21.15.3:0/355444553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0c7ba0 msgr2=0x7f8b4c0ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/355444553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0ae870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098e0 tx=0x7f8b440091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- 172.21.15.3:0/355444553 shutdown_connections 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/355444553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0ae870 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/355444553 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0ae230 0x7f8b4c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- 172.21.15.3:0/355444553 >> 172.21.15.3:0/355444553 conn(0x7f8b4c0c83d0 msgr2=0x7f8b4c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:48.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- 172.21.15.3:0/355444553 shutdown_connections 2023-10-08T16:08:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.389+0000 7f8b4b59e700 1 -- 172.21.15.3:0/355444553 wait complete. 2023-10-08T16:08:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 Processor -- start 2023-10-08T16:08:48.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 -- start start 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 0x7f8b4c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b4c0ae230 0x7f8b4c0c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c15a820 con 0x7f8b4c0ade60 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0c4d90 con 0x7f8b4c0ae230 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c15a260 con 0x7f8b4c0c7ba0 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 0x7f8b4c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 0x7f8b4c1598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33662/0 (socket says 172.21.15.3:33662) 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 -- 172.21.15.3:0/507727933 learned_addr learned my addr 172.21.15.3:0/507727933 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:48.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4ad9d700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b49d9b700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b4c0ae230 0x7f8b4c0c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 -- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0c7ba0 msgr2=0x7f8b4c0c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 -- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b4c0ae230 msgr2=0x7f8b4c0c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b4c0ae230 0x7f8b4c0c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 -- 172.21.15.3:0/507727933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009420 con 0x7f8b4c0ade60 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b49d9b700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b4c0ae230 0x7f8b4c0c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4a59c700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 0x7f8b4c1598f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c580 tx=0x7f8b3c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c005b30 con 0x7f8b4c0ade60 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c005c90 con 0x7f8b4c0ade60 2023-10-08T16:08:48.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c15a540 con 0x7f8b4c0ade60 2023-10-08T16:08:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c007320 con 0x7f8b4c0ade60 2023-10-08T16:08:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.393+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c159e30 con 0x7f8b4c0ade60 2023-10-08T16:08:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.397+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0c4880 con 0x7f8b4c0ade60 2023-10-08T16:08:48.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.397+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8b3c007690 con 0x7f8b4c0ade60 2023-10-08T16:08:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.397+0000 7f8b427fc700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8b2c060550 0x7f8b2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.397+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b3c07bcd0 con 0x7f8b4c0ade60 2023-10-08T16:08:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.397+0000 7f8b49d9b700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8b2c060550 0x7f8b2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.397+0000 7f8b49d9b700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8b2c060550 0x7f8b2c062a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b340094d0 tx=0x7f8b3400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.405+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b4c0c4880 con 0x7f8b4c0ade60 2023-10-08T16:08:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.605+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b4c0c4880 con 0x7f8b4c0ade60 2023-10-08T16:08:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b427fc700 1 -- 172.21.15.3:0/507727933 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8b4c0c4880 con 0x7f8b4c0ade60 2023-10-08T16:08:48.613 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8b2c060550 msgr2=0x7f8b2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8b2c060550 0x7f8b2c062a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b340094d0 tx=0x7f8b3400b040 comp rx=0 tx=0).stop 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 msgr2=0x7f8b4c1598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 0x7f8b4c1598f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c580 tx=0x7f8b3c007df0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 shutdown_connections 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8b2c060550 0x7f8b2c062a00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8b4c0c7ba0 0x7f8b4c0c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b4c0ae230 0x7f8b4c0c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 --2- 172.21.15.3:0/507727933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b4c0ade60 0x7f8b4c1598f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.609+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 >> 172.21.15.3:0/507727933 conn(0x7f8b4c0c83d0 msgr2=0x7f8b4c06d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:48.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.613+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 shutdown_connections 2023-10-08T16:08:48.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:48.613+0000 7f8b4b59e700 1 -- 172.21.15.3:0/507727933 wait complete. 2023-10-08T16:08:48.631 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:08:48.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:08:48.632 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:08:48.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:48.632 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-10-08T16:08:48.641 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:08:48.641 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:08:48.641 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:08:48.641 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.641 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:08:48.642 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42430sec preferred_lft 42430sec 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:88:23:76:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:08:48.643 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:7e:cd:39:46:09 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::e4d6:67ff:fe20:d296/64 scope link 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ce:f9:8e:0a:a5:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ccf9:8eff:fe0a:a5cd/64 scope link 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:08:48.644 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:7e:cd:39:46:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:08:48.645 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::587e:cdff:fe39:4609/64 scope link 2023-10-08T16:08:48.645 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:48.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:48.645 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:08:48.660 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-10-08T16:08:48.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:48.662 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:08:48.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:48.714 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-08T16:08:48.714 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-08T16:08:48.714 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:08:48.714 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:08:48.714 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:08:48.714 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-08T16:08:48.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:48.754 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-08T16:08:48.761 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:08:48.761 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:08:48.761 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:08:48.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:48.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-10-08T16:08:48.778 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-08T16:08:48.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:08:48.778 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:48.784 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:08:48.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:08:48.785 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:48.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:08:48.806 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:48.806 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:48.819 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:48.819 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:48.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:48.821 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:08:48.827 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:08:48.827 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-08T16:08:48.869 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:08:48.888 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:48.888 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:48.898 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:48.899 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:48.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:48.899 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:08:48.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:2023-10-08T16:08:48.955+0000 7f9b57c67380 -1 init, newargv = 0x55c882630a70 newargc=15 2023-10-08T16:08:48.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39889]: starting ceph client 2023-10-08T16:08:48.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39889]: starting fuse 2023-10-08T16:08:50.048 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-08T16:08:50.066 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:50.066 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:50.076 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:50.076 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:50.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:50.077 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-08T16:08:50.126 INFO:teuthology.orchestra.run.smithi027.stdout:52 2023-10-08T16:08:50.126 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:08:50.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:08:50.126 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> import re 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> import os 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2023-10-08T16:08:50.127 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> return f 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.1")) 2023-10-08T16:08:50.128 DEBUG:teuthology.orchestra.run.smithi027:> ' 2023-10-08T16:08:50.208 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.1.39889.asok 2023-10-08T16:08:50.394 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.39889.asok 2023-10-08T16:08:50.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:50.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.39889.asok status 2023-10-08T16:08:50.477 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-08T16:08:50.477 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "1", 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "39889", 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2023-10-08T16:08:50.478 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 5240, 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 5240 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:08:50.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3747533313 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3747533313 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-08T16:08:50.480 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.5240 192.168.0.1:0/3747533313", 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "192.168.0.1:0/3747533313", 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 18, 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 44, 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2023-10-08T16:08:50.481 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-08T16:08:50.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:50.486 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2023-10-08T16:08:50.486 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:50.490 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2023-10-08T16:08:50.491 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:50.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:50.491 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:50.546 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set client client_inject_fixed_oldest_tid true 2023-10-08T16:08:50.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 Processor -- start 2023-10-08T16:08:50.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 -- start start 2023-10-08T16:08:50.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0d90156b10 0x7f0d900af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d900ae800 0x7f0d900aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900c80b0 con 0x7f0d90156ee0 2023-10-08T16:08:50.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900c9fc0 con 0x7f0d900ae800 2023-10-08T16:08:50.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d96f30700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900ad400 con 0x7f0d90156b10 2023-10-08T16:08:50.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d900ae800 0x7f0d900aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d900ae800 0x7f0d900aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38864/0 (socket says 172.21.15.3:38864) 2023-10-08T16:08:50.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 -- 172.21.15.3:0/2788916395 learned_addr learned my addr 172.21.15.3:0/2788916395 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:50.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d95f2e700 1 --2- 172.21.15.3:0/2788916395 >> v2:172.21.15.27:3300/0 conn(0x7f0d90156b10 0x7f0d900af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 -- 172.21.15.3:0/2788916395 >> v2:172.21.15.27:3300/0 conn(0x7f0d90156b10 msgr2=0x7f0d900af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:50.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 --2- 172.21.15.3:0/2788916395 >> v2:172.21.15.27:3300/0 conn(0x7f0d90156b10 0x7f0d900af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 -- 172.21.15.3:0/2788916395 >> v1:172.21.15.27:6789/0 conn(0x7f0d90156ee0 legacy=0x7f0d900c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d94f2c700 1 -- 172.21.15.3:0/2788916395 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156538801 0 0) 0x7f0d900c80b0 con 0x7f0d90156ee0 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 -- 172.21.15.3:0/2788916395 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9015b6d0 con 0x7f0d900ae800 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d9672f700 1 --2- 172.21.15.3:0/2788916395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d900ae800 0x7f0d900aec80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0d900c9420 tx=0x7f0d88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321aa34f9d459a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.669+0000 7f0d94f2c700 1 -- 172.21.15.3:0/2788916395 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800e070 con 0x7f0d900ae800 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d94f2c700 1 -- 172.21.15.3:0/2788916395 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800b990 con 0x7f0d900ae800 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d94f2c700 1 -- 172.21.15.3:0/2788916395 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880092e0 con 0x7f0d900ae800 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- 172.21.15.3:0/2788916395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d900ae800 msgr2=0x7f0d900aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 --2- 172.21.15.3:0/2788916395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d900ae800 0x7f0d900aec80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0d900c9420 tx=0x7f0d88009840 comp rx=0 tx=0).stop 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- 172.21.15.3:0/2788916395 shutdown_connections 2023-10-08T16:08:50.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 --2- 172.21.15.3:0/2788916395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d900ae800 0x7f0d900aec80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 --2- 172.21.15.3:0/2788916395 >> v2:172.21.15.27:3300/0 conn(0x7f0d90156b10 0x7f0d900af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- 172.21.15.3:0/2788916395 >> 172.21.15.3:0/2788916395 conn(0x7f0d9006b4f0 msgr2=0x7f0d9006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:50.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- 172.21.15.3:0/2788916395 shutdown_connections 2023-10-08T16:08:50.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- 172.21.15.3:0/2788916395 wait complete. 2023-10-08T16:08:50.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 Processor -- start 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- start start 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 0x7f0d900c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d90156b10 0x7f0d900c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d90156ee0 0x7f0d90147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900c53a0 con 0x7f0d90156ee0 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900c4de0 con 0x7f0d90156b10 2023-10-08T16:08:50.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d96f30700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900c50c0 con 0x7f0d900ae800 2023-10-08T16:08:50.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d9672f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d90156ee0 0x7f0d90147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d95f2e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 0x7f0d900c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d9672f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d90156ee0 0x7f0d90147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38870/0 (socket says 172.21.15.3:38870) 2023-10-08T16:08:50.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d95f2e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 0x7f0d900c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:33494/0 (socket says 172.21.15.3:33494) 2023-10-08T16:08:50.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d9672f700 1 -- 172.21.15.3:0/4144102919 learned_addr learned my addr 172.21.15.3:0/4144102919 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:50.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.673+0000 7f0d9572d700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d90156b10 0x7f0d900c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d95f2e700 1 -- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d90156b10 msgr2=0x7f0d900c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d95f2e700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d90156b10 0x7f0d900c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d95f2e700 1 -- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d90156ee0 msgr2=0x7f0d90147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d95f2e700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d90156ee0 0x7f0d90147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d95f2e700 1 -- 172.21.15.3:0/4144102919 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009ae0 con 0x7f0d900ae800 2023-10-08T16:08:50.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d95f2e700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 0x7f0d900c4440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00ea50 tx=0x7f0d8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:50.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00ee90 con 0x7f0d900ae800 2023-10-08T16:08:50.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00c7f0 con 0x7f0d900ae800 2023-10-08T16:08:50.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d900c0380 con 0x7f0d900ae800 2023-10-08T16:08:50.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00cb90 con 0x7f0d900ae800 2023-10-08T16:08:50.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d900c4980 con 0x7f0d900ae800 2023-10-08T16:08:50.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9004be40 con 0x7f0d900ae800 2023-10-08T16:08:50.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.677+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0d8c013470 con 0x7f0d900ae800 2023-10-08T16:08:50.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.681+0000 7f0d85ffb700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0d74060580 0x7f0d74062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.681+0000 7f0d9572d700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0d74060580 0x7f0d74062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.681+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d8c07c920 con 0x7f0d900ae800 2023-10-08T16:08:50.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.681+0000 7f0d9572d700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0d74060580 0x7f0d74062a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d90157330 tx=0x7f0d80007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.693+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d8c04ce70 con 0x7f0d900ae800 2023-10-08T16:08:50.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.857+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_command([{prefix=config set, name=client_inject_fixed_oldest_tid}] v 0) v1 -- 0x7f0d900c7780 con 0x7f0d900ae800 2023-10-08T16:08:50.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.865+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 7 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0d8c04ce70 con 0x7f0d900ae800 2023-10-08T16:08:50.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.865+0000 7f0d85ffb700 1 -- 172.21.15.3:0/4144102919 <== mon.2 v2:172.21.15.27:3301/0 8 ==== mon_command_ack([{prefix=config set, name=client_inject_fixed_oldest_tid}]=0 v17)=0 v17) v1 ==== 134+0+0 (secure 0 0 0) 0x7f0d8c0170c0 con 0x7f0d900ae800 2023-10-08T16:08:50.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0d74060580 msgr2=0x7f0d74062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0d74060580 0x7f0d74062a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d90157330 tx=0x7f0d80007ec0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 msgr2=0x7f0d900c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 0x7f0d900c4440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00ea50 tx=0x7f0d8c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 shutdown_connections 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0d74060580 0x7f0d74062a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d90156ee0 0x7f0d90147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d90156b10 0x7f0d900c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 --2- 172.21.15.3:0/4144102919 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0d900ae800 0x7f0d900c4440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 >> 172.21.15.3:0/4144102919 conn(0x7f0d9006b4f0 msgr2=0x7f0d900afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 shutdown_connections 2023-10-08T16:08:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:50.873+0000 7f0d96f30700 1 -- 172.21.15.3:0/4144102919 wait complete. 2023-10-08T16:08:50.891 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-10-08T16:08:50.892 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:08:50.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:50.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44541]: fuse finished with error 0 and tester_r 0 2023-10-08T16:08:50.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:50.903 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:08:51.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94abfff700 1 Processor -- start 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94abfff700 1 -- start start 2023-10-08T16:08:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94abfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94abfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac06e340 con 0x7f94ac06ccc0 2023-10-08T16:08:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94abfff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac06d730 con 0x7f94ac1592b0 2023-10-08T16:08:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94abfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac06da10 con 0x7f94ac0684b0 2023-10-08T16:08:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94aa7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f94ac06ccc0 0x7f94ac158ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51518/0 (socket says 172.21.15.3:51518) 2023-10-08T16:08:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94aa7fc700 1 -- 172.21.15.3:0/3038034924 learned_addr learned my addr 172.21.15.3:0/3038034924 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.125+0000 7f94aaffd700 1 --2- 172.21.15.3:0/3038034924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120126661 0 0) 0x7f94ac06e340 con 0x7f94ac06ccc0 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9494003570 con 0x7f94ac06ccc0 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107102276 0 0) 0x7f94ac06d730 con 0x7f94ac1592b0 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ac06e340 con 0x7f94ac1592b0 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94aaffd700 1 -- 172.21.15.3:0/3038034924 >> v1:172.21.15.27:6789/0 conn(0x7f94ac1592b0 legacy=0x7f94ac0c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94aaffd700 1 -- 172.21.15.3:0/3038034924 >> v1:172.21.15.3:6789/0 conn(0x7f94ac06ccc0 legacy=0x7f94ac158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94aaffd700 1 -- 172.21.15.3:0/3038034924 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac06dcf0 con 0x7f94ac0684b0 2023-10-08T16:08:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94aaffd700 1 --2- 172.21.15.3:0/3038034924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac068880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f949c009910 tx=0x7f949c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1a969190bdb0aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c011630 con 0x7f94ac0684b0 2023-10-08T16:08:51.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f949c011790 con 0x7f94ac0684b0 2023-10-08T16:08:51.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94a9ffb700 1 -- 172.21.15.3:0/3038034924 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c011b30 con 0x7f94ac0684b0 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 -- 172.21.15.3:0/3038034924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 msgr2=0x7f94ac068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 --2- 172.21.15.3:0/3038034924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac068880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f949c009910 tx=0x7f949c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 -- 172.21.15.3:0/3038034924 shutdown_connections 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 --2- 172.21.15.3:0/3038034924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac068880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 -- 172.21.15.3:0/3038034924 >> 172.21.15.3:0/3038034924 conn(0x7f94ac0c8c90 msgr2=0x7f94ac0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 -- 172.21.15.3:0/3038034924 shutdown_connections 2023-10-08T16:08:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.129+0000 7f94abfff700 1 -- 172.21.15.3:0/3038034924 wait complete. 2023-10-08T16:08:51.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 Processor -- start 2023-10-08T16:08:51.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 -- start start 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94ac06ccc0 0x7f94ac16a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 0x7f94ac149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac16a580 con 0x7f94ac1592b0 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0c4f10 con 0x7f94ac06ccc0 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94abfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0c4be0 con 0x7f94ac0684b0 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 0x7f94ac149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94aa7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94ac06ccc0 0x7f94ac16a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 0x7f94ac149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38880/0 (socket says 172.21.15.3:38880) 2023-10-08T16:08:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 -- 172.21.15.3:0/2265920273 learned_addr learned my addr 172.21.15.3:0/2265920273 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:51.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94aaffd700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 -- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 msgr2=0x7f94ac0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 -- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94ac06ccc0 msgr2=0x7f94ac16a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94ac06ccc0 0x7f94ac16a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.133+0000 7f94ab7fe700 1 -- 172.21.15.3:0/2265920273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009420 con 0x7f94ac1592b0 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f94aa7fc700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94ac06ccc0 0x7f94ac16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f94ab7fe700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 0x7f94ac149000 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c910 tx=0x7f94a40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4012630 con 0x7f94ac1592b0 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f94a40127b0 con 0x7f94ac1592b0 2023-10-08T16:08:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac149540 con 0x7f94ac1592b0 2023-10-08T16:08:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4012b70 con 0x7f94ac1592b0 2023-10-08T16:08:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0b1cb0 con 0x7f94ac1592b0 2023-10-08T16:08:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac0c4a40 con 0x7f94ac1592b0 2023-10-08T16:08:51.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.137+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f94a401b400 con 0x7f94ac1592b0 2023-10-08T16:08:51.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.141+0000 7f9492ffd700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9498060550 0x7f9498062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.141+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94a407cdf0 con 0x7f94ac1592b0 2023-10-08T16:08:51.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.141+0000 7f94aaffd700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9498060550 0x7f9498062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.141+0000 7f94aaffd700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9498060550 0x7f9498062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f949c009fd0 tx=0x7f949c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.141+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f94a404d4c0 con 0x7f94ac1592b0 2023-10-08T16:08:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94ac0c4a40 con 0x7f94ac1592b0 2023-10-08T16:08:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f9492ffd700 1 -- 172.21.15.3:0/2265920273 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94ac0c4a40 con 0x7f94ac1592b0 2023-10-08T16:08:51.346 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:08:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9498060550 msgr2=0x7f9498062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9498060550 0x7f9498062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f949c009fd0 tx=0x7f949c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 msgr2=0x7f94ac149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 0x7f94ac149000 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c910 tx=0x7f94a40027a0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 shutdown_connections 2023-10-08T16:08:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9498060550 0x7f9498062a00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94ac1592b0 0x7f94ac149000 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94ac06ccc0 0x7f94ac16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 --2- 172.21.15.3:0/2265920273 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f94ac0684b0 0x7f94ac0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 >> 172.21.15.3:0/2265920273 conn(0x7f94ac0c8c90 msgr2=0x7f94ac157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 shutdown_connections 2023-10-08T16:08:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:51.341+0000 7f94abfff700 1 -- 172.21.15.3:0/2265920273 wait complete. 2023-10-08T16:08:51.360 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:08:51.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:08:51.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-10-08T16:08:51.360 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:08:51.360 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:51.360 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:08:51.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:08:51.361 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:08:51.361 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:08:51.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:51.361 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:51.366 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T16:08:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 02:42:23:c8:a3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec2d:51ff:fe60:39b2/64 scope link 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 12:d3:e4:73:f2:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::10d3:e4ff:fe73:f282/64 scope link 2023-10-08T16:08:51.368 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.369 INFO:teuthology.orchestra.run.smithi003.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:08:51.369 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether be:9c:c5:92:be:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:08:51.369 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::bc9c:c5ff:fe92:be4a/64 scope link 2023-10-08T16:08:51.369 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:08:51.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:51.369 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:08:51.383 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-10-08T16:08:51.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:51.384 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-10-08T16:08:51.437 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-10-08T16:08:51.437 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:08:51.437 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T16:08:51.437 INFO:teuthology.orchestra.run.smithi003.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T16:08:51.437 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T16:08:51.438 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:08:51.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:51.438 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-10-08T16:08:51.438 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-10-08T16:08:51.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:08:51.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:08:51.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:08:51.438 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-10-08T16:08:51.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:51.477 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:08:51.484 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:08:51.484 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:08:51.484 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:08:51.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:51.484 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-10-08T16:08:51.539 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T16:08:51.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:08:51.539 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:51.544 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:08:51.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:08:51.544 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:51.549 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:08:51.565 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:51.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:51.579 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:51.580 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:51.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:51.580 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:08:51.586 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T16:08:51.586 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T16:08:51.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:08:51.647 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:51.647 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:51.656 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:51.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:51.657 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:08:51.715 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-10-08T16:08:51.709+0000 7f4fedfc8380 -1 init, newargv = 0x55da7dbf2b50 newargc=15 2023-10-08T16:08:51.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44712]: starting ceph client 2023-10-08T16:08:51.724 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44712]: starting fuse 2023-10-08T16:08:52.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-10-08T16:08:52.783 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T16:08:52.783 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T16:08:52.799 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T16:08:52.800 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T16:08:52.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:52.801 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-10-08T16:08:52.808 INFO:teuthology.orchestra.run.smithi003.stdout:52 2023-10-08T16:08:52.808 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T16:08:52.808 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:08:52.808 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-10-08T16:08:52.808 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-10-08T16:08:52.809 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-10-08T16:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-10-08T16:08:52.811 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T16:08:52.811 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:52.811 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2023-10-08T16:08:52.811 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:08:52.932 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.44712.asok 2023-10-08T16:08:53.118 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44712.asok 2023-10-08T16:08:53.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:53.118 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44712.asok status 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-10-08T16:08:53.214 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "44712", 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5616, 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 5616 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:53.215 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3875502896 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3875502896 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.5616 192.168.0.1:0/3875502896", 2023-10-08T16:08:53.216 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/3875502896", 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 18, 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 44, 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-10-08T16:08:53.217 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:08:53.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:53.223 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-10-08T16:08:53.223 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:53.231 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-10-08T16:08:53.231 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:53.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:53.231 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:53.246 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_completed_requests 10000 2023-10-08T16:08:53.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 Processor -- start 2023-10-08T16:08:53.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 -- start start 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f287c0cd420 0x7f287c06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f287c159410 0x7f287c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0cb380 con 0x7f287c159040 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0caa90 con 0x7f287c159410 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2882e4f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c06b850 con 0x7f287c0cd420 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f28813ec700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f287c159410 0x7f287c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2880beb700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f287c159040 0x7f287c0b2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51520/0 (socket says 172.21.15.3:51520) 2023-10-08T16:08:53.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f2880beb700 1 -- 172.21.15.3:0/1422969523 learned_addr learned my addr 172.21.15.3:0/1422969523 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f287bfff700 1 --2- 172.21.15.3:0/1422969523 >> v2:172.21.15.27:3300/0 conn(0x7f287c0cd420 0x7f287c06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f287b7fe700 1 -- 172.21.15.3:0/1422969523 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817299798 0 0) 0x7f287c0cb380 con 0x7f287c159040 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.405+0000 7f287b7fe700 1 -- 172.21.15.3:0/1422969523 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2868003570 con 0x7f287c159040 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f28813ec700 1 -- 172.21.15.3:0/1422969523 >> v2:172.21.15.27:3300/0 conn(0x7f287c0cd420 msgr2=0x7f287c06aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f28813ec700 1 --2- 172.21.15.3:0/1422969523 >> v2:172.21.15.27:3300/0 conn(0x7f287c0cd420 0x7f287c06aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f28813ec700 1 -- 172.21.15.3:0/1422969523 >> v1:172.21.15.3:6789/0 conn(0x7f287c159040 legacy=0x7f287c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f287b7fe700 1 -- 172.21.15.3:0/1422969523 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393987773 0 0) 0x7f2868003570 con 0x7f287c159040 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f28813ec700 1 -- 172.21.15.3:0/1422969523 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0cad30 con 0x7f287c159410 2023-10-08T16:08:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f287bfff700 1 --2- 172.21.15.3:0/1422969523 >> v2:172.21.15.27:3300/0 conn(0x7f287c0cd420 0x7f287c06aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f28813ec700 1 --2- 172.21.15.3:0/1422969523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159410 0x7f287c0ce1c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f287c0b5e20 tx=0x7f286c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc2fda06e2a35dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f287b7fe700 1 -- 172.21.15.3:0/1422969523 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c011630 con 0x7f287c159410 2023-10-08T16:08:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f287b7fe700 1 -- 172.21.15.3:0/1422969523 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f286c011790 con 0x7f287c159410 2023-10-08T16:08:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f287b7fe700 1 -- 172.21.15.3:0/1422969523 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c011b30 con 0x7f287c159410 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 -- 172.21.15.3:0/1422969523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159410 msgr2=0x7f287c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1422969523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159410 0x7f287c0ce1c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f287c0b5e20 tx=0x7f286c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 -- 172.21.15.3:0/1422969523 shutdown_connections 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1422969523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159410 0x7f287c0ce1c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1422969523 >> v2:172.21.15.27:3300/0 conn(0x7f287c0cd420 0x7f287c06aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 -- 172.21.15.3:0/1422969523 >> 172.21.15.3:0/1422969523 conn(0x7f287c0d0920 msgr2=0x7f287c0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 -- 172.21.15.3:0/1422969523 shutdown_connections 2023-10-08T16:08:53.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.409+0000 7f2882e4f700 1 -- 172.21.15.3:0/1422969523 wait complete. 2023-10-08T16:08:53.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 Processor -- start 2023-10-08T16:08:53.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 -- start start 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f287c0cd420 0x7f287c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 0x7f287c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f287c15c3c0 0x7f287c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c15bf30 con 0x7f287c159040 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c14ae40 con 0x7f287c15c3c0 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2882e4f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c15b320 con 0x7f287c0cd420 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f287bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 0x7f287c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f287bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 0x7f287c1538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38906/0 (socket says 172.21.15.3:38906) 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f287bfff700 1 -- 172.21.15.3:0/1311877346 learned_addr learned my addr 172.21.15.3:0/1311877346 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f2880beb700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f287c0cd420 0x7f287c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.413+0000 7f28813ec700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f287c15c3c0 0x7f287c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f287bfff700 1 -- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f287c0cd420 msgr2=0x7f287c14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f287bfff700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f287c0cd420 0x7f287c14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f287bfff700 1 -- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f287c15c3c0 msgr2=0x7f287c153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f287bfff700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f287c15c3c0 0x7f287c153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f287bfff700 1 -- 172.21.15.3:0/1311877346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009420 con 0x7f287c159040 2023-10-08T16:08:53.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f28813ec700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f287c15c3c0 0x7f287c153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:53.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f287bfff700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 0x7f287c1538b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f286400d890 tx=0x7f2864008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640125f0 con 0x7f287c159040 2023-10-08T16:08:53.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f2864012750 con 0x7f287c159040 2023-10-08T16:08:53.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c15b600 con 0x7f287c159040 2023-10-08T16:08:53.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864012af0 con 0x7f287c159040 2023-10-08T16:08:53.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c15bbc0 con 0x7f287c159040 2023-10-08T16:08:53.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c071180 con 0x7f287c159040 2023-10-08T16:08:53.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2864014430 con 0x7f287c159040 2023-10-08T16:08:53.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2878ff9700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f285c060580 0x7f285c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2880beb700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f285c060580 0x7f285c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.417+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f286407cc60 con 0x7f287c159040 2023-10-08T16:08:53.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.421+0000 7f2880beb700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f285c060580 0x7f285c062a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28740076b0 tx=0x7f2874005bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.429+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f286404d250 con 0x7f287c159040 2023-10-08T16:08:53.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.593+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_max_completed_requests}] v 0) v1 -- 0x7f287c068070 con 0x7f287c159040 2023-10-08T16:08:53.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2878ff9700 1 -- 172.21.15.3:0/1311877346 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_completed_requests}]=0 v18)=0 v18) v1 ==== 128+0+0 (secure 0 0 0) 0x7f2864050870 con 0x7f287c159040 2023-10-08T16:08:53.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f285c060580 msgr2=0x7f285c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f285c060580 0x7f285c062a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28740076b0 tx=0x7f2874005bc0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 msgr2=0x7f287c1538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 0x7f287c1538b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f286400d890 tx=0x7f2864008040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 shutdown_connections 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f285c060580 0x7f285c062a30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f287c15c3c0 0x7f287c153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f287c159040 0x7f287c1538b0 secure :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f286400d890 tx=0x7f2864008040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 --2- 172.21.15.3:0/1311877346 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f287c0cd420 0x7f287c14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 >> 172.21.15.3:0/1311877346 conn(0x7f287c0d0920 msgr2=0x7f287c14b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 shutdown_connections 2023-10-08T16:08:53.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:08:53.605+0000 7f2882e4f700 1 -- 172.21.15.3:0/1311877346 wait complete. 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> n = 10100 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:08:53.625 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file1" 2023-10-08T16:08:53.626 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:53.626 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:08:53.626 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:08:53.626 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:08:53.626 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:08:53.627 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:08:53.628 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:09:12.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:13.248 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:43.296 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:43.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:43.344 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:09:43.344 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:09:43.344 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:09:43.344 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:43.344 DEBUG:teuthology.orchestra.run.smithi003:> n = 5 2023-10-08T16:09:43.344 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file2" 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:43.345 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> if True: 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:09:43.346 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:09:43.347 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:09:43.603 INFO:tasks.ceph_test_case:waiting 1000s for health warning matching MDS_CLIENT_OLDEST_TID 2023-10-08T16:09:43.603 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health detail --format=json 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.752+0000 7f960b35e700 1 Processor -- start 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.752+0000 7f960b35e700 1 -- start start 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f960b35e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f960406c700 0x7f960406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f960b35e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f96040c9960 0x7f9604067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f960b35e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9604159440 con 0x7f960406d010 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f960b35e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9604068420 con 0x7f96040c9960 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f960b35e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9604068700 con 0x7f960406c700 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f96040c9960 0x7f9604067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f96040c9960 0x7f9604067dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47458/0 (socket says 172.21.15.3:47458) 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 -- 172.21.15.3:0/2844731471 learned_addr learned my addr 172.21.15.3:0/2844731471 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96090fa700 1 --2- 172.21.15.3:0/2844731471 >> v2:172.21.15.27:3300/0 conn(0x7f960406c700 0x7f960406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f95fbfff700 1 -- 172.21.15.3:0/2844731471 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304085135 0 0) 0x7f9604159440 con 0x7f960406d010 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 -- 172.21.15.3:0/2844731471 >> v2:172.21.15.27:3300/0 conn(0x7f960406c700 msgr2=0x7f960406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 --2- 172.21.15.3:0/2844731471 >> v2:172.21.15.27:3300/0 conn(0x7f960406c700 0x7f960406cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 -- 172.21.15.3:0/2844731471 >> v1:172.21.15.27:6789/0 conn(0x7f960406d010 legacy=0x7f96040676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 -- 172.21.15.3:0/2844731471 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040689e0 con 0x7f96040c9960 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f96098fb700 1 --2- 172.21.15.3:0/2844731471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96040c9960 0x7f9604067dc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f960406ec60 tx=0x7f95fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa66973ee149f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f95fbfff700 1 -- 172.21.15.3:0/2844731471 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00e070 con 0x7f96040c9960 2023-10-08T16:09:43.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f95fbfff700 1 -- 172.21.15.3:0/2844731471 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f95fc00ba20 con 0x7f96040c9960 2023-10-08T16:09:43.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.756+0000 7f95fbfff700 1 -- 172.21.15.3:0/2844731471 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0092e0 con 0x7f96040c9960 2023-10-08T16:09:43.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 -- 172.21.15.3:0/2844731471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96040c9960 msgr2=0x7f9604067dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 --2- 172.21.15.3:0/2844731471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96040c9960 0x7f9604067dc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f960406ec60 tx=0x7f95fc009840 comp rx=0 tx=0).stop 2023-10-08T16:09:43.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 -- 172.21.15.3:0/2844731471 shutdown_connections 2023-10-08T16:09:43.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 --2- 172.21.15.3:0/2844731471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96040c9960 0x7f9604067dc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 --2- 172.21.15.3:0/2844731471 >> v2:172.21.15.27:3300/0 conn(0x7f960406c700 0x7f960406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 -- 172.21.15.3:0/2844731471 >> 172.21.15.3:0/2844731471 conn(0x7f96040ca750 msgr2=0x7f96040cab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 -- 172.21.15.3:0/2844731471 shutdown_connections 2023-10-08T16:09:43.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 -- 172.21.15.3:0/2844731471 wait complete. 2023-10-08T16:09:43.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 Processor -- start 2023-10-08T16:09:43.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.760+0000 7f960b35e700 1 -- start start 2023-10-08T16:09:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 0x7f9604156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f960406d010 0x7f960415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96040c9960 0x7f9604067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960415b440 con 0x7f960406c700 2023-10-08T16:09:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040c4ea0 con 0x7f96040c9960 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604169a70 con 0x7f960406d010 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 0x7f9604156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 0x7f9604156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47464/0 (socket says 172.21.15.3:47464) 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 -- 172.21.15.3:0/2413098966 learned_addr learned my addr 172.21.15.3:0/2413098966 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96088f9700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f960406d010 0x7f960415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96098fb700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96040c9960 0x7f9604067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 -- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f960406d010 msgr2=0x7f960415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f960406d010 0x7f960415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 -- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96040c9960 msgr2=0x7f9604067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96040c9960 0x7f9604067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 -- 172.21.15.3:0/2413098966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc009ae0 con 0x7f960406c700 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96088f9700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f960406d010 0x7f960415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96098fb700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96040c9960 0x7f9604067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:43.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f96090fa700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 0x7f9604156990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f960000e930 tx=0x7f96000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000eed0 con 0x7f960406c700 2023-10-08T16:09:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f960000c850 con 0x7f960406c700 2023-10-08T16:09:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960415b160 con 0x7f960406c700 2023-10-08T16:09:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000cbf0 con 0x7f960406c700 2023-10-08T16:09:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9604169700 con 0x7f960406c700 2023-10-08T16:09:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.764+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9600013470 con 0x7f960406c700 2023-10-08T16:09:43.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.768+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960404be40 con 0x7f960406c700 2023-10-08T16:09:43.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.768+0000 7f95f97fa700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f95e8060550 0x7f95e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.768+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f960007caa0 con 0x7f960406c700 2023-10-08T16:09:43.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.768+0000 7f96088f9700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f95e8060550 0x7f95e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.768+0000 7f96088f9700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f95e8060550 0x7f95e8062a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9604158e30 tx=0x7f95f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.772+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f960004d050 con 0x7f960406c700 2023-10-08T16:09:43.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.992+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f9604068cc0 con 0x7f960406c700 2023-10-08T16:09:43.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.992+0000 7f95f97fa700 1 -- 172.21.15.3:0/2413098966 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail", "format": "json"}]=0 v0) v1 ==== 92+0+46 (secure 0 0 0) 0x7f9600017040 con 0x7f960406c700 2023-10-08T16:09:43.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:09:43.997 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T16:09:43.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f95e8060550 msgr2=0x7f95e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f95e8060550 0x7f95e8062a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9604158e30 tx=0x7f95f4009040 comp rx=0 tx=0).stop 2023-10-08T16:09:43.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 msgr2=0x7f9604156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 0x7f9604156990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f960000e930 tx=0x7f96000091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 shutdown_connections 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f95e8060550 0x7f95e8062a00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96040c9960 0x7f9604067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f960406d010 0x7f960415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 --2- 172.21.15.3:0/2413098966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f960406c700 0x7f9604156990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 >> 172.21.15.3:0/2413098966 conn(0x7f96040ca750 msgr2=0x7f96040c2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 shutdown_connections 2023-10-08T16:09:44.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:43.996+0000 7f960b35e700 1 -- 172.21.15.3:0/2413098966 wait complete. 2023-10-08T16:09:44.015 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2023-10-08T16:09:44.015 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=1000 retry_count=0)... 2023-10-08T16:09:49.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health detail --format=json 2023-10-08T16:09:49.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 Processor -- start 2023-10-08T16:09:49.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 -- start start 2023-10-08T16:09:49.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60ac0c80d0 0x7f60ac06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 0x7f60ac0c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac0c16b0 con 0x7f60ac155e20 2023-10-08T16:09:49.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0c8710 con 0x7f60ac0c80d0 2023-10-08T16:09:49.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.132+0000 7f60ab59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0c1060 con 0x7f60ac06e300 2023-10-08T16:09:49.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60aad9d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 0x7f60ac0c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60ac0c80d0 0x7f60ac06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60aad9d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 0x7f60ac0c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:45342/0 (socket says 172.21.15.3:45342) 2023-10-08T16:09:49.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60aad9d700 1 -- 172.21.15.3:0/3295508792 learned_addr learned my addr 172.21.15.3:0/3295508792 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:09:49.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 --2- 172.21.15.3:0/3295508792 >> v2:172.21.15.27:3300/0 conn(0x7f60ac0c80d0 0x7f60ac06ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:46610/0 (socket says 172.21.15.3:46610) 2023-10-08T16:09:49.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 -- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 msgr2=0x7f60ac0c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:49.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 --2- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 0x7f60ac0c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 -- 172.21.15.3:0/3295508792 >> v1:172.21.15.27:6789/0 conn(0x7f60ac155e20 legacy=0x7f60ac15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 -- 172.21.15.3:0/3295508792 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0c1340 con 0x7f60ac0c80d0 2023-10-08T16:09:49.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60aad9d700 1 --2- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 0x7f60ac0c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:49.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a3fff700 1 --2- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac06ddc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60940098e0 tx=0x7f60940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebfbe1ea1b6dcfd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a9d9b700 1 -- 172.21.15.3:0/3295508792 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400b640 con 0x7f60ac0c80d0 2023-10-08T16:09:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a9d9b700 1 -- 172.21.15.3:0/3295508792 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f609400b7a0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60a9d9b700 1 -- 172.21.15.3:0/3295508792 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400bb40 con 0x7f60ac0c80d0 2023-10-08T16:09:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 -- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 msgr2=0x7f60ac06ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 --2- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac06ddc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60940098e0 tx=0x7f60940091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 -- 172.21.15.3:0/3295508792 shutdown_connections 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 --2- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac06e300 0x7f60ac0c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 --2- 172.21.15.3:0/3295508792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac06ddc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 -- 172.21.15.3:0/3295508792 >> 172.21.15.3:0/3295508792 conn(0x7f60ac0c8c90 msgr2=0x7f60ac0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 -- 172.21.15.3:0/3295508792 shutdown_connections 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.136+0000 7f60ab59e700 1 -- 172.21.15.3:0/3295508792 wait complete. 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 Processor -- start 2023-10-08T16:09:49.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 -- start start 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 0x7f60ac0c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac0684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac155e20 0x7f60ac153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0c65d0 con 0x7f60ac06e300 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac157380 con 0x7f60ac0c80d0 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0c5d30 con 0x7f60ac155e20 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60aa59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 0x7f60ac0c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60aa59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 0x7f60ac0c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47466/0 (socket says 172.21.15.3:47466) 2023-10-08T16:09:49.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60aa59c700 1 -- 172.21.15.3:0/2666412142 learned_addr learned my addr 172.21.15.3:0/2666412142 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:09:49.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac0684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60aad9d700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac155e20 0x7f60ac153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 -- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac155e20 msgr2=0x7f60ac153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac155e20 0x7f60ac153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 -- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 msgr2=0x7f60ac0c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 0x7f60ac0c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 -- 172.21.15.3:0/2666412142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009ae0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60aa59c700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 0x7f60ac0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:49.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a3fff700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac0684b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60940098e0 tx=0x7f60940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:49.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609401bb70 con 0x7f60ac0c80d0 2023-10-08T16:09:49.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f609401bcf0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6094009420 con 0x7f60ac0c80d0 2023-10-08T16:09:49.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609401bea0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.140+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac0c62f0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.144+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac04be40 con 0x7f60ac0c80d0 2023-10-08T16:09:49.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.144+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f60940449c0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.144+0000 7f60a27fc700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f608c060550 0x7f608c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.144+0000 7f60aa59c700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f608c060550 0x7f608c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.144+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f609407def0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.148+0000 7f60aa59c700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f608c060550 0x7f608c062a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f609c001e90 tx=0x7f609c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:49.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.152+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f609404e500 con 0x7f60ac0c80d0 2023-10-08T16:09:49.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.372+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f60ac0c97a0 con 0x7f60ac0c80d0 2023-10-08T16:09:49.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.372+0000 7f60a27fc700 1 -- 172.21.15.3:0/2666412142 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail", "format": "json"}]=0 v0) v1 ==== 92+0+46 (secure 0 0 0) 0x7f6094015040 con 0x7f60ac0c80d0 2023-10-08T16:09:49.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:09:49.376 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f608c060550 msgr2=0x7f608c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f608c060550 0x7f608c062a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f609c001e90 tx=0x7f609c009040 comp rx=0 tx=0).stop 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 msgr2=0x7f60ac0684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac0684b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60940098e0 tx=0x7f60940091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 shutdown_connections 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f608c060550 0x7f608c062a00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f60ac155e20 0x7f60ac153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0c80d0 0x7f60ac0684b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 --2- 172.21.15.3:0/2666412142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60ac06e300 0x7f60ac0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 >> 172.21.15.3:0/2666412142 conn(0x7f60ac0c8c90 msgr2=0x7f60ac0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:49.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 shutdown_connections 2023-10-08T16:09:49.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:49.376+0000 7f60ab59e700 1 -- 172.21.15.3:0/2666412142 wait complete. 2023-10-08T16:09:49.389 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2023-10-08T16:09:49.389 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=1000 retry_count=0)... 2023-10-08T16:09:54.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health detail --format=json 2023-10-08T16:09:54.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 Processor -- start 2023-10-08T16:09:54.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 -- start start 2023-10-08T16:09:54.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fada40684b0 0x7fada4068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada406ccc0 0x7fada406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada406e340 con 0x7fada4158ba0 2023-10-08T16:09:54.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada406d730 con 0x7fada40684b0 2023-10-08T16:09:54.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada9517700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada406da10 con 0x7fada406ccc0 2023-10-08T16:09:54.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada8d16700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fada4158ba0 0x7fada4159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:38138/0 (socket says 172.21.15.3:38138) 2023-10-08T16:09:54.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada8d16700 1 -- 172.21.15.3:0/4083500139 learned_addr learned my addr 172.21.15.3:0/4083500139 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada37fe700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada406ccc0 0x7fada406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada3fff700 1 --2- 172.21.15.3:0/4083500139 >> v2:172.21.15.27:3300/0 conn(0x7fada40684b0 0x7fada4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada2ffd700 1 -- 172.21.15.3:0/4083500139 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405507810 0 0) 0x7fada406e340 con 0x7fada4158ba0 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada2ffd700 1 -- 172.21.15.3:0/4083500139 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad8c003570 con 0x7fada4158ba0 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada3fff700 1 -- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada406ccc0 msgr2=0x7fada406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada3fff700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada406ccc0 0x7fada406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.504+0000 7fada3fff700 1 -- 172.21.15.3:0/4083500139 >> v1:172.21.15.3:6789/0 conn(0x7fada4158ba0 legacy=0x7fada4159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada3fff700 1 -- 172.21.15.3:0/4083500139 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada406dcf0 con 0x7fada40684b0 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada37fe700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada406ccc0 0x7fada406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada3fff700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada40684b0 0x7fada4068880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad940098e0 tx=0x7fad940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5270eaa69cb862ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada2ffd700 1 -- 172.21.15.3:0/4083500139 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94011630 con 0x7fada40684b0 2023-10-08T16:09:54.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada2ffd700 1 -- 172.21.15.3:0/4083500139 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fad94011790 con 0x7fada40684b0 2023-10-08T16:09:54.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada2ffd700 1 -- 172.21.15.3:0/4083500139 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94011b10 con 0x7fada40684b0 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada40684b0 msgr2=0x7fada4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada40684b0 0x7fada4068880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad940098e0 tx=0x7fad940091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- 172.21.15.3:0/4083500139 shutdown_connections 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada406ccc0 0x7fada406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 --2- 172.21.15.3:0/4083500139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada40684b0 0x7fada4068880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- 172.21.15.3:0/4083500139 >> 172.21.15.3:0/4083500139 conn(0x7fada40c8c90 msgr2=0x7fada40c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- 172.21.15.3:0/4083500139 shutdown_connections 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- 172.21.15.3:0/4083500139 wait complete. 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 Processor -- start 2023-10-08T16:09:54.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- start start 2023-10-08T16:09:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada40684b0 0x7fada414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 0x7fada40b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada4158ba0 0x7fada40b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40a9830 con 0x7fada406ccc0 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40aaaf0 con 0x7fada4158ba0 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.508+0000 7fada9517700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada40a9550 con 0x7fada40684b0 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 0x7fada40b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 0x7fada40b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49948/0 (socket says 172.21.15.3:49948) 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 -- 172.21.15.3:0/360166065 learned_addr learned my addr 172.21.15.3:0/360166065 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada3fff700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada40684b0 0x7fada414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada8d16700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada4158ba0 0x7fada40b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 -- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada40684b0 msgr2=0x7fada414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada40684b0 0x7fada414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 -- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada4158ba0 msgr2=0x7fada40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada4158ba0 0x7fada40b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 -- 172.21.15.3:0/360166065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009420 con 0x7fada406ccc0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada37fe700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 0x7fada40b09b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fad9800ec80 tx=0x7fad980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800c850 con 0x7fada406ccc0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fad9800c9b0 con 0x7fada406ccc0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad94009420 con 0x7fada406ccc0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800cd30 con 0x7fada406ccc0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada40aa780 con 0x7fada406ccc0 2023-10-08T16:09:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.512+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada40aac60 con 0x7fada406ccc0 2023-10-08T16:09:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.516+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad98013680 con 0x7fada406ccc0 2023-10-08T16:09:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.516+0000 7fad8bfff700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad90060550 0x7fad90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.516+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fad9807cdd0 con 0x7fada406ccc0 2023-10-08T16:09:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.516+0000 7fada3fff700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad90060550 0x7fad90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.516+0000 7fada3fff700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad90060550 0x7fad90062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad940093a0 tx=0x7fad940091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.524+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad98050df0 con 0x7fada406ccc0 2023-10-08T16:09:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.744+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fada404be40 con 0x7fada406ccc0 2023-10-08T16:09:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.744+0000 7fad8bfff700 1 -- 172.21.15.3:0/360166065 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail", "format": "json"}]=0 v0) v1 ==== 92+0+322 (secure 0 0 0) 0x7fad980210a0 con 0x7fada406ccc0 2023-10-08T16:09:54.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:09:54.748 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CLIENT_OLDEST_TID":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to advance oldest client/flush tid","count":1},"detail":[{"message":"mds.c(mds.0): Client smithi003:0 failing to advance its oldest client/flush tid. client_id: 5616"}],"muted":false}},"mutes":[]} 2023-10-08T16:09:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad90060550 msgr2=0x7fad90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad90060550 0x7fad90062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad940093a0 tx=0x7fad940091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 msgr2=0x7fada40b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 0x7fada40b09b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fad9800ec80 tx=0x7fad980091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 shutdown_connections 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fad90060550 0x7fad90062a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada4158ba0 0x7fada40b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fada406ccc0 0x7fada40b09b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 --2- 172.21.15.3:0/360166065 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fada40684b0 0x7fada414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 >> 172.21.15.3:0/360166065 conn(0x7fada40c8c90 msgr2=0x7fada40cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 shutdown_connections 2023-10-08T16:09:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.748+0000 7fada9517700 1 -- 172.21.15.3:0/360166065 wait complete. 2023-10-08T16:09:54.767 DEBUG:tasks.ceph_test_case:detail_strings: ['mds.c(mds.0): Client smithi003:0 failing to advance its oldest client/flush tid. client_id: 5616'] 2023-10-08T16:09:54.767 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T16:09:54.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_metadata_threshold 5000 2023-10-08T16:09:54.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.880+0000 7f5763fff700 1 Processor -- start 2023-10-08T16:09:54.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.880+0000 7f5763fff700 1 -- start start 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640cc450 0x7f57640ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640c8da0 con 0x7f57640adc50 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640cd530 con 0x7f57640ad120 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640cd9c0 con 0x7f57640cc450 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57637fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f57640adc50 0x7f57640ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:38144/0 (socket says 172.21.15.3:38144) 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57637fe700 1 -- 172.21.15.3:0/3976760495 learned_addr learned my addr 172.21.15.3:0/3976760495 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f575a7fc700 1 --2- 172.21.15.3:0/3976760495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640cc450 0x7f57640ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57627fc700 1 -- 172.21.15.3:0/3976760495 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035701543 0 0) 0x7f57640c8da0 con 0x7f57640adc50 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57627fc700 1 -- 172.21.15.3:0/3976760495 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5750003570 con 0x7f57640adc50 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f575a7fc700 1 -- 172.21.15.3:0/3976760495 >> v1:172.21.15.27:6789/0 conn(0x7f57640ad120 legacy=0x7f57640cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f575a7fc700 1 -- 172.21.15.3:0/3976760495 >> v1:172.21.15.3:6789/0 conn(0x7f57640adc50 legacy=0x7f57640ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f575a7fc700 1 -- 172.21.15.3:0/3976760495 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640cc920 con 0x7f57640cc450 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f575a7fc700 1 --2- 172.21.15.3:0/3976760495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640cc450 0x7f57640ad710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f574c009910 tx=0x7f574c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1371d4e75eda5704 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57627fc700 1 -- 172.21.15.3:0/3976760495 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c00b680 con 0x7f57640cc450 2023-10-08T16:09:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57627fc700 1 -- 172.21.15.3:0/3976760495 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f574c00b7e0 con 0x7f57640cc450 2023-10-08T16:09:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f57627fc700 1 -- 172.21.15.3:0/3976760495 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c00bb60 con 0x7f57640cc450 2023-10-08T16:09:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- 172.21.15.3:0/3976760495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640cc450 msgr2=0x7f57640ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 --2- 172.21.15.3:0/3976760495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640cc450 0x7f57640ad710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f574c009910 tx=0x7f574c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- 172.21.15.3:0/3976760495 shutdown_connections 2023-10-08T16:09:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 --2- 172.21.15.3:0/3976760495 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640cc450 0x7f57640ad710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- 172.21.15.3:0/3976760495 >> 172.21.15.3:0/3976760495 conn(0x7f57640ca5e0 msgr2=0x7f57640ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- 172.21.15.3:0/3976760495 shutdown_connections 2023-10-08T16:09:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.884+0000 7f5763fff700 1 -- 172.21.15.3:0/3976760495 wait complete. 2023-10-08T16:09:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.888+0000 7f5763fff700 1 Processor -- start 2023-10-08T16:09:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.888+0000 7f5763fff700 1 -- start start 2023-10-08T16:09:54.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640ad120 0x7f576414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57640adc50 0x7f57640c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 0x7f57640af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b1bc0 con 0x7f57640cc450 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b2700 con 0x7f57640adc50 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b1dd0 con 0x7f57640ad120 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 0x7f57640af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 0x7f57640af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49950/0 (socket says 172.21.15.3:49950) 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 -- 172.21.15.3:0/2254194178 learned_addr learned my addr 172.21.15.3:0/2254194178 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:09:54.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f575a7fc700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57640adc50 0x7f57640c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5762ffd700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640ad120 0x7f576414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 -- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640ad120 msgr2=0x7f576414e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640ad120 0x7f576414e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 -- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57640adc50 msgr2=0x7f57640c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57640adc50 0x7f57640c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 -- 172.21.15.3:0/2254194178 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c009420 con 0x7f57640cc450 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f57637fe700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 0x7f57640af250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f575c001460 tx=0x7f575c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00a830 con 0x7f57640cc450 2023-10-08T16:09:54.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f575c00a990 con 0x7f57640cc450 2023-10-08T16:09:54.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57640b20b0 con 0x7f57640cc450 2023-10-08T16:09:54.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00ad10 con 0x7f57640cc450 2023-10-08T16:09:54.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.892+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576414ed60 con 0x7f57640cc450 2023-10-08T16:09:54.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.896+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57640b2870 con 0x7f57640cc450 2023-10-08T16:09:54.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.896+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f575c007300 con 0x7f57640cc450 2023-10-08T16:09:54.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.896+0000 7f575b7fe700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5744060580 0x7f5744062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.896+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f575c07ca50 con 0x7f57640cc450 2023-10-08T16:09:54.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.896+0000 7f5762ffd700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5744060580 0x7f5744062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.896+0000 7f5762ffd700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5744060580 0x7f5744062a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5754000c00 tx=0x7f5754007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:54.904+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f575c04d160 con 0x7f57640cc450 2023-10-08T16:09:55.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.060+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_session_metadata_threshold}] v 0) v1 -- 0x7f57640c7f70 con 0x7f57640cc450 2023-10-08T16:09:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.068+0000 7f575b7fe700 1 -- 172.21.15.3:0/2254194178 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_metadata_threshold}]=0 v19)=0 v19) v1 ==== 131+0+0 (secure 0 0 0) 0x7f575c050780 con 0x7f57640cc450 2023-10-08T16:09:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5744060580 msgr2=0x7f5744062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5744060580 0x7f5744062a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5754000c00 tx=0x7f5754007ef0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 msgr2=0x7f57640af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 0x7f57640af250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f575c001460 tx=0x7f575c001ae0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 shutdown_connections 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5744060580 0x7f5744062a30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57640cc450 0x7f57640af250 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57640adc50 0x7f57640c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 --2- 172.21.15.3:0/2254194178 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f57640ad120 0x7f576414e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 >> 172.21.15.3:0/2254194178 conn(0x7f57640ca5e0 msgr2=0x7f57640679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 shutdown_connections 2023-10-08T16:09:55.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:09:55.072+0000 7f5763fff700 1 -- 172.21.15.3:0/2254194178 wait complete. 2023-10-08T16:09:55.088 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:09:55.088 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-10-08T16:09:55.088 DEBUG:teuthology.orchestra.run.smithi003:> import uuid 2023-10-08T16:09:55.088 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:55.088 DEBUG:teuthology.orchestra.run.smithi003:> n = 100000 2023-10-08T16:09:55.088 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = False 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> if 0 > 0: 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> create_hard_links = True 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file2" 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> dpath = os.path.dirname(path) 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> fnameprefix = os.path.basename(path) 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> os.makedirs(dpath, exist_ok=True) 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> try: 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> for i in range(n): 2023-10-08T16:09:55.089 DEBUG:teuthology.orchestra.run.smithi003:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> f.write(f"{i}") 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> if True: 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> f.flush() 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(f.fileno()) 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> os.unlink(fpath) 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> if create_hard_links: 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> for j in range(0): 2023-10-08T16:09:55.090 DEBUG:teuthology.orchestra.run.smithi003:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T16:09:55.091 DEBUG:teuthology.orchestra.run.smithi003:> if False: 2023-10-08T16:09:55.091 DEBUG:teuthology.orchestra.run.smithi003:> os.fsync(dirfd) 2023-10-08T16:09:55.091 DEBUG:teuthology.orchestra.run.smithi003:> finally: 2023-10-08T16:09:55.091 DEBUG:teuthology.orchestra.run.smithi003:> os.close(dirfd) 2023-10-08T16:09:55.091 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-10-08T16:10:13.342 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:13.345 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:43.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:43.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:13.465 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:13.468 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:43.846 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:43.849 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:13.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:13.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:43.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:43.988 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:14.033 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:14.036 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:44.082 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:44.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:14.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:14.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:44.178 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:44.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:06.349 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-10-08T16:15:06.337+0000 7f16509d5700 -1 mds.0.sessionmap save: session (client.5616) exceeds sesion metadata threshold - blocklisting 2023-10-08T16:15:06.372 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-10-08T16:15:06.357+0000 7f16509d5700 -1 mds.0.sessionmap save_if_dirty: session (client.5616) exceeds sesion metadata threshold - blocklisting 2023-10-08T16:15:06.456 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-10-08T16:15:06.449+0000 7f16509d5700 -1 mds.0.sessionmap save_if_dirty: session (client.5616) exceeds sesion metadata threshold - blocklisting 2023-10-08T16:15:06.608 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2023-10-08T16:15:06.597+0000 7f4fd37fe700 -1 client.5616 I was blocklisted at osd epoch 47 2023-10-08T16:15:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:Traceback (most recent call last): 2023-10-08T16:15:07.104 INFO:teuthology.orchestra.run.smithi003.stderr: File "", line 20, in 2023-10-08T16:15:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:BrokenPipeError: [Errno 108] Cannot send after transport endpoint shutdown: '/home/ubuntu/cephtest/mnt.0/testdir/file2_24599' 2023-10-08T16:15:07.133 INFO:teuthology.orchestra.run.smithi003.stderr:daemon-helper: command failed with exit status 1 2023-10-08T16:15:07.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:15:07.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:07.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 Processor -- start 2023-10-08T16:15:07.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 -- start start 2023-10-08T16:15:07.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c3c0ca5d0 0x7f0c3c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c0674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c06ce20 con 0x7f0c3c1591f0 2023-10-08T16:15:07.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c067a20 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c4084d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cb090 con 0x7f0c3c067060 2023-10-08T16:15:07.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c3c0ca5d0 0x7f0c3c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c0674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c0674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:45598/0 (socket says 172.21.15.3:45598) 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 -- 172.21.15.3:0/2120729841 learned_addr learned my addr 172.21.15.3:0/2120729841 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 -- 172.21.15.3:0/2120729841 >> v2:172.21.15.27:3300/0 conn(0x7f0c3c0ca5d0 msgr2=0x7f0c3c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 --2- 172.21.15.3:0/2120729841 >> v2:172.21.15.27:3300/0 conn(0x7f0c3c0ca5d0 0x7f0c3c0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 -- 172.21.15.3:0/2120729841 >> v1:172.21.15.27:6789/0 conn(0x7f0c3c1591f0 legacy=0x7f0c3c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 -- 172.21.15.3:0/2120729841 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0cb370 con 0x7f0c3c067060 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c3b59e700 1 --2- 172.21.15.3:0/2120729841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c0674e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009f20 tx=0x7f0c34009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19dedbee852ddb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c39d9b700 1 -- 172.21.15.3:0/2120729841 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400e070 con 0x7f0c3c067060 2023-10-08T16:15:07.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c39d9b700 1 -- 172.21.15.3:0/2120729841 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0c3400b9d0 con 0x7f0c3c067060 2023-10-08T16:15:07.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.233+0000 7f0c39d9b700 1 -- 172.21.15.3:0/2120729841 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340092e0 con 0x7f0c3c067060 2023-10-08T16:15:07.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- 172.21.15.3:0/2120729841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 msgr2=0x7f0c3c0674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2120729841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c0674e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009f20 tx=0x7f0c34009840 comp rx=0 tx=0).stop 2023-10-08T16:15:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- 172.21.15.3:0/2120729841 shutdown_connections 2023-10-08T16:15:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2120729841 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c0674e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2120729841 >> v2:172.21.15.27:3300/0 conn(0x7f0c3c0ca5d0 0x7f0c3c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- 172.21.15.3:0/2120729841 >> 172.21.15.3:0/2120729841 conn(0x7f0c3c0cfd80 msgr2=0x7f0c3c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- 172.21.15.3:0/2120729841 shutdown_connections 2023-10-08T16:15:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- 172.21.15.3:0/2120729841 wait complete. 2023-10-08T16:15:07.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 Processor -- start 2023-10-08T16:15:07.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- start start 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 0x7f0c3c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c1591f0 0x7f0c3c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cdc80 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ce7c0 con 0x7f0c3c1591f0 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c4084d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cde90 con 0x7f0c3c067060 2023-10-08T16:15:07.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c3a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 0x7f0c3c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c3a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 0x7f0c3c0b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46982/0 (socket says 172.21.15.3:46982) 2023-10-08T16:15:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c3a59c700 1 -- 172.21.15.3:0/2617679652 learned_addr learned my addr 172.21.15.3:0/2617679652 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.237+0000 7f0c3b59e700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c1591f0 0x7f0c3c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3ad9d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3a59c700 1 -- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 msgr2=0x7f0c3c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3a59c700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3a59c700 1 -- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c1591f0 msgr2=0x7f0c3c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3a59c700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c1591f0 0x7f0c3c0b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3a59c700 1 -- 172.21.15.3:0/2617679652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009ae0 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.241+0000 7f0c3a59c700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 0x7f0c3c0b3c50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000e930 tx=0x7f0c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:07.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30013680 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0c300137e0 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c0ce170 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30013b80 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c0cec50 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c04be40 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0c3000c460 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c22ffd700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0c28060650 0x7f0c28062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f0c3007c8d0 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c3ad9d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0c28060650 0x7f0c28062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.249+0000 7f0c3ad9d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0c28060650 0x7f0c28062b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c15dad0 tx=0x7f0c2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:07.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.257+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0c3004cfc0 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.453+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c3c06b990 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.453+0000 7f0c22ffd700 1 -- 172.21.15.3:0/2617679652 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15410 (secure 0 0 0) 0x7f0c300505e0 con 0x7f0c3c0ca5d0 2023-10-08T16:15:07.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:07.463 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":47,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:15:06.487348+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3875502896":"2023-10-08T17:15:06.455191+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0c28060650 msgr2=0x7f0c28062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0c28060650 0x7f0c28062b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c15dad0 tx=0x7f0c2c009040 comp rx=0 tx=0).stop 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 msgr2=0x7f0c3c0b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 0x7f0c3c0b3c50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000e930 tx=0x7f0c300091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 shutdown_connections 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0c28060650 0x7f0c28062b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c1591f0 0x7f0c3c0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c3c0ca5d0 0x7f0c3c0b3c50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 --2- 172.21.15.3:0/2617679652 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0c3c067060 0x7f0c3c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 >> 172.21.15.3:0/2617679652 conn(0x7f0c3c0cfd80 msgr2=0x7f0c3c1524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 shutdown_connections 2023-10-08T16:15:07.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.457+0000 7f0c4084d700 1 -- 172.21.15.3:0/2617679652 wait complete. 2023-10-08T16:15:07.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:07.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.569+0000 7f2d3ad4f700 1 Processor -- start 2023-10-08T16:15:07.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.569+0000 7f2d3ad4f700 1 -- start start 2023-10-08T16:15:07.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2d340cb880 0x7f2d34155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2d34159e80 0x7f2d34156140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d34068e80 con 0x7f2d34068ab0 2023-10-08T16:15:07.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34156680 con 0x7f2d34159e80 2023-10-08T16:15:07.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34156930 con 0x7f2d340cb880 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2d34159e80 0x7f2d34156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d38aeb700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2d34068ab0 0x7f2d340cb170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46764/0 (socket says 172.21.15.3:46764) 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2d34159e80 0x7f2d34156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46990/0 (socket says 172.21.15.3:46990) 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d38aeb700 1 -- 172.21.15.3:0/2347068009 learned_addr learned my addr 172.21.15.3:0/2347068009 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d2bfff700 1 --2- 172.21.15.3:0/2347068009 >> v2:172.21.15.27:3300/0 conn(0x7f2d340cb880 0x7f2d34155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 -- 172.21.15.3:0/2347068009 >> v2:172.21.15.27:3300/0 conn(0x7f2d340cb880 msgr2=0x7f2d34155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:07.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 --2- 172.21.15.3:0/2347068009 >> v2:172.21.15.27:3300/0 conn(0x7f2d340cb880 0x7f2d34155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 -- 172.21.15.3:0/2347068009 >> v1:172.21.15.3:6789/0 conn(0x7f2d34068ab0 legacy=0x7f2d340cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d2b7fe700 1 -- 172.21.15.3:0/2347068009 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493675212 0 0) 0x7f2d34068e80 con 0x7f2d34068ab0 2023-10-08T16:15:07.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 -- 172.21.15.3:0/2347068009 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d341593a0 con 0x7f2d34159e80 2023-10-08T16:15:07.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d392ec700 1 --2- 172.21.15.3:0/2347068009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d34156140 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406ac80 tx=0x7f2d2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc0a2a878ec9282 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:07.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d2b7fe700 1 -- 172.21.15.3:0/2347068009 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00bb60 con 0x7f2d34159e80 2023-10-08T16:15:07.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d2b7fe700 1 -- 172.21.15.3:0/2347068009 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f2d2c00bcc0 con 0x7f2d34159e80 2023-10-08T16:15:07.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d2b7fe700 1 -- 172.21.15.3:0/2347068009 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0116b0 con 0x7f2d34159e80 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/2347068009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 msgr2=0x7f2d34156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/2347068009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d34156140 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406ac80 tx=0x7f2d2c009780 comp rx=0 tx=0).stop 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/2347068009 shutdown_connections 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/2347068009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d34156140 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/2347068009 >> v2:172.21.15.27:3300/0 conn(0x7f2d340cb880 0x7f2d34155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.573+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/2347068009 >> 172.21.15.3:0/2347068009 conn(0x7f2d340c8de0 msgr2=0x7f2d340c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:07.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.577+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/2347068009 shutdown_connections 2023-10-08T16:15:07.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.577+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/2347068009 wait complete. 2023-10-08T16:15:07.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.577+0000 7f2d3ad4f700 1 Processor -- start 2023-10-08T16:15:07.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.577+0000 7f2d3ad4f700 1 -- start start 2023-10-08T16:15:07.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2d34068ab0 0x7f2d340b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d340cb880 0x7f2d341684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d341689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c1110 con 0x7f2d34159e80 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34166070 con 0x7f2d340cb880 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c1690 con 0x7f2d34068ab0 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d341689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d341689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46994/0 (socket says 172.21.15.3:46994) 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 -- 172.21.15.3:0/3956613227 learned_addr learned my addr 172.21.15.3:0/3956613227 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d38aeb700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2d34068ab0 0x7f2d340b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d2bfff700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d340cb880 0x7f2d341684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 -- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2d34068ab0 msgr2=0x7f2d340b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2d34068ab0 0x7f2d340b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 -- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d340cb880 msgr2=0x7f2d341684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d340cb880 0x7f2d341684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 -- 172.21.15.3:0/3956613227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c009a20 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d38aeb700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2d34068ab0 0x7f2d340b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d2bfff700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d340cb880 0x7f2d341684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d392ec700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d341689e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00b6c0 tx=0x7f2d2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c020070 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f2d2c0196e0 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d340b1ab0 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c019aa0 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d340c1320 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.581+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d340b1fb0 con 0x7f2d34159e80 2023-10-08T16:15:07.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.585+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2d2c003040 con 0x7f2d34159e80 2023-10-08T16:15:07.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.585+0000 7f2d28ff9700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2d20060550 0x7f2d20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:07.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.585+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f2d2c080730 con 0x7f2d34159e80 2023-10-08T16:15:07.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.585+0000 7f2d38aeb700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2d20060550 0x7f2d20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:07.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.585+0000 7f2d38aeb700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2d20060550 0x7f2d20062a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406d2e0 tx=0x7f2d30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:07.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.593+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2d2c050d20 con 0x7f2d34159e80 2023-10-08T16:15:07.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d3404be40 con 0x7f2d34159e80 2023-10-08T16:15:07.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d28ff9700 1 -- 172.21.15.3:0/3956613227 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f2d2c054340 con 0x7f2d34159e80 2023-10-08T16:15:07.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:07.784 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:09:49.438145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:15:07.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2d20060550 msgr2=0x7f2d20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2d20060550 0x7f2d20062a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406d2e0 tx=0x7f2d30009040 comp rx=0 tx=0).stop 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 msgr2=0x7f2d341689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d341689e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00b6c0 tx=0x7f2d2c009780 comp rx=0 tx=0).stop 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 shutdown_connections 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2d20060550 0x7f2d20062a00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d34159e80 0x7f2d341689e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d340cb880 0x7f2d341684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 --2- 172.21.15.3:0/3956613227 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2d34068ab0 0x7f2d340b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 >> 172.21.15.3:0/3956613227 conn(0x7f2d340c8de0 msgr2=0x7f2d3406b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 shutdown_connections 2023-10-08T16:15:07.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:07.777+0000 7f2d3ad4f700 1 -- 172.21.15.3:0/3956613227 wait complete. 2023-10-08T16:15:07.788 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T16:15:07.798 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-08T16:15:07.905 INFO:teuthology.orchestra.run.smithi003.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":8355,"msgr_send_messages":8347,"msgr_recv_bytes":2219239,"msgr_send_bytes":45405914,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":1.247602069,"msgr_running_send_time":0.488269656,"msgr_running_recv_time":0.244687013,"msgr_running_fast_dispatch_time":0.425883902,"msgr_send_messages_queue_lat":{"avgcount":8347,"sum":1.566877670,"avgtime":0.000187717},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":161117,"msgr_send_messages":181422,"msgr_recv_bytes":47666734,"msgr_send_bytes":121744554,"msgr_created_connections":9,"msgr_active_connections":4,"msgr_running_total_time":22.080590212,"msgr_running_send_time":10.677552433,"msgr_running_recv_time":15.781335276,"msgr_running_fast_dispatch_time":0.353329451,"msgr_send_messages_queue_lat":{"avgcount":181421,"sum":8.514904491,"avgtime":0.000046934},"msgr_handle_ack_lat":{"avgcount":328139,"sum":0.107991807,"avgtime":0.000000329}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":14134,"msgr_send_messages":13758,"msgr_recv_bytes":3623766,"msgr_send_bytes":96817093,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":2.197162152,"msgr_running_send_time":0.933893261,"msgr_running_recv_time":0.409091440,"msgr_running_fast_dispatch_time":0.708001960,"msgr_send_messages_queue_lat":{"avgcount":13756,"sum":3.080173460,"avgtime":0.000223914},"msgr_handle_ack_lat":{"avgcount":424,"sum":0.000106551,"avgtime":0.000000251}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":49700,"sum":44.330862014,"avgtime":0.000891969}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000031526,"avgtime":0.000015763}},"mds":{"request":71343,"reply":71342,"reply_latency":{"avgcount":71342,"sum":93.996418254,"avgtime":0.001317546},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":21,"dir_split":1,"dir_merge":0,"inodes":34710,"inodes_top":0,"inodes_bottom":34710,"inodes_pin_tail":0,"inodes_pinned":34710,"inodes_expired":30,"inodes_with_caps":34701,"caps":34702,"subtrees":2,"traverse":107980,"traverse_hit":34718,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":327775,"q":1,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":34698,"root_rbytes":151270,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":7,"ceph_cap_op_grant":34706,"ceph_cap_op_trunc":5,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":59229,"handle_client_caps_dirty":35012,"handle_client_cap_release":0,"process_request_cap_release":34701},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":394,"recovery_completed":394,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":1,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":94238,"evex":2048,"evtrm":0,"ev":94238,"evexg":0,"evexd":2048,"segadd":130,"segex":2,"segtrm":0,"seg":130,"segexg":0,"segexd":2,"expos":4194304,"wrpos":186323578,"rdpos":0,"jlat":{"avgcount":24791,"sum":94.782161658,"avgtime":0.003823248},"replayed":0},"mds_mem":{"ino":34713,"ino+":34713,"ino-":0,"dir":20,"dir+":21,"dir-":1,"dn":34710,"dn+":34740,"dn-":30,"cap":1,"cap+":34703,"cap-":34702,"rss":207256,"heap":207072},"mds_server":{"dispatch_client_request":71349,"dispatch_server_request":0,"handle_client_request":71343,"handle_client_session":24645,"handle_peer_request":0,"req_create_latency":{"avgcount":34699,"sum":71.930867331,"avgtime":0.002072995},"req_getattr_latency":{"avgcount":4,"sum":0.001640062,"avgtime":0.000410015},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":36632,"sum":22.048647586,"avgtime":0.000601895},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.006684957,"avgtime":0.006684957},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":5,"sum":0.008161882,"avgtime":0.001632376},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000416436,"avgtime":0.000416436},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":18103,"average_load":9051,"avg_session_uptime":375,"mdthresh_evicted":3},"mempool":{"bloom_filter_bytes":37760,"bloom_filter_items":37760,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238798,"buffer_anon_items":88,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5432,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":107236560,"mds_co_items":694636,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":27780,"op_send_bytes":194670476,"op_resend":25,"op_reply":27780,"oplen_avg":{"avgcount":27780,"sum":31758},"op":27780,"op_r":394,"op_w":27386,"op_rmw":0,"op_pg":0,"osdop_stat":394,"osdop_create":1908,"osdop_read":0,"osdop_write":24791,"osdop_writefull":33,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":1,"osdop_delete":549,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":3816,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":5,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":47,"map_full":0,"map_inc":4,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":185,"omap_rd":0,"omap_del":76},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":183601,"get_sum":36976205,"get_or_fail_fail":0,"get_or_fail_success":183601,"take":0,"take_sum":0,"put":183601,"put_sum":36976205,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":27780,"take_sum":194670476,"put":27780,"put_sum":194670476,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":27780,"take_sum":27780,"put":27780,"put_sum":27780,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55edd0d39e00":{"val":870248,"max":3758096384,"get_started":0,"get":94238,"get_sum":182129274,"get_or_fail_fail":0,"get_or_fail_success":94238,"take":0,"take_sum":0,"put":24791,"put_sum":181259026,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-08T16:15:07.907 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 2219239, "msgr_recv_messages": 8355, "msgr_running_fast_dispatch_time": 0.425883902, "msgr_running_recv_time": 0.244687013, "msgr_running_send_time": 0.488269656, "msgr_running_total_time": 1.247602069, "msgr_send_bytes": 45405914, "msgr_send_messages": 8347, "msgr_send_messages_queue_lat": { "avgcount": 8347, "avgtime": 0.000187717, "sum": 1.56687767 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 328139, "avgtime": 3.29e-07, "sum": 0.107991807 }, "msgr_recv_bytes": 47666734, "msgr_recv_messages": 161117, "msgr_running_fast_dispatch_time": 0.353329451, "msgr_running_recv_time": 15.781335276, "msgr_running_send_time": 10.677552433, "msgr_running_total_time": 22.080590212, "msgr_send_bytes": 121744554, "msgr_send_messages": 181422, "msgr_send_messages_queue_lat": { "avgcount": 181421, "avgtime": 4.6934e-05, "sum": 8.514904491 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 424, "avgtime": 2.51e-07, "sum": 0.000106551 }, "msgr_recv_bytes": 3623766, "msgr_recv_messages": 14134, "msgr_running_fast_dispatch_time": 0.70800196, "msgr_running_recv_time": 0.40909144, "msgr_running_send_time": 0.933893261, "msgr_running_total_time": 2.197162152, "msgr_send_bytes": 96817093, "msgr_send_messages": 13758, "msgr_send_messages_queue_lat": { "avgcount": 13756, "avgtime": 0.000223914, "sum": 3.08017346 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 49700, "avgtime": 0.000891969, "sum": 44.330862014 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.5763e-05, "sum": 3.1526e-05 }, "queue_len": 0 }, "mds": { "caps": 34702, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 34706, "ceph_cap_op_revoke": 7, "ceph_cap_op_trunc": 5, "dir_commit": 21, "dir_fetch": 0, "dir_merge": 0, "dir_split": 1, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 59229, "handle_client_caps_dirty": 35012, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 34710, "inodes_bottom": 34710, "inodes_expired": 30, "inodes_pin_tail": 0, "inodes_pinned": 34710, "inodes_top": 0, "inodes_with_caps": 34701, "load_cent": 327775, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 34701, "q": 1, "reply": 71342, "reply_latency": { "avgcount": 71342, "avgtime": 0.001317546, "sum": 93.996418254 }, "request": 71343, "root_rbytes": 151270, "root_rfiles": 34698, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 107980, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 34718, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 1, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 394, "recovery_started": 394, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 94238, "evadd": 94238, "evex": 2048, "evexd": 2048, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 24791, "avgtime": 0.003823248, "sum": 94.782161658 }, "rdpos": 0, "replayed": 0, "seg": 130, "segadd": 130, "segex": 2, "segexd": 2, "segexg": 0, "segtrm": 0, "wrpos": 186323578 }, "mds_mem": { "cap": 1, "cap+": 34703, "cap-": 34702, "dir": 20, "dir+": 21, "dir-": 1, "dn": 34710, "dn+": 34740, "dn-": 30, "heap": 207072, "ino": 34713, "ino+": 34713, "ino-": 0, "rss": 207256 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 71349, "dispatch_server_request": 0, "handle_client_request": 71343, "handle_client_session": 24645, "handle_peer_request": 0, "req_create_latency": { "avgcount": 34699, "avgtime": 0.002072995, "sum": 71.930867331 }, "req_getattr_latency": { "avgcount": 4, "avgtime": 0.000410015, "sum": 0.001640062 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 36632, "avgtime": 0.000601895, "sum": 22.048647586 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.006684957, "sum": 0.006684957 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 5, "avgtime": 0.001632376, "sum": 0.008161882 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000416436, "sum": 0.000416436 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 9051, "avg_session_uptime": 375, "mdthresh_evicted": 3, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 18103 }, "mempool": { "bloom_filter_bytes": 37760, "bloom_filter_items": 37760, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238798, "buffer_anon_items": 88, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 107236560, "mds_co_items": 694636, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5432, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 47, "map_full": 0, "map_inc": 4, "omap_del": 76, "omap_rd": 0, "omap_wr": 185, "op": 27780, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 394, "op_reply": 27780, "op_resend": 25, "op_rmw": 0, "op_send": 27780, "op_send_bytes": 194670476, "op_w": 27386, "oplen_avg": { "avgcount": 27780, "sum": 31758 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1908, "osdop_delete": 549, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 5, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 3816, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 394, "osdop_truncate": 1, "osdop_watch": 0, "osdop_write": 24791, "osdop_writefull": 33, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 183601, "get_or_fail_fail": 0, "get_or_fail_success": 183601, "get_started": 0, "get_sum": 36976205, "max": 104857600, "put": 183601, "put_sum": 36976205, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 27780, "put_sum": 194670476, "take": 27780, "take_sum": 194670476, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 27780, "put_sum": 27780, "take": 27780, "take_sum": 27780, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55edd0d39e00": { "get": 94238, "get_or_fail_fail": 0, "get_or_fail_success": 94238, "get_started": 0, "get_sum": 182129274, "max": 3758096384, "put": 24791, "put_sum": 181259026, "take": 0, "take_sum": 0, "val": 870248, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-08T16:15:07.908 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:15:07.908 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:15:07.927 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:15:07.948 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:15:07.949 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-10-08T16:15:07.949 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:15:07.949 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T16:15:07.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[44712]: fuse finished with error 0 and tester_r 0 2023-10-08T16:15:08.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:15:08.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:08.016 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:15:08.144 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2023-10-08T16:15:08.144 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:15:08.145 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-08T16:15:08.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi027.stderr:ceph-fuse[39889]: fuse finished with error 0 and tester_r 0 2023-10-08T16:15:08.162 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:15:08.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:08.162 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:15:08.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:15:08.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:08.268 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T16:15:08.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:15:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T16:15:08.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:15:08.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:08.281 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T16:15:08.288 INFO:teuthology.orchestra.run.smithi027.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T16:15:08.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:15:08.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:08.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 Processor -- start 2023-10-08T16:15:08.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- start start 2023-10-08T16:15:08.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17b40ade60 0x7f17b40cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f17b40c7d70 0x7f17b40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b41562c0 con 0x7f17b40ae230 2023-10-08T16:15:08.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b406b0b0 con 0x7f17b40c7d70 2023-10-08T16:15:08.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b406b390 con 0x7f17b40ade60 2023-10-08T16:15:08.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f17b40c7d70 0x7f17b40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f17b40c7d70 0x7f17b40cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47008/0 (socket says 172.21.15.3:47008) 2023-10-08T16:15:08.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 -- 172.21.15.3:0/479946697 learned_addr learned my addr 172.21.15.3:0/479946697 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:08.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b3fff700 1 --2- 172.21.15.3:0/479946697 >> v2:172.21.15.27:3300/0 conn(0x7f17b40ade60 0x7f17b40cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 -- 172.21.15.3:0/479946697 >> v2:172.21.15.27:3300/0 conn(0x7f17b40ade60 msgr2=0x7f17b40cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:08.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 --2- 172.21.15.3:0/479946697 >> v2:172.21.15.27:3300/0 conn(0x7f17b40ade60 0x7f17b40cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 -- 172.21.15.3:0/479946697 >> v1:172.21.15.27:6789/0 conn(0x7f17b40ae230 legacy=0x7f17b40c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 -- 172.21.15.3:0/479946697 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b406b670 con 0x7f17b40c7d70 2023-10-08T16:15:08.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b8b83700 1 --2- 172.21.15.3:0/479946697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40c7d70 0x7f17b40cb390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f17b4069ca0 tx=0x7f17ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2793a97a00691729 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:08.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b2ffd700 1 -- 172.21.15.3:0/479946697 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac009e70 con 0x7f17b40c7d70 2023-10-08T16:15:08.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b2ffd700 1 -- 172.21.15.3:0/479946697 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f17ac00b860 con 0x7f17b40c7d70 2023-10-08T16:15:08.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b2ffd700 1 -- 172.21.15.3:0/479946697 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00bc00 con 0x7f17b40c7d70 2023-10-08T16:15:08.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- 172.21.15.3:0/479946697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40c7d70 msgr2=0x7f17b40cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 --2- 172.21.15.3:0/479946697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40c7d70 0x7f17b40cb390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f17b4069ca0 tx=0x7f17ac009250 comp rx=0 tx=0).stop 2023-10-08T16:15:08.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- 172.21.15.3:0/479946697 shutdown_connections 2023-10-08T16:15:08.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 --2- 172.21.15.3:0/479946697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40c7d70 0x7f17b40cb390 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 --2- 172.21.15.3:0/479946697 >> v2:172.21.15.27:3300/0 conn(0x7f17b40ade60 0x7f17b40cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- 172.21.15.3:0/479946697 >> 172.21.15.3:0/479946697 conn(0x7f17b40c83d0 msgr2=0x7f17b40c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:08.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- 172.21.15.3:0/479946697 shutdown_connections 2023-10-08T16:15:08.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.389+0000 7f17b9384700 1 -- 172.21.15.3:0/479946697 wait complete. 2023-10-08T16:15:08.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 Processor -- start 2023-10-08T16:15:08.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 -- start start 2023-10-08T16:15:08.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 0x7f17b414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b40ae230 0x7f17b41598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f17b40c7d70 0x7f17b4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40b0090 con 0x7f17b40ade60 2023-10-08T16:15:08.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40b0930 con 0x7f17b40ae230 2023-10-08T16:15:08.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.393+0000 7f17b9384700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b414b520 con 0x7f17b40c7d70 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 0x7f17b414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 0x7f17b414afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47016/0 (socket says 172.21.15.3:47016) 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 -- 172.21.15.3:0/2291523475 learned_addr learned my addr 172.21.15.3:0/2291523475 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b37fe700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b40ae230 0x7f17b41598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b8b83700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f17b40c7d70 0x7f17b4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 -- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f17b40c7d70 msgr2=0x7f17b4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f17b40c7d70 0x7f17b4159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 -- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b40ae230 msgr2=0x7f17b41598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b40ae230 0x7f17b41598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 -- 172.21.15.3:0/2291523475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0094f0 con 0x7f17b40ade60 2023-10-08T16:15:08.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b8b83700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f17b40c7d70 0x7f17b4159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b3fff700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 0x7f17b414afe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f179c00e960 tx=0x7f179c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00c850 con 0x7f17b40ade60 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f179c00c9b0 con 0x7f17b40ade60 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b4166e60 con 0x7f17b40ade60 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00cd50 con 0x7f17b40ade60 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b40b05c0 con 0x7f17b40ade60 2023-10-08T16:15:08.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b404be40 con 0x7f17b40ade60 2023-10-08T16:15:08.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.397+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f179c013680 con 0x7f17b40ade60 2023-10-08T16:15:08.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.401+0000 7f17abfff700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1798060550 0x7f1798062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.401+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f179c07cd90 con 0x7f17b40ade60 2023-10-08T16:15:08.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.401+0000 7f17b37fe700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1798060550 0x7f1798062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.401+0000 7f17b37fe700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1798060550 0x7f1798062a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17b4153870 tx=0x7f17a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.405+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f179c04d3a0 con 0x7f17b40ade60 2023-10-08T16:15:08.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.605+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17b41596d0 con 0x7f17b40ade60 2023-10-08T16:15:08.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.605+0000 7f17abfff700 1 -- 172.21.15.3:0/2291523475 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f179c017090 con 0x7f17b40ade60 2023-10-08T16:15:08.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:08.614 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:09:49.438145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:15:08.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1798060550 msgr2=0x7f1798062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1798060550 0x7f1798062a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17b4153870 tx=0x7f17a4009040 comp rx=0 tx=0).stop 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 msgr2=0x7f17b414afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 0x7f17b414afe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f179c00e960 tx=0x7f179c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 shutdown_connections 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1798060550 0x7f1798062a00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f17b40c7d70 0x7f17b4159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b40ae230 0x7f17b41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 --2- 172.21.15.3:0/2291523475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17b40ade60 0x7f17b414afe0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 >> 172.21.15.3:0/2291523475 conn(0x7f17b40c83d0 msgr2=0x7f17b40c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 shutdown_connections 2023-10-08T16:15:08.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.609+0000 7f17b9384700 1 -- 172.21.15.3:0/2291523475 wait complete. 2023-10-08T16:15:08.618 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T16:15:08.629 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:08.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.729+0000 7f596aefa700 1 Processor -- start 2023-10-08T16:15:08.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.729+0000 7f596aefa700 1 -- start start 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5964158b90 0x7f5964158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f596406a400 0x7f596406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f59640cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59641594a0 con 0x7f5964158b90 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59640ca2d0 con 0x7f596406a400 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640ca890 con 0x7f59640cad20 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5964158b90 0x7f5964158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5964158b90 0x7f5964158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47018/0 (socket says 172.21.15.3:47018) 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 -- 172.21.15.3:0/1546161654 learned_addr learned my addr 172.21.15.3:0/1546161654 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f59696f7700 1 --2- 172.21.15.3:0/1546161654 >> v2:172.21.15.27:3300/0 conn(0x7f596406a400 0x7f596406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596a6f9700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f59640cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 -- 172.21.15.3:0/1546161654 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 msgr2=0x7f59640cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f59640cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 -- 172.21.15.3:0/1546161654 >> v2:172.21.15.27:3300/0 conn(0x7f596406a400 msgr2=0x7f596406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 --2- 172.21.15.3:0/1546161654 >> v2:172.21.15.27:3300/0 conn(0x7f596406a400 0x7f596406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 -- 172.21.15.3:0/1546161654 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964159890 con 0x7f5964158b90 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f59696f7700 1 --2- 172.21.15.3:0/1546161654 >> v2:172.21.15.27:3300/0 conn(0x7f596406a400 0x7f596406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:08.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596a6f9700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f59640cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:08.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5969ef8700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964158b90 0x7f5964158f60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f596406b7d0 tx=0x7f595c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc910e25fc2efbb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:08.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5968ef6700 1 -- 172.21.15.3:0/1546161654 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00e070 con 0x7f5964158b90 2023-10-08T16:15:08.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5968ef6700 1 -- 172.21.15.3:0/1546161654 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f595c00ba50 con 0x7f5964158b90 2023-10-08T16:15:08.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f5968ef6700 1 -- 172.21.15.3:0/1546161654 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0092e0 con 0x7f5964158b90 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- 172.21.15.3:0/1546161654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964158b90 msgr2=0x7f5964158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964158b90 0x7f5964158f60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f596406b7d0 tx=0x7f595c009840 comp rx=0 tx=0).stop 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- 172.21.15.3:0/1546161654 shutdown_connections 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f59640cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- 172.21.15.3:0/1546161654 >> v2:172.21.15.27:3300/0 conn(0x7f596406a400 0x7f596406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 --2- 172.21.15.3:0/1546161654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964158b90 0x7f5964158f60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- 172.21.15.3:0/1546161654 >> 172.21.15.3:0/1546161654 conn(0x7f59640cfd30 msgr2=0x7f59640d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:08.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- 172.21.15.3:0/1546161654 shutdown_connections 2023-10-08T16:15:08.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- 172.21.15.3:0/1546161654 wait complete. 2023-10-08T16:15:08.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 Processor -- start 2023-10-08T16:15:08.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.733+0000 7f596aefa700 1 -- start start 2023-10-08T16:15:08.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 0x7f59641691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f5964147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5964158b90 0x7f596416cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640c8340 con 0x7f596406a400 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640c8620 con 0x7f5964158b90 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640c8900 con 0x7f59640cad20 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 0x7f59641691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 0x7f59641691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47028/0 (socket says 172.21.15.3:47028) 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 -- 172.21.15.3:0/2534508024 learned_addr learned my addr 172.21.15.3:0/2534508024 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f59696f7700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f5964147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596a6f9700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5964158b90 0x7f596416cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 -- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 msgr2=0x7f5964147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f5964147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 -- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5964158b90 msgr2=0x7f596416cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5964158b90 0x7f596416cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 -- 172.21.15.3:0/2534508024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c009ae0 con 0x7f596406a400 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5969ef8700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 0x7f59641691e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f595c009430 tx=0x7f595c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c008bb0 con 0x7f596406a400 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f595c008d10 con 0x7f596406a400 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59640c8be0 con 0x7f596406a400 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0266b0 con 0x7f596406a400 2023-10-08T16:15:08.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.737+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596416d2b0 con 0x7f596406a400 2023-10-08T16:15:08.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.741+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59640c90e0 con 0x7f596406a400 2023-10-08T16:15:08.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.741+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f595c003040 con 0x7f596406a400 2023-10-08T16:15:08.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.741+0000 7f5961ffb700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5944060550 0x7f5944062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:08.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.741+0000 7f59696f7700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5944060550 0x7f5944062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:08.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.741+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f595c07e740 con 0x7f596406a400 2023-10-08T16:15:08.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.741+0000 7f59696f7700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5944060550 0x7f5944062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59640c6480 tx=0x7f594c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:08.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.745+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f595c04ed50 con 0x7f596406a400 2023-10-08T16:15:08.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.909+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f596404be40 con 0x7f596406a400 2023-10-08T16:15:08.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.909+0000 7f5961ffb700 1 -- 172.21.15.3:0/2534508024 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15410 (secure 0 0 0) 0x7f595c052370 con 0x7f596406a400 2023-10-08T16:15:08.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:08.919 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":47,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:15:06.487348+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3875502896":"2023-10-08T17:15:06.455191+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:08.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5944060550 msgr2=0x7f5944062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5944060550 0x7f5944062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59640c6480 tx=0x7f594c008040 comp rx=0 tx=0).stop 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 msgr2=0x7f59641691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 0x7f59641691e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f595c009430 tx=0x7f595c009840 comp rx=0 tx=0).stop 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 shutdown_connections 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5944060550 0x7f5944062a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5964158b90 0x7f596416cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f59640cad20 0x7f5964147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 --2- 172.21.15.3:0/2534508024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f596406a400 0x7f59641691e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 >> 172.21.15.3:0/2534508024 conn(0x7f59640cfd30 msgr2=0x7f596415b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 shutdown_connections 2023-10-08T16:15:08.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:08.913+0000 7f596aefa700 1 -- 172.21.15.3:0/2534508024 wait complete. 2023-10-08T16:15:08.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:06:27.882653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:08:34.133440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:08:34.862986+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:15:08.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:15:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 Processor -- start 2023-10-08T16:15:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 -- start start 2023-10-08T16:15:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90a415bf50 0x7f90a415c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a40c7700 con 0x7f90a415ca70 2023-10-08T16:15:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a40cad30 con 0x7f90a415bf50 2023-10-08T16:15:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.041+0000 7f90aae64700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40c8200 con 0x7f90a40ac670 2023-10-08T16:15:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90a415bf50 0x7f90a415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90a415bf50 0x7f90a415c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47044/0 (socket says 172.21.15.3:47044) 2023-10-08T16:15:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 -- 172.21.15.3:0/2850881188 learned_addr learned my addr 172.21.15.3:0/2850881188 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aa663700 1 --2- 172.21.15.3:0/2850881188 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 -- 172.21.15.3:0/2850881188 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 msgr2=0x7f90a40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 --2- 172.21.15.3:0/2850881188 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 -- 172.21.15.3:0/2850881188 >> v1:172.21.15.27:6789/0 conn(0x7f90a415ca70 legacy=0x7f90a40c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a8e60700 1 -- 172.21.15.3:0/2850881188 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183947095 0 0) 0x7f90a40c7700 con 0x7f90a415ca70 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 -- 172.21.15.3:0/2850881188 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40c7960 con 0x7f90a415bf50 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a9e62700 1 --2- 172.21.15.3:0/2850881188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415bf50 0x7f90a415c320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f90a40cae70 tx=0x7f9094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4509a925e65a62c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a8e60700 1 -- 172.21.15.3:0/2850881188 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094009e70 con 0x7f90a415bf50 2023-10-08T16:15:09.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a8e60700 1 -- 172.21.15.3:0/2850881188 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f909400b860 con 0x7f90a415bf50 2023-10-08T16:15:09.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90a8e60700 1 -- 172.21.15.3:0/2850881188 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400bc20 con 0x7f90a415bf50 2023-10-08T16:15:09.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 -- 172.21.15.3:0/2850881188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415bf50 msgr2=0x7f90a415c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 --2- 172.21.15.3:0/2850881188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415bf50 0x7f90a415c320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f90a40cae70 tx=0x7f9094009250 comp rx=0 tx=0).stop 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 -- 172.21.15.3:0/2850881188 shutdown_connections 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 --2- 172.21.15.3:0/2850881188 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 --2- 172.21.15.3:0/2850881188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415bf50 0x7f90a415c320 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 -- 172.21.15.3:0/2850881188 >> 172.21.15.3:0/2850881188 conn(0x7f90a406b4f0 msgr2=0x7f90a406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 -- 172.21.15.3:0/2850881188 shutdown_connections 2023-10-08T16:15:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.045+0000 7f90aae64700 1 -- 172.21.15.3:0/2850881188 wait complete. 2023-10-08T16:15:09.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 Processor -- start 2023-10-08T16:15:09.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 -- start start 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a415bf50 0x7f90a416dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 0x7f90a415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40c4c50 con 0x7f90a415ca70 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a416e270 con 0x7f90a415bf50 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aae64700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40c4040 con 0x7f90a40ac670 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 0x7f90a415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 0x7f90a415b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47050/0 (socket says 172.21.15.3:47050) 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 -- 172.21.15.3:0/712284098 learned_addr learned my addr 172.21.15.3:0/712284098 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90a9661700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a415bf50 0x7f90a416dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90a9e62700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 -- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 msgr2=0x7f90a40c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 -- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a415bf50 msgr2=0x7f90a416dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a415bf50 0x7f90a416dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.049+0000 7f90aa663700 1 -- 172.21.15.3:0/712284098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940094f0 con 0x7f90a415ca70 2023-10-08T16:15:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f90aa663700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 0x7f90a415b0b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e900 tx=0x7f909c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c013680 con 0x7f90a415ca70 2023-10-08T16:15:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a40c4320 con 0x7f90a415ca70 2023-10-08T16:15:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f909c0137e0 con 0x7f90a415ca70 2023-10-08T16:15:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c013be0 con 0x7f90a415ca70 2023-10-08T16:15:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a40c48e0 con 0x7f90a415ca70 2023-10-08T16:15:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a40c4e00 con 0x7f90a415ca70 2023-10-08T16:15:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f909c013d40 con 0x7f90a415ca70 2023-10-08T16:15:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f9099ffb700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9090060550 0x7f9090062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f909c07c8f0 con 0x7f90a415ca70 2023-10-08T16:15:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.053+0000 7f90a9e62700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9090060550 0x7f9090062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.057+0000 7f90a9e62700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9090060550 0x7f9090062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90940090b0 tx=0x7f9094009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.061+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f90a40c4e00 con 0x7f90a415ca70 2023-10-08T16:15:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.225+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90a40c4e00 con 0x7f90a415ca70 2023-10-08T16:15:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.225+0000 7f9099ffb700 1 -- 172.21.15.3:0/712284098 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90a40c4e00 con 0x7f90a415ca70 2023-10-08T16:15:09.234 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T16:15:09.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9090060550 msgr2=0x7f9090062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9090060550 0x7f9090062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90940090b0 tx=0x7f9094009250 comp rx=0 tx=0).stop 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 msgr2=0x7f90a415b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 0x7f90a415b0b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e900 tx=0x7f909c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 shutdown_connections 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9090060550 0x7f9090062a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90a415ca70 0x7f90a415b0b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a415bf50 0x7f90a416dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 --2- 172.21.15.3:0/712284098 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f90a40ac670 0x7f90a40c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 >> 172.21.15.3:0/712284098 conn(0x7f90a406b4f0 msgr2=0x7f90a40c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 shutdown_connections 2023-10-08T16:15:09.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.229+0000 7f90aae64700 1 -- 172.21.15.3:0/712284098 wait complete. 2023-10-08T16:15:09.248 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:15:09.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.353+0000 7f81cf59e700 1 Processor -- start 2023-10-08T16:15:09.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.353+0000 7f81cf59e700 1 -- start start 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cf59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81d00cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cf59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f81d00cc280 0x7f81d006c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cf59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d00c8da0 con 0x7f81d006cc40 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cf59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d00cd9c0 con 0x7f81d00cc280 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cf59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cd530 con 0x7f81d00ad120 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f81d006cc40 0x7f81d00ad710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46768/0 (socket says 172.21.15.3:46768) 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 -- 172.21.15.3:0/1133021426 learned_addr learned my addr 172.21.15.3:0/1133021426 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ce59c700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81d00cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cdd9b700 1 --2- 172.21.15.3:0/1133021426 >> v2:172.21.15.27:3300/0 conn(0x7f81d00cc280 0x7f81d006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452434472 0 0) 0x7f81d00c8da0 con 0x7f81d006cc40 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b8003570 con 0x7f81d006cc40 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3043259148 0 0) 0x7f81b8003570 con 0x7f81d006cc40 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 msgr2=0x7f81d00cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81d00cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 >> v2:172.21.15.27:3300/0 conn(0x7f81d00cc280 msgr2=0x7f81d006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 --2- 172.21.15.3:0/1133021426 >> v2:172.21.15.27:3300/0 conn(0x7f81d00cc280 0x7f81d006c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00cc6d0 con 0x7f81d006cc40 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ce59c700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81d00cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f81c80017f0 con 0x7f81d006cc40 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 >> v1:172.21.15.3:6789/0 conn(0x7f81d006cc40 legacy=0x7f81d00ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81b8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b8003fa0 0x7f81b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81b8004d50 0x7f81b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cd9c0 con 0x7f81b8004d50 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cd530 con 0x7f81b8003fa0 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b800ba60 con 0x7f81d00ad120 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81b8004d50 0x7f81b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ce59c700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81b8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cdd9b700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b8003fa0 0x7f81b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 -- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 msgr2=0x7f81b8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81d00ad120 0x7f81b8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 -- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b8003fa0 msgr2=0x7f81b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b8003fa0 0x7f81b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 -- 172.21.15.3:0/1133021426 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00093c0 con 0x7f81b8004d50 2023-10-08T16:15:09.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81ced9d700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81b8004d50 0x7f81b80051c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f81c800a970 tx=0x7f81d00cd670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132a6c2abf9d9abe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80070d0 con 0x7f81b8004d50 2023-10-08T16:15:09.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f81c8007270 con 0x7f81b8004d50 2023-10-08T16:15:09.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.357+0000 7f81cd59a700 1 -- 172.21.15.3:0/1133021426 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8007630 con 0x7f81b8004d50 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- 172.21.15.3:0/1133021426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81b8004d50 msgr2=0x7f81b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 --2- 172.21.15.3:0/1133021426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81b8004d50 0x7f81b80051c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f81c800a970 tx=0x7f81d00cd670 comp rx=0 tx=0).stop 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81ced9d700 1 -- 172.21.15.3:0/1133021426 reap_dead start 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- 172.21.15.3:0/1133021426 shutdown_connections 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- 172.21.15.3:0/1133021426 >> 172.21.15.3:0/1133021426 conn(0x7f81d00ca5e0 msgr2=0x7f81d00ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- 172.21.15.3:0/1133021426 shutdown_connections 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- 172.21.15.3:0/1133021426 wait complete. 2023-10-08T16:15:09.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 Processor -- start 2023-10-08T16:15:09.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- start start 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81b8004d50 0x7f81d00b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81d0153740 0x7f81d0157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 0x7f81d01597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0159cf0 con 0x7f81d0159340 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c58a0 con 0x7f81d0153740 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.361+0000 7f81cf59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0153bb0 con 0x7f81b8004d50 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 0x7f81d01597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ce59c700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81b8004d50 0x7f81d00b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 0x7f81d01597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47062/0 (socket says 172.21.15.3:47062) 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 -- 172.21.15.3:0/2914927184 learned_addr learned my addr 172.21.15.3:0/2914927184 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81cdd9b700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81d0153740 0x7f81d0157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 -- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81b8004d50 msgr2=0x7f81d00b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81b8004d50 0x7f81d00b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 -- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81d0153740 msgr2=0x7f81d0157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81d0153740 0x7f81d0157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 -- 172.21.15.3:0/2914927184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00c5570 con 0x7f81d0159340 2023-10-08T16:15:09.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81ced9d700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 0x7f81d01597b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f81c8001220 tx=0x7f81d00cd670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80070d0 con 0x7f81d0159340 2023-10-08T16:15:09.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f81c80017b0 con 0x7f81d0159340 2023-10-08T16:15:09.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d0158490 con 0x7f81d0159340 2023-10-08T16:15:09.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d0158a50 con 0x7f81d0159340 2023-10-08T16:15:09.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8002050 con 0x7f81d0159340 2023-10-08T16:15:09.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b40052b0 con 0x7f81d0159340 2023-10-08T16:15:09.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.365+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f81c8024070 con 0x7f81d0159340 2023-10-08T16:15:09.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.369+0000 7f81be7fc700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f81b0060580 0x7f81b0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.369+0000 7f81ce59c700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f81b0060580 0x7f81b0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.369+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f81c807ed20 con 0x7f81d0159340 2023-10-08T16:15:09.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.369+0000 7f81ce59c700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f81b0060580 0x7f81b0062a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f81c0006ea0 tx=0x7f81c0009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.373+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f81c804f290 con 0x7f81d0159340 2023-10-08T16:15:09.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.537+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81b4005ae0 con 0x7f81d0159340 2023-10-08T16:15:09.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.537+0000 7f81be7fc700 1 -- 172.21.15.3:0/2914927184 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81c80528b0 con 0x7f81d0159340 2023-10-08T16:15:09.545 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T16:15:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f81b0060580 msgr2=0x7f81b0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f81b0060580 0x7f81b0062a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f81c0006ea0 tx=0x7f81c0009120 comp rx=0 tx=0).stop 2023-10-08T16:15:09.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 msgr2=0x7f81d01597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 0x7f81d01597b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f81c8001220 tx=0x7f81d00cd670 comp rx=0 tx=0).stop 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 shutdown_connections 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f81b0060580 0x7f81b0062a30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81d0159340 0x7f81d01597b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81d0153740 0x7f81d0157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 --2- 172.21.15.3:0/2914927184 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81b8004d50 0x7f81d00b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 >> 172.21.15.3:0/2914927184 conn(0x7f81d00ca5e0 msgr2=0x7f81d006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 shutdown_connections 2023-10-08T16:15:09.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.541+0000 7f81cf59e700 1 -- 172.21.15.3:0/2914927184 wait complete. 2023-10-08T16:15:09.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:15:09.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 Processor -- start 2023-10-08T16:15:09.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 -- start start 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa1600cc140 0x7fa1600cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 0x7fa1600c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600ca080 con 0x7fa1600c9060 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1600c9500 con 0x7fa1600cc140 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa164dcc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c97e0 con 0x7fa1600c86f0 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa15ed9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa1600c9060 0x7fa16006c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55938/0 (socket says 172.21.15.3:55938) 2023-10-08T16:15:09.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.669+0000 7fa15ed9d700 1 -- 172.21.15.3:0/1830588401 learned_addr learned my addr 172.21.15.3:0/1830588401 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15e59c700 1 --2- 172.21.15.3:0/1830588401 >> v2:172.21.15.27:3300/0 conn(0x7fa1600cc140 0x7fa1600cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 0x7fa1600c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148136757 0 0) 0x7fa1600ca080 con 0x7fa1600c9060 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa14c003570 con 0x7fa1600c9060 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1462278913 0 0) 0x7fa14c003570 con 0x7fa1600c9060 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 msgr2=0x7fa1600c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 0x7fa1600c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 >> v2:172.21.15.27:3300/0 conn(0x7fa1600cc140 msgr2=0x7fa1600cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 --2- 172.21.15.3:0/1830588401 >> v2:172.21.15.27:3300/0 conn(0x7fa1600cc140 0x7fa1600cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600c9ac0 con 0x7fa1600c9060 2023-10-08T16:15:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fa158001470 con 0x7fa1600c9060 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15e59c700 1 --2- 172.21.15.3:0/1830588401 >> v2:172.21.15.27:3300/0 conn(0x7fa1600cc140 0x7fa1600cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 >> v1:172.21.15.3:6789/0 conn(0x7fa1600c9060 legacy=0x7fa16006c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 0x7fa14c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa14c003fe0 0x7fa14c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa14c004d50 0x7fa14c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c9500 con 0x7fa14c004d50 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c97e0 con 0x7fa14c003fe0 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c00ba90 con 0x7fa1600c86f0 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa14c003fe0 0x7fa14c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15e59c700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 0x7fa14c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15ed9d700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa14c004d50 0x7fa14c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 -- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 msgr2=0x7fa14c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa1600c86f0 0x7fa14c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 -- 172.21.15.3:0/1830588401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa14c004d50 msgr2=0x7fa14c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa14c004d50 0x7fa14c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 -- 172.21.15.3:0/1830588401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c003570 con 0x7fa14c003fe0 2023-10-08T16:15:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15dd9b700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa14c003fe0 0x7fa14c004810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa15000e210 tx=0x7fa15000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5123dcee4e6d4245 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000eac0 con 0x7fa14c003fe0 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fa15000f040 con 0x7fa14c003fe0 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15d59a700 1 -- 172.21.15.3:0/1830588401 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000ee70 con 0x7fa14c003fe0 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa164dcc700 1 -- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa14c003fe0 msgr2=0x7fa14c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa164dcc700 1 --2- 172.21.15.3:0/1830588401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa14c003fe0 0x7fa14c004810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa15000e210 tx=0x7fa15000b040 comp rx=0 tx=0).stop 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa15ed9d700 1 -- 172.21.15.3:0/1830588401 reap_dead start 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa164dcc700 1 -- 172.21.15.3:0/1830588401 shutdown_connections 2023-10-08T16:15:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.673+0000 7fa164dcc700 1 -- 172.21.15.3:0/1830588401 >> 172.21.15.3:0/1830588401 conn(0x7fa1600ca6d0 msgr2=0x7fa1600caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.677+0000 7fa164dcc700 1 -- 172.21.15.3:0/1830588401 shutdown_connections 2023-10-08T16:15:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.677+0000 7fa164dcc700 1 -- 172.21.15.3:0/1830588401 wait complete. 2023-10-08T16:15:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.677+0000 7fa164dcc700 1 Processor -- start 2023-10-08T16:15:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.677+0000 7fa164dcc700 1 -- start start 2023-10-08T16:15:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa14c003fe0 0x7fa1600afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa160155840 0x7fa160157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 0x7fa160157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c7430 con 0x7fa160155c90 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160157f80 con 0x7fa160155840 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c6820 con 0x7fa14c003fe0 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 0x7fa160157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 0x7fa160157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34680/0 (socket says 172.21.15.3:34680) 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa160155840 0x7fa160157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 -- 172.21.15.3:0/2169954394 learned_addr learned my addr 172.21.15.3:0/2169954394 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15e59c700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa14c003fe0 0x7fa1600afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 -- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa14c003fe0 msgr2=0x7fa1600afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa14c003fe0 0x7fa1600afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 -- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa160155840 msgr2=0x7fa160157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa160155840 0x7fa160157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 -- 172.21.15.3:0/2169954394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600c6b00 con 0x7fa160155c90 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa15ed9d700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 0x7fa160157a40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa1600ad4d0 tx=0x7fa158001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158018030 con 0x7fa160155c90 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fa15800f8a0 con 0x7fa160155c90 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1600c6de0 con 0x7fa160155c90 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800fc40 con 0x7fa160155c90 2023-10-08T16:15:09.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160153c00 con 0x7fa160155c90 2023-10-08T16:15:09.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.681+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa160158490 con 0x7fa160155c90 2023-10-08T16:15:09.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.685+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa15801b070 con 0x7fa160155c90 2023-10-08T16:15:09.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.685+0000 7fa1567fc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa140060580 0x7fa140062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.685+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7fa158019070 con 0x7fa160155c90 2023-10-08T16:15:09.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.685+0000 7fa15e59c700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa140060580 0x7fa140062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.685+0000 7fa15e59c700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa140060580 0x7fa140062a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa148006f00 tx=0x7fa1480091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.693+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa15804cb90 con 0x7fa160155c90 2023-10-08T16:15:09.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.857+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1600c7260 con 0x7fa160155c90 2023-10-08T16:15:09.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.857+0000 7fa1567fc700 1 -- 172.21.15.3:0/2169954394 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa15807ae60 con 0x7fa160155c90 2023-10-08T16:15:09.866 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T16:15:09.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa140060580 msgr2=0x7fa140062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa140060580 0x7fa140062a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa148006f00 tx=0x7fa1480091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 msgr2=0x7fa160157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 0x7fa160157a40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa1600ad4d0 tx=0x7fa158001e50 comp rx=0 tx=0).stop 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 shutdown_connections 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa140060580 0x7fa140062a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa160155c90 0x7fa160157a40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa160155840 0x7fa160157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 --2- 172.21.15.3:0/2169954394 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa14c003fe0 0x7fa1600afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 >> 172.21.15.3:0/2169954394 conn(0x7fa1600ca6d0 msgr2=0x7fa160068d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 shutdown_connections 2023-10-08T16:15:09.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.861+0000 7fa164dcc700 1 -- 172.21.15.3:0/2169954394 wait complete. 2023-10-08T16:15:09.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:09.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 Processor -- start 2023-10-08T16:15:09.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 -- start start 2023-10-08T16:15:09.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f966c0ade60 0x7f966c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f966c0c7d70 0x7f966c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c1562c0 con 0x7f966c0ae230 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c06b0b0 con 0x7f966c0c7d70 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c06b390 con 0x7f966c0ade60 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f966c0c7d70 0x7f966c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f96627fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f966c0ae230 0x7f966c0c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55954/0 (socket says 172.21.15.3:55954) 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f96627fc700 1 -- 172.21.15.3:0/826259769 learned_addr learned my addr 172.21.15.3:0/826259769 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:09.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966affd700 1 --2- 172.21.15.3:0/826259769 >> v2:172.21.15.27:3300/0 conn(0x7f966c0ade60 0x7f966c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966b7fe700 1 -- 172.21.15.3:0/826259769 >> v2:172.21.15.27:3300/0 conn(0x7f966c0ade60 msgr2=0x7f966c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966b7fe700 1 --2- 172.21.15.3:0/826259769 >> v2:172.21.15.27:3300/0 conn(0x7f966c0ade60 0x7f966c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966b7fe700 1 -- 172.21.15.3:0/826259769 >> v1:172.21.15.3:6789/0 conn(0x7f966c0ae230 legacy=0x7f966c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966b7fe700 1 -- 172.21.15.3:0/826259769 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c06b670 con 0x7f966c0c7d70 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966affd700 1 --2- 172.21.15.3:0/826259769 >> v2:172.21.15.27:3300/0 conn(0x7f966c0ade60 0x7f966c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966b7fe700 1 --2- 172.21.15.3:0/826259769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb390 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f966c069ca0 tx=0x7f9664009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d130373124316e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966a7fc700 1 -- 172.21.15.3:0/826259769 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400bc30 con 0x7f966c0c7d70 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966a7fc700 1 -- 172.21.15.3:0/826259769 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f966400bd90 con 0x7f966c0c7d70 2023-10-08T16:15:09.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.985+0000 7f966a7fc700 1 -- 172.21.15.3:0/826259769 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640116b0 con 0x7f966c0c7d70 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/826259769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 msgr2=0x7f966c0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 --2- 172.21.15.3:0/826259769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb390 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f966c069ca0 tx=0x7f9664009780 comp rx=0 tx=0).stop 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/826259769 shutdown_connections 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 --2- 172.21.15.3:0/826259769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb390 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 --2- 172.21.15.3:0/826259769 >> v2:172.21.15.27:3300/0 conn(0x7f966c0ade60 0x7f966c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/826259769 >> 172.21.15.3:0/826259769 conn(0x7f966c0c83d0 msgr2=0x7f966c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/826259769 shutdown_connections 2023-10-08T16:15:09.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/826259769 wait complete. 2023-10-08T16:15:09.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 Processor -- start 2023-10-08T16:15:09.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- start start 2023-10-08T16:15:09.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f966c0ade60 0x7f966c145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f966c0ae230 0x7f966c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c16dd70 con 0x7f966c0c7d70 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c1697a0 con 0x7f966c0ade60 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c16a000 con 0x7f966c0ae230 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34690/0 (socket says 172.21.15.3:34690) 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 -- 172.21.15.3:0/893322076 learned_addr learned my addr 172.21.15.3:0/893322076 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966affd700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f966c0ade60 0x7f966c145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f96627fc700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f966c0ae230 0x7f966c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 -- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f966c0ae230 msgr2=0x7f966c0cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f966c0ae230 0x7f966c0cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 -- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f966c0ade60 msgr2=0x7f966c145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f966c0ade60 0x7f966c145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 -- 172.21.15.3:0/893322076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664009a20 con 0x7f966c0c7d70 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966b7fe700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb110 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9664019730 tx=0x7f9664009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966401e070 con 0x7f966c0c7d70 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c16da90 con 0x7f966c0c7d70 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f96640032f0 con 0x7f966c0c7d70 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400bc30 con 0x7f966c0c7d70 2023-10-08T16:15:10.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.989+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c169c90 con 0x7f966c0c7d70 2023-10-08T16:15:10.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.993+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c16a190 con 0x7f966c0c7d70 2023-10-08T16:15:10.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.993+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9664003040 con 0x7f966c0c7d70 2023-10-08T16:15:10.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.993+0000 7f96637fe700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f964c060550 0x7f964c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.993+0000 7f966affd700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f964c060550 0x7f964c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.993+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f966407e670 con 0x7f966c0c7d70 2023-10-08T16:15:10.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:09.997+0000 7f966affd700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f964c060550 0x7f964c062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f965c006f00 tx=0x7f965c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.001+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f966404ec60 con 0x7f966c0c7d70 2023-10-08T16:15:10.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.193+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f966c04be40 con 0x7f966c0c7d70 2023-10-08T16:15:10.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.193+0000 7f96637fe700 1 -- 172.21.15.3:0/893322076 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f9664052280 con 0x7f966c0c7d70 2023-10-08T16:15:10.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:10.202 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:09:49.438145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f964c060550 msgr2=0x7f964c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f964c060550 0x7f964c062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f965c006f00 tx=0x7f965c008040 comp rx=0 tx=0).stop 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 msgr2=0x7f966c0cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb110 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9664019730 tx=0x7f9664009780 comp rx=0 tx=0).stop 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 shutdown_connections 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f964c060550 0x7f964c062a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f966c0c7d70 0x7f966c0cb110 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f966c0ae230 0x7f966c0cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 --2- 172.21.15.3:0/893322076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f966c0ade60 0x7f966c145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 >> 172.21.15.3:0/893322076 conn(0x7f966c0c83d0 msgr2=0x7f966c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:10.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 shutdown_connections 2023-10-08T16:15:10.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.197+0000 7f966bfff700 1 -- 172.21.15.3:0/893322076 wait complete. 2023-10-08T16:15:10.205 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T16:15:10.216 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:10.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.313+0000 7f36c8e72700 1 Processor -- start 2023-10-08T16:15:10.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.313+0000 7f36c8e72700 1 -- start start 2023-10-08T16:15:10.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f36c4158b90 0x7f36c4158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c406a400 0x7f36c406a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f36c40cad20 0x7f36c40cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c41594a0 con 0x7f36c40cad20 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40ca2d0 con 0x7f36c4158b90 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40ca890 con 0x7f36c406a400 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f36c40cad20 0x7f36c40cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f36c40cad20 0x7f36c40cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34702/0 (socket says 172.21.15.3:34702) 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 -- 172.21.15.3:0/2444448703 learned_addr learned my addr 172.21.15.3:0/2444448703 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c37fe700 1 --2- 172.21.15.3:0/2444448703 >> v2:172.21.15.27:3300/0 conn(0x7f36c4158b90 0x7f36c4158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c2ffd700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c406a400 0x7f36c406a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 -- 172.21.15.3:0/2444448703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c406a400 msgr2=0x7f36c406a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c406a400 0x7f36c406a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 -- 172.21.15.3:0/2444448703 >> v2:172.21.15.27:3300/0 conn(0x7f36c4158b90 msgr2=0x7f36c4158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:10.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 --2- 172.21.15.3:0/2444448703 >> v2:172.21.15.27:3300/0 conn(0x7f36c4158b90 0x7f36c4158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 -- 172.21.15.3:0/2444448703 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4159890 con 0x7f36c40cad20 2023-10-08T16:15:10.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c2ffd700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c406a400 0x7f36c406a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:10.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c3fff700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c40cad20 0x7f36c40cb180 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f36c4069e60 tx=0x7f36bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b4f7f309336e73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c27fc700 1 -- 172.21.15.3:0/2444448703 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00e070 con 0x7f36c40cad20 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c27fc700 1 -- 172.21.15.3:0/2444448703 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f36bc00ba20 con 0x7f36c40cad20 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c27fc700 1 -- 172.21.15.3:0/2444448703 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0092e0 con 0x7f36c40cad20 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- 172.21.15.3:0/2444448703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c40cad20 msgr2=0x7f36c40cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c40cad20 0x7f36c40cb180 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f36c4069e60 tx=0x7f36bc009840 comp rx=0 tx=0).stop 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- 172.21.15.3:0/2444448703 shutdown_connections 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c40cad20 0x7f36c40cb180 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- 172.21.15.3:0/2444448703 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c406a400 0x7f36c406a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 --2- 172.21.15.3:0/2444448703 >> v2:172.21.15.27:3300/0 conn(0x7f36c4158b90 0x7f36c4158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- 172.21.15.3:0/2444448703 >> 172.21.15.3:0/2444448703 conn(0x7f36c40cfd30 msgr2=0x7f36c40d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:10.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- 172.21.15.3:0/2444448703 shutdown_connections 2023-10-08T16:15:10.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.317+0000 7f36c8e72700 1 -- 172.21.15.3:0/2444448703 wait complete. 2023-10-08T16:15:10.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.321+0000 7f36c8e72700 1 Processor -- start 2023-10-08T16:15:10.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.321+0000 7f36c8e72700 1 -- start start 2023-10-08T16:15:10.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.321+0000 7f36c8e72700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c406a400 0x7f36c416d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.321+0000 7f36c8e72700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c40cad20 0x7f36c416a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 0x7f36c40c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c416e040 con 0x7f36c4158b90 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c416d7a0 con 0x7f36c406a400 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c416da80 con 0x7f36c40cad20 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 0x7f36c40c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 0x7f36c40c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34708/0 (socket says 172.21.15.3:34708) 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 -- 172.21.15.3:0/4182223401 learned_addr learned my addr 172.21.15.3:0/4182223401 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c2ffd700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c40cad20 0x7f36c416a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c37fe700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c406a400 0x7f36c416d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 -- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c40cad20 msgr2=0x7f36c416a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c40cad20 0x7f36c416a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 -- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c406a400 msgr2=0x7f36c416d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c406a400 0x7f36c416d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 -- 172.21.15.3:0/4182223401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc009ae0 con 0x7f36c4158b90 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c3fff700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 0x7f36c40c97a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007940 tx=0x7f36bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0092e0 con 0x7f36c4158b90 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f36bc007ba0 con 0x7f36c4158b90 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc01d420 con 0x7f36c4158b90 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c416dd60 con 0x7f36c4158b90 2023-10-08T16:15:10.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c416a770 con 0x7f36c4158b90 2023-10-08T16:15:10.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.325+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c416abd0 con 0x7f36c4158b90 2023-10-08T16:15:10.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.329+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f36bc003050 con 0x7f36c4158b90 2023-10-08T16:15:10.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.329+0000 7f36ab7fe700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f36b0060580 0x7f36b0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.329+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f36bc07e300 con 0x7f36c4158b90 2023-10-08T16:15:10.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.329+0000 7f36c37fe700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f36b0060580 0x7f36b0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.329+0000 7f36c37fe700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f36b0060580 0x7f36b0062a30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f36c406ad60 tx=0x7f36b40091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.333+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36bc04e890 con 0x7f36c4158b90 2023-10-08T16:15:10.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.497+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36c416afb0 con 0x7f36c4158b90 2023-10-08T16:15:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36ab7fe700 1 -- 172.21.15.3:0/4182223401 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15410 (secure 0 0 0) 0x7f36bc051eb0 con 0x7f36c4158b90 2023-10-08T16:15:10.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:10.508 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":47,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:15:06.487348+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3875502896":"2023-10-08T17:15:06.455191+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f36b0060580 msgr2=0x7f36b0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f36b0060580 0x7f36b0062a30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f36c406ad60 tx=0x7f36b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 msgr2=0x7f36c40c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 0x7f36c40c97a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007940 tx=0x7f36bc009840 comp rx=0 tx=0).stop 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 shutdown_connections 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f36b0060580 0x7f36b0062a30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36c4158b90 0x7f36c40c97a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f36c40cad20 0x7f36c416a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 --2- 172.21.15.3:0/4182223401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c406a400 0x7f36c416d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 >> 172.21.15.3:0/4182223401 conn(0x7f36c40cfd30 msgr2=0x7f36c4067060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 shutdown_connections 2023-10-08T16:15:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.501+0000 7f36c8e72700 1 -- 172.21.15.3:0/4182223401 wait complete. 2023-10-08T16:15:10.523 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:15:10.524 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:10.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.621+0000 7fe91bfff700 1 Processor -- start 2023-10-08T16:15:10.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.621+0000 7fe91bfff700 1 -- start start 2023-10-08T16:15:10.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe91c0c3380 0x7fe91c0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c06d930 con 0x7fe91c15d930 2023-10-08T16:15:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c0c8390 con 0x7fe91c0c3380 2023-10-08T16:15:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c0cba20 con 0x7fe91c06cf90 2023-10-08T16:15:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91a7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe91c15d930 0x7fe91c0cb310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55962/0 (socket says 172.21.15.3:55962) 2023-10-08T16:15:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91a7fc700 1 -- 172.21.15.3:0/718998679 learned_addr learned my addr 172.21.15.3:0/718998679 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91affd700 1 --2- 172.21.15.3:0/718998679 >> v2:172.21.15.3:3300/0 conn(0x7fe91c0c3380 0x7fe91c0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91b7fe700 1 --2- 172.21.15.3:0/718998679 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe919ffb700 1 -- 172.21.15.3:0/718998679 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279833712 0 0) 0x7fe90c001110 con 0x7fe91c15d930 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe919ffb700 1 -- 172.21.15.3:0/718998679 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe908003570 con 0x7fe91c15d930 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91b7fe700 1 -- 172.21.15.3:0/718998679 >> v2:172.21.15.3:3300/0 conn(0x7fe91c0c3380 msgr2=0x7fe91c0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91b7fe700 1 --2- 172.21.15.3:0/718998679 >> v2:172.21.15.3:3300/0 conn(0x7fe91c0c3380 0x7fe91c0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91b7fe700 1 -- 172.21.15.3:0/718998679 >> v1:172.21.15.3:6789/0 conn(0x7fe91c15d930 legacy=0x7fe91c0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe919ffb700 1 -- 172.21.15.3:0/718998679 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347874606 0 0) 0x7fe908003570 con 0x7fe91c15d930 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91b7fe700 1 -- 172.21.15.3:0/718998679 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0c7500 con 0x7fe91c06cf90 2023-10-08T16:15:10.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91affd700 1 --2- 172.21.15.3:0/718998679 >> v2:172.21.15.3:3300/0 conn(0x7fe91c0c3380 0x7fe91c0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:10.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91b7fe700 1 --2- 172.21.15.3:0/718998679 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c06d3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe914009e60 tx=0x7fe914009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9f25e880674ebe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe919ffb700 1 -- 172.21.15.3:0/718998679 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400e070 con 0x7fe91c06cf90 2023-10-08T16:15:10.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe919ffb700 1 -- 172.21.15.3:0/718998679 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe91400bab0 con 0x7fe91c06cf90 2023-10-08T16:15:10.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe919ffb700 1 -- 172.21.15.3:0/718998679 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400be70 con 0x7fe91c06cf90 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- 172.21.15.3:0/718998679 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 msgr2=0x7fe91c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 --2- 172.21.15.3:0/718998679 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c06d3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe914009e60 tx=0x7fe914009780 comp rx=0 tx=0).stop 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- 172.21.15.3:0/718998679 shutdown_connections 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 --2- 172.21.15.3:0/718998679 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c06d3f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 --2- 172.21.15.3:0/718998679 >> v2:172.21.15.3:3300/0 conn(0x7fe91c0c3380 0x7fe91c0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- 172.21.15.3:0/718998679 >> 172.21.15.3:0/718998679 conn(0x7fe91c06b5b0 msgr2=0x7fe91c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- 172.21.15.3:0/718998679 shutdown_connections 2023-10-08T16:15:10.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.625+0000 7fe91bfff700 1 -- 172.21.15.3:0/718998679 wait complete. 2023-10-08T16:15:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 Processor -- start 2023-10-08T16:15:10.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 -- start start 2023-10-08T16:15:10.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c0c3380 0x7fe91c169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 0x7fe91c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c16cc20 con 0x7fe91c15d930 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c169b10 con 0x7fe91c0c3380 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c169df0 con 0x7fe91c06cf90 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 0x7fe91c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 0x7fe91c157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34730/0 (socket says 172.21.15.3:34730) 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 -- 172.21.15.3:0/3705636924 learned_addr learned my addr 172.21.15.3:0/3705636924 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91affd700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91a7fc700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c0c3380 0x7fe91c169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 -- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 msgr2=0x7fe91c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 -- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c0c3380 msgr2=0x7fe91c169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c0c3380 0x7fe91c169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 -- 172.21.15.3:0/3705636924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904009420 con 0x7fe91c15d930 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91b7fe700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 0x7fe91c157860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe914012970 tx=0x7fe914009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914026480 con 0x7fe91c15d930 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914009a20 con 0x7fe91c15d930 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe914026600 con 0x7fe91c15d930 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9140269c0 con 0x7fe91c15d930 2023-10-08T16:15:10.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.629+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c154820 con 0x7fe91c15d930 2023-10-08T16:15:10.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.633+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c16c710 con 0x7fe91c15d930 2023-10-08T16:15:10.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.633+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe91401c400 con 0x7fe91c15d930 2023-10-08T16:15:10.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.633+0000 7fe912ffd700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8fc060550 0x7fe8fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.633+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7fe91407e9f0 con 0x7fe91c15d930 2023-10-08T16:15:10.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.633+0000 7fe91affd700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8fc060550 0x7fe8fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.633+0000 7fe91affd700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8fc060550 0x7fe8fc062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe9040093f0 tx=0x7fe904008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.641+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe91c16c710 con 0x7fe91c15d930 2023-10-08T16:15:10.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.829+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe91c16c710 con 0x7fe91c15d930 2023-10-08T16:15:10.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe912ffd700 1 -- 172.21.15.3:0/3705636924 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fe91c16c710 con 0x7fe91c15d930 2023-10-08T16:15:10.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:10.839 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:09:49.438145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:15:10.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8fc060550 msgr2=0x7fe8fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8fc060550 0x7fe8fc062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe9040093f0 tx=0x7fe904008040 comp rx=0 tx=0).stop 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 msgr2=0x7fe91c157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 0x7fe91c157860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe914012970 tx=0x7fe914009780 comp rx=0 tx=0).stop 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 shutdown_connections 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe8fc060550 0x7fe8fc062a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe91c15d930 0x7fe91c157860 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c0c3380 0x7fe91c169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 --2- 172.21.15.3:0/3705636924 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe91c06cf90 0x7fe91c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 >> 172.21.15.3:0/3705636924 conn(0x7fe91c06b5b0 msgr2=0x7fe91c0687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:10.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 shutdown_connections 2023-10-08T16:15:10.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.833+0000 7fe91bfff700 1 -- 172.21.15.3:0/3705636924 wait complete. 2023-10-08T16:15:10.843 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T16:15:10.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:10.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 Processor -- start 2023-10-08T16:15:10.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 -- start start 2023-10-08T16:15:10.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5ddc0aa960 0x7f5ddc0aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 0x7f5ddc0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc06c260 con 0x7f5ddc159e20 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc06b650 con 0x7f5ddc0aa960 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de2b06700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc06b930 con 0x7f5ddc0c6920 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de1303700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 0x7f5ddc0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de1b04700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5ddc0aa960 0x7f5ddc0aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de1303700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 0x7f5ddc0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:50636/0 (socket says 172.21.15.3:50636) 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.957+0000 7f5de1303700 1 -- 172.21.15.3:0/2320758370 learned_addr learned my addr 172.21.15.3:0/2320758370 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de1303700 1 -- 172.21.15.3:0/2320758370 >> v2:172.21.15.27:3300/0 conn(0x7f5ddc0aa960 msgr2=0x7f5ddc0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de1303700 1 --2- 172.21.15.3:0/2320758370 >> v2:172.21.15.27:3300/0 conn(0x7f5ddc0aa960 0x7f5ddc0aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de1303700 1 -- 172.21.15.3:0/2320758370 >> v1:172.21.15.27:6789/0 conn(0x7f5ddc159e20 legacy=0x7f5ddc06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de1303700 1 -- 172.21.15.3:0/2320758370 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc06bc10 con 0x7f5ddc0c6920 2023-10-08T16:15:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de0b02700 1 -- 172.21.15.3:0/2320758370 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003227621 0 0) 0x7f5ddc06c260 con 0x7f5ddc159e20 2023-10-08T16:15:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de1303700 1 --2- 172.21.15.3:0/2320758370 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 0x7f5ddc0c6d70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0099b0 tx=0x7f5dcc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ce95caa25ff1d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de0b02700 1 -- 172.21.15.3:0/2320758370 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc009ea0 con 0x7f5ddc0c6920 2023-10-08T16:15:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de0b02700 1 -- 172.21.15.3:0/2320758370 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f5dcc00b860 con 0x7f5ddc0c6920 2023-10-08T16:15:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de0b02700 1 -- 172.21.15.3:0/2320758370 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00bc00 con 0x7f5ddc0c6920 2023-10-08T16:15:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 -- 172.21.15.3:0/2320758370 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 msgr2=0x7f5ddc0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 --2- 172.21.15.3:0/2320758370 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 0x7f5ddc0c6d70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0099b0 tx=0x7f5dcc009250 comp rx=0 tx=0).stop 2023-10-08T16:15:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 -- 172.21.15.3:0/2320758370 shutdown_connections 2023-10-08T16:15:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 --2- 172.21.15.3:0/2320758370 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc0c6920 0x7f5ddc0c6d70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 --2- 172.21.15.3:0/2320758370 >> v2:172.21.15.27:3300/0 conn(0x7f5ddc0aa960 0x7f5ddc0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 -- 172.21.15.3:0/2320758370 >> 172.21.15.3:0/2320758370 conn(0x7f5ddc0c83d0 msgr2=0x7f5ddc0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 -- 172.21.15.3:0/2320758370 shutdown_connections 2023-10-08T16:15:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 -- 172.21.15.3:0/2320758370 wait complete. 2023-10-08T16:15:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 Processor -- start 2023-10-08T16:15:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.961+0000 7f5de2b06700 1 -- start start 2023-10-08T16:15:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 0x7f5ddc0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ddc0c6920 0x7f5ddc0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc159e20 0x7f5ddc169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c5ad0 con 0x7f5ddc0aa960 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c9530 con 0x7f5ddc0c6920 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c9af0 con 0x7f5ddc159e20 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 0x7f5ddc0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 0x7f5ddc0c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34732/0 (socket says 172.21.15.3:34732) 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 -- 172.21.15.3:0/903090725 learned_addr learned my addr 172.21.15.3:0/903090725 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1303700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ddc0c6920 0x7f5ddc0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2305700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc159e20 0x7f5ddc169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 -- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc159e20 msgr2=0x7f5ddc169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc159e20 0x7f5ddc169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 -- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ddc0c6920 msgr2=0x7f5ddc0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ddc0c6920 0x7f5ddc0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 -- 172.21.15.3:0/903090725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0094f0 con 0x7f5ddc0aa960 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2305700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc159e20 0x7f5ddc169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de1b04700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 0x7f5ddc0c5590 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800e930 tx=0x7f5dd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8013680 con 0x7f5ddc0aa960 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f5dd80137e0 con 0x7f5ddc0aa960 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8013b80 con 0x7f5ddc0aa960 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc169d90 con 0x7f5ddc0aa960 2023-10-08T16:15:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.965+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc0c9780 con 0x7f5ddc0aa960 2023-10-08T16:15:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.969+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc04be40 con 0x7f5ddc0aa960 2023-10-08T16:15:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.969+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5dd800c460 con 0x7f5ddc0aa960 2023-10-08T16:15:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.969+0000 7f5dd1ffb700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5dc0060550 0x7f5dc0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.969+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f5dd807ca20 con 0x7f5ddc0aa960 2023-10-08T16:15:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.969+0000 7f5de1303700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5dc0060550 0x7f5dc0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.969+0000 7f5de1303700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5dc0060550 0x7f5dc0062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0090b0 tx=0x7f5dcc009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:10.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:10.977+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5dd804cfb0 con 0x7f5ddc0aa960 2023-10-08T16:15:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.173+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ddc06bef0 con 0x7f5ddc0aa960 2023-10-08T16:15:11.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5dd1ffb700 1 -- 172.21.15.3:0/903090725 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f5dd80505d0 con 0x7f5ddc0aa960 2023-10-08T16:15:11.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:11.184 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:35.863860+0000","modified":"2023-10-08T16:09:49.438145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5406":{"gid":5406,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6837/1848134842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1848134842},{"type":"v1","addr":"172.21.15.3:6837","nonce":1848134842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5dc0060550 msgr2=0x7f5dc0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5dc0060550 0x7f5dc0062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0090b0 tx=0x7f5dcc009250 comp rx=0 tx=0).stop 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 msgr2=0x7f5ddc0c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 0x7f5ddc0c5590 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800e930 tx=0x7f5dd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 shutdown_connections 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5dc0060550 0x7f5dc0062a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5ddc159e20 0x7f5ddc169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ddc0c6920 0x7f5ddc0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 --2- 172.21.15.3:0/903090725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0aa960 0x7f5ddc0c5590 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 >> 172.21.15.3:0/903090725 conn(0x7f5ddc0c83d0 msgr2=0x7f5ddc0abb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 shutdown_connections 2023-10-08T16:15:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.177+0000 7f5de2b06700 1 -- 172.21.15.3:0/903090725 wait complete. 2023-10-08T16:15:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T16:15:11.198 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:11.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f818547f700 1 Processor -- start 2023-10-08T16:15:11.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f818547f700 1 -- start start 2023-10-08T16:15:11.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f818547f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800aa960 0x7f81800aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f818547f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818006c260 con 0x7f81800c6920 2023-10-08T16:15:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f818547f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818006b650 con 0x7f818015a530 2023-10-08T16:15:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f818547f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818006b930 con 0x7f81800aa960 2023-10-08T16:15:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f8177fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f81800c6920 0x7f8180159e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55970/0 (socket says 172.21.15.3:55970) 2023-10-08T16:15:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f8177fff700 1 -- 172.21.15.3:0/1007987909 learned_addr learned my addr 172.21.15.3:0/1007987909 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:11.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f817ffff700 1 --2- 172.21.15.3:0/1007987909 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800aa960 0x7f81800aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685357352 0 0) 0x7f818006c260 con 0x7f81800c6920 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f816c003570 con 0x7f81800c6920 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268894479 0 0) 0x7f818006b650 con 0x7f818015a530 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f818006c260 con 0x7f818015a530 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.297+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2968811104 0 0) 0x7f816c003570 con 0x7f81800c6920 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817ffff700 1 -- 172.21.15.3:0/1007987909 >> v1:172.21.15.27:6789/0 conn(0x7f818015a530 legacy=0x7f8180160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817ffff700 1 -- 172.21.15.3:0/1007987909 >> v1:172.21.15.3:6789/0 conn(0x7f81800c6920 legacy=0x7f8180159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817ffff700 1 -- 172.21.15.3:0/1007987909 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818006bc10 con 0x7f81800aa960 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817ffff700 1 --2- 172.21.15.3:0/1007987909 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800aa960 0x7f81800aad30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8170009910 tx=0x7f81700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419a0509471a597d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168001470 con 0x7f81800aa960 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8170011420 con 0x7f81800aa960 2023-10-08T16:15:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f817f7fe700 1 -- 172.21.15.3:0/1007987909 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700117c0 con 0x7f81800aa960 2023-10-08T16:15:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 -- 172.21.15.3:0/1007987909 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800aa960 msgr2=0x7f81800aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 --2- 172.21.15.3:0/1007987909 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800aa960 0x7f81800aad30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8170009910 tx=0x7f81700091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 -- 172.21.15.3:0/1007987909 shutdown_connections 2023-10-08T16:15:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 --2- 172.21.15.3:0/1007987909 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800aa960 0x7f81800aad30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 -- 172.21.15.3:0/1007987909 >> 172.21.15.3:0/1007987909 conn(0x7f81800c83d0 msgr2=0x7f81800c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 -- 172.21.15.3:0/1007987909 shutdown_connections 2023-10-08T16:15:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.301+0000 7f818547f700 1 -- 172.21.15.3:0/1007987909 wait complete. 2023-10-08T16:15:11.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 Processor -- start 2023-10-08T16:15:11.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 -- start start 2023-10-08T16:15:11.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81800aa960 0x7f81801435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800c6920 0x7f8180167290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 0x7f818006cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81800b0380 con 0x7f818015a530 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180143b30 con 0x7f81800aa960 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8180167c00 con 0x7f81800c6920 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 0x7f818006cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 0x7f818006cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34740/0 (socket says 172.21.15.3:34740) 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 -- 172.21.15.3:0/2512917339 learned_addr learned my addr 172.21.15.3:0/2512917339 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f817ffff700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81800aa960 0x7f81801435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8177fff700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800c6920 0x7f8180167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 -- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800c6920 msgr2=0x7f8180167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800c6920 0x7f8180167290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 -- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81800aa960 msgr2=0x7f81801435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81800aa960 0x7f81801435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 -- 172.21.15.3:0/2512917339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170009420 con 0x7f818015a530 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f8184c7e700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 0x7f818006cc40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f817800c910 tx=0x7f8178007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178012630 con 0x7f818015a530 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f81780127b0 con 0x7f818015a530 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178012b70 con 0x7f818015a530 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8180167ee0 con 0x7f818015a530 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.305+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81800b0010 con 0x7f818015a530 2023-10-08T16:15:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.309+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81800b0530 con 0x7f818015a530 2023-10-08T16:15:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.309+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f817801b400 con 0x7f818015a530 2023-10-08T16:15:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.309+0000 7f817cff9700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8160060580 0x7f8160062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.309+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f817807cbf0 con 0x7f818015a530 2023-10-08T16:15:11.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.309+0000 7f817ffff700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8160060580 0x7f8160062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.309+0000 7f817ffff700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8160060580 0x7f8160062a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f817000a010 tx=0x7f81700091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.317+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f817804d180 con 0x7f818015a530 2023-10-08T16:15:11.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.477+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f818004be40 con 0x7f818015a530 2023-10-08T16:15:11.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.477+0000 7f817cff9700 1 -- 172.21.15.3:0/2512917339 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15410 (secure 0 0 0) 0x7f8178016090 con 0x7f818015a530 2023-10-08T16:15:11.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:11.486 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":47,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:15:06.487348+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:34.133440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:34.862986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3875502896":"2023-10-08T17:15:06.455191+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8160060580 msgr2=0x7f8160062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8160060580 0x7f8160062a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f817000a010 tx=0x7f81700091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 msgr2=0x7f818006cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 0x7f818006cc40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f817800c910 tx=0x7f8178007f90 comp rx=0 tx=0).stop 2023-10-08T16:15:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 shutdown_connections 2023-10-08T16:15:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8160060580 0x7f8160062a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f818015a530 0x7f818006cc40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f81800c6920 0x7f8180167290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 --2- 172.21.15.3:0/2512917339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81800aa960 0x7f81801435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 >> 172.21.15.3:0/2512917339 conn(0x7f81800c83d0 msgr2=0x7f81800c1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:11.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 shutdown_connections 2023-10-08T16:15:11.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.481+0000 7f818547f700 1 -- 172.21.15.3:0/2512917339 wait complete. 2023-10-08T16:15:11.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:15:11.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.601+0000 7f3285e6d700 1 Processor -- start 2023-10-08T16:15:11.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.601+0000 7f3285e6d700 1 -- start start 2023-10-08T16:15:11.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.601+0000 7f3285e6d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 0x7f32800c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.601+0000 7f3285e6d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32800ae870 con 0x7f328006add0 2023-10-08T16:15:11.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.601+0000 7f3285e6d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328006a940 con 0x7f3280155ce0 2023-10-08T16:15:11.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.601+0000 7f3285e6d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328006a610 con 0x7f32800c75f0 2023-10-08T16:15:11.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f328006add0 0x7f328006b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55976/0 (socket says 172.21.15.3:55976) 2023-10-08T16:15:11.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 -- 172.21.15.3:0/2478435213 learned_addr learned my addr 172.21.15.3:0/2478435213 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3277fff700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 0x7f32800c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852387604 0 0) 0x7f32800ae870 con 0x7f328006add0 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3268003570 con 0x7f328006add0 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710478734 0 0) 0x7f3268003570 con 0x7f328006add0 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 msgr2=0x7f32800c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 0x7f32800c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 >> v1:172.21.15.27:6789/0 conn(0x7f3280155ce0 legacy=0x7f32800c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800cad50 con 0x7f328006add0 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7f32780017f0 con 0x7f328006add0 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 >> v1:172.21.15.3:6789/0 conn(0x7f328006add0 legacy=0x7f328006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3268003a90 0x7f3268003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 0x7f3268004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3268004d50 0x7f32680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328006a610 con 0x7f3268004d50 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326800ddb0 con 0x7f3268003a90 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326800df70 con 0x7f32800c75f0 2023-10-08T16:15:11.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3268004d50 0x7f32680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3277fff700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 0x7f3268004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3284e6b700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3268003a90 0x7f3268003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 -- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 msgr2=0x7f3268004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f32800c75f0 0x7f3268004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 -- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3268003a90 msgr2=0x7f3268003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3268003a90 0x7f3268003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 -- 172.21.15.3:0/2478435213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268003570 con 0x7f3268004d50 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3268004d50 0x7f32680051c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f327800a930 tx=0x7f32780021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1bd67dd4d040f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780070d0 con 0x7f3268004d50 2023-10-08T16:15:11.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f3278007230 con 0x7f3268004d50 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f32777fe700 1 -- 172.21.15.3:0/2478435213 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780075d0 con 0x7f3268004d50 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3285e6d700 1 -- 172.21.15.3:0/2478435213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3268004d50 msgr2=0x7f32680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3285e6d700 1 --2- 172.21.15.3:0/2478435213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3268004d50 0x7f32680051c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f327800a930 tx=0x7f32780021d0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f328566c700 1 -- 172.21.15.3:0/2478435213 reap_dead start 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3285e6d700 1 -- 172.21.15.3:0/2478435213 shutdown_connections 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3285e6d700 1 -- 172.21.15.3:0/2478435213 >> 172.21.15.3:0/2478435213 conn(0x7f32800c83d0 msgr2=0x7f32800c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3285e6d700 1 -- 172.21.15.3:0/2478435213 shutdown_connections 2023-10-08T16:15:11.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.605+0000 7f3285e6d700 1 -- 172.21.15.3:0/2478435213 wait complete. 2023-10-08T16:15:11.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 Processor -- start 2023-10-08T16:15:11.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 -- start start 2023-10-08T16:15:11.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3280153b00 0x7f3280153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3280166550 0x7f32801501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 0x7f3280150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280150c50 con 0x7f32801669c0 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800c3a90 con 0x7f3280153b00 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32800c4270 con 0x7f3280166550 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 0x7f3280150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 0x7f3280150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34766/0 (socket says 172.21.15.3:34766) 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 -- 172.21.15.3:0/696431038 learned_addr learned my addr 172.21.15.3:0/696431038 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3284e6b700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3280153b00 0x7f3280153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3277fff700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3280166550 0x7f32801501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 -- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3280166550 msgr2=0x7f32801501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3280166550 0x7f32801501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 -- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3280153b00 msgr2=0x7f3280153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3280153b00 0x7f3280153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 -- 172.21.15.3:0/696431038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800c4550 con 0x7f32801669c0 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f328566c700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 0x7f3280150710 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f327800a3f0 tx=0x7f32780021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278007b50 con 0x7f32801669c0 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f32780018b0 con 0x7f32801669c0 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32800c4830 con 0x7f32801669c0 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780075d0 con 0x7f32801669c0 2023-10-08T16:15:11.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.609+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32800c5030 con 0x7f32801669c0 2023-10-08T16:15:11.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.613+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32800c5ab0 con 0x7f32801669c0 2023-10-08T16:15:11.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.613+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f327801e640 con 0x7f32801669c0 2023-10-08T16:15:11.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.613+0000 7f3274ff9700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f326c060550 0x7f326c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.613+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5806+0+0 (secure 0 0 0) 0x7f327807eb80 con 0x7f32801669c0 2023-10-08T16:15:11.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.613+0000 7f3284e6b700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f326c060550 0x7f326c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.613+0000 7f3284e6b700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f326c060550 0x7f326c062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f327c007e40 tx=0x7f327c007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.621+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f327804f0f0 con 0x7f32801669c0 2023-10-08T16:15:11.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.813+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f328004be40 con 0x7f32801669c0 2023-10-08T16:15:11.820 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T16:15:11.813+0000 7ff88634f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:15:11.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.825+0000 7f3274ff9700 1 -- 172.21.15.3:0/696431038 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3278052710 con 0x7f32801669c0 2023-10-08T16:15:11.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f326c060550 msgr2=0x7f326c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f326c060550 0x7f326c062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f327c007e40 tx=0x7f327c007d30 comp rx=0 tx=0).stop 2023-10-08T16:15:11.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 msgr2=0x7f3280150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 0x7f3280150710 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f327800a3f0 tx=0x7f32780021d0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 shutdown_connections 2023-10-08T16:15:11.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f326c060550 0x7f326c062a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32801669c0 0x7f3280150710 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3280166550 0x7f32801501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 --2- 172.21.15.3:0/696431038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3280153b00 0x7f3280153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 >> 172.21.15.3:0/696431038 conn(0x7f32800c83d0 msgr2=0x7f32800c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 shutdown_connections 2023-10-08T16:15:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.829+0000 7f3285e6d700 1 -- 172.21.15.3:0/696431038 wait complete. 2023-10-08T16:15:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:15:11.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:15:11.880 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-10-08T16:15:11.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.949+0000 7f77accda700 1 Processor -- start 2023-10-08T16:15:11.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.949+0000 7f77accda700 1 -- start start 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f77a8158c80 0x7f77a815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f77a806db60 0x7f77a806b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a80b45a0 con 0x7f77a80b37c0 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a815a060 con 0x7f77a8158c80 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a806a3a0 con 0x7f77a806db60 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f77a8158c80 0x7f77a815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f77a8158c80 0x7f77a815d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34786/0 (socket says 172.21.15.3:34786) 2023-10-08T16:15:11.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 -- 172.21.15.3:0/3512994056 learned_addr learned my addr 172.21.15.3:0/3512994056 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:11.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f779effd700 1 --2- 172.21.15.3:0/3512994056 >> v2:172.21.15.27:3300/0 conn(0x7f77a806db60 0x7f77a806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 -- 172.21.15.3:0/3512994056 >> v2:172.21.15.27:3300/0 conn(0x7f77a806db60 msgr2=0x7f77a806b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:11.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 --2- 172.21.15.3:0/3512994056 >> v2:172.21.15.27:3300/0 conn(0x7f77a806db60 0x7f77a806b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 -- 172.21.15.3:0/3512994056 >> v1:172.21.15.27:6789/0 conn(0x7f77a80b37c0 legacy=0x7f77a806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 -- 172.21.15.3:0/3512994056 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a806a680 con 0x7f77a8158c80 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a77fe700 1 --2- 172.21.15.3:0/3512994056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a8158c80 0x7f77a815d4c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f77a80b2990 tx=0x7f7798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4655996fa243b779 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a6ffd700 1 -- 172.21.15.3:0/3512994056 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798009e70 con 0x7f77a8158c80 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a6ffd700 1 -- 172.21.15.3:0/3512994056 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f779800b8f0 con 0x7f77a8158c80 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77a6ffd700 1 -- 172.21.15.3:0/3512994056 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779800bc90 con 0x7f77a8158c80 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- 172.21.15.3:0/3512994056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a8158c80 msgr2=0x7f77a815d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 --2- 172.21.15.3:0/3512994056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a8158c80 0x7f77a815d4c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f77a80b2990 tx=0x7f7798009250 comp rx=0 tx=0).stop 2023-10-08T16:15:11.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- 172.21.15.3:0/3512994056 shutdown_connections 2023-10-08T16:15:11.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 --2- 172.21.15.3:0/3512994056 >> v2:172.21.15.27:3300/0 conn(0x7f77a806db60 0x7f77a806b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 --2- 172.21.15.3:0/3512994056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a8158c80 0x7f77a815d4c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- 172.21.15.3:0/3512994056 >> 172.21.15.3:0/3512994056 conn(0x7f77a80d0820 msgr2=0x7f77a80b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:11.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- 172.21.15.3:0/3512994056 shutdown_connections 2023-10-08T16:15:11.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.953+0000 7f77accda700 1 -- 172.21.15.3:0/3512994056 wait complete. 2023-10-08T16:15:11.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 Processor -- start 2023-10-08T16:15:11.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 -- start start 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 0x7f77a81468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f77a80b37c0 0x7f77a80aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77a8158c80 0x7f77a80acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80a9580 con 0x7f77a806db60 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80a8970 con 0x7f77a8158c80 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77accda700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80a8c50 con 0x7f77a80b37c0 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 0x7f77a81468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 0x7f77a81468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34790/0 (socket says 172.21.15.3:34790) 2023-10-08T16:15:11.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 -- 172.21.15.3:0/1043360802 learned_addr learned my addr 172.21.15.3:0/1043360802 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f779effd700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f77a80b37c0 0x7f77a80aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a7fff700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77a8158c80 0x7f77a80acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 -- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f77a80b37c0 msgr2=0x7f77a80aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f77a80b37c0 0x7f77a80aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 -- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77a8158c80 msgr2=0x7f77a80acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77a8158c80 0x7f77a80acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.957+0000 7f77a77fe700 1 -- 172.21.15.3:0/1043360802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980094f0 con 0x7f77a806db60 2023-10-08T16:15:11.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f77a77fe700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 0x7f77a81468c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7798006fd0 tx=0x7f7798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798006bc0 con 0x7f77a806db60 2023-10-08T16:15:11.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f779800bc70 con 0x7f77a806db60 2023-10-08T16:15:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779801a6a0 con 0x7f77a806db60 2023-10-08T16:15:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a80a8f30 con 0x7f77a806db60 2023-10-08T16:15:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a80af230 con 0x7f77a806db60 2023-10-08T16:15:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a804be40 con 0x7f77a806db60 2023-10-08T16:15:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f779801aa10 con 0x7f77a806db60 2023-10-08T16:15:11.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779ffff700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7788060550 0x7f7788062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:11.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5892+0+0 (secure 0 0 0) 0x7f779807df90 con 0x7f77a806db60 2023-10-08T16:15:11.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.961+0000 7f779effd700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7788060550 0x7f7788062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:11.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.965+0000 7f779effd700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7788060550 0x7f7788062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77a80b4100 tx=0x7f77900091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:11.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:11.969+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f779804e420 con 0x7f77a806db60 2023-10-08T16:15:12.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.165+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77a8069ba0 con 0x7f77a806db60 2023-10-08T16:15:12.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.833+0000 7f779ffff700 1 -- 172.21.15.3:0/1043360802 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7798051a40 con 0x7f77a806db60 2023-10-08T16:15:12.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7788060550 msgr2=0x7f7788062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7788060550 0x7f7788062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77a80b4100 tx=0x7f77900091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 msgr2=0x7f77a81468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 0x7f77a81468c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7798006fd0 tx=0x7f7798009250 comp rx=0 tx=0).stop 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 shutdown_connections 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f7788060550 0x7f7788062a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77a8158c80 0x7f77a80acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f77a80b37c0 0x7f77a80aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 --2- 172.21.15.3:0/1043360802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77a806db60 0x7f77a81468c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 >> 172.21.15.3:0/1043360802 conn(0x7f77a80d0820 msgr2=0x7f77a81525d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:12.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 shutdown_connections 2023-10-08T16:15:12.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.837+0000 7f77accda700 1 -- 172.21.15.3:0/1043360802 wait complete. 2023-10-08T16:15:12.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:15:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 Processor -- start 2023-10-08T16:15:12.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- start start 2023-10-08T16:15:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fa8155930 0x7f0fa80c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0fa8155d00 0x7f0fa80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:12.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa80c6c20 con 0x7f0fa8068df0 2023-10-08T16:15:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80c7830 con 0x7f0fa8155d00 2023-10-08T16:15:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80c6f00 con 0x7f0fa8155930 2023-10-08T16:15:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fade80700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0fa8068df0 0x7f0fa81596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56002/0 (socket says 172.21.15.3:56002) 2023-10-08T16:15:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0face7e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0fa8155d00 0x7f0fa80688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:12.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fade80700 1 -- 172.21.15.3:0/3506034283 learned_addr learned my addr 172.21.15.3:0/3506034283 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fad67f700 1 --2- 172.21.15.3:0/3506034283 >> v2:172.21.15.27:3300/0 conn(0x7f0fa8155930 0x7f0fa80c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0f9ffff700 1 -- 172.21.15.3:0/3506034283 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735667669 0 0) 0x7f0fa80c6c20 con 0x7f0fa8068df0 2023-10-08T16:15:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0f9ffff700 1 -- 172.21.15.3:0/3506034283 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f94003570 con 0x7f0fa8068df0 2023-10-08T16:15:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0face7e700 1 -- 172.21.15.3:0/3506034283 >> v2:172.21.15.27:3300/0 conn(0x7f0fa8155930 msgr2=0x7f0fa80c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:12.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0face7e700 1 --2- 172.21.15.3:0/3506034283 >> v2:172.21.15.27:3300/0 conn(0x7f0fa8155930 0x7f0fa80c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0face7e700 1 -- 172.21.15.3:0/3506034283 >> v1:172.21.15.3:6789/0 conn(0x7f0fa8068df0 legacy=0x7f0fa81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0face7e700 1 -- 172.21.15.3:0/3506034283 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80c71e0 con 0x7f0fa8155d00 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0face7e700 1 --2- 172.21.15.3:0/3506034283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa80688b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80c3180 tx=0x7f0f980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b240dd1cba8e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0f9ffff700 1 -- 172.21.15.3:0/3506034283 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011630 con 0x7f0fa8155d00 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0f9ffff700 1 -- 172.21.15.3:0/3506034283 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0f980117b0 con 0x7f0fa8155d00 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0f9ffff700 1 -- 172.21.15.3:0/3506034283 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011b70 con 0x7f0fa8155d00 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- 172.21.15.3:0/3506034283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 msgr2=0x7f0fa80688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 --2- 172.21.15.3:0/3506034283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa80688b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80c3180 tx=0x7f0f980091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- 172.21.15.3:0/3506034283 shutdown_connections 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 --2- 172.21.15.3:0/3506034283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa80688b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 --2- 172.21.15.3:0/3506034283 >> v2:172.21.15.27:3300/0 conn(0x7f0fa8155930 0x7f0fa80c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:12.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- 172.21.15.3:0/3506034283 >> 172.21.15.3:0/3506034283 conn(0x7f0fa80c8c30 msgr2=0x7f0fa80c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- 172.21.15.3:0/3506034283 shutdown_connections 2023-10-08T16:15:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.981+0000 7f0fae681700 1 -- 172.21.15.3:0/3506034283 wait complete. 2023-10-08T16:15:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 Processor -- start 2023-10-08T16:15:12.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 -- start start 2023-10-08T16:15:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0fa8068df0 0x7f0fa814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fa8155930 0x7f0fa80c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa81505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:12.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8151510 con 0x7f0fa8155d00 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8156e10 con 0x7f0fa8155930 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fae681700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8151230 con 0x7f0fa8068df0 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.985+0000 7f0fade80700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa81505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa81505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34804/0 (socket says 172.21.15.3:34804) 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 -- 172.21.15.3:0/3792952931 learned_addr learned my addr 172.21.15.3:0/3792952931 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fad67f700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0fa8068df0 0x7f0fa814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:12.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0face7e700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fa8155930 0x7f0fa80c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 -- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0fa8068df0 msgr2=0x7f0fa814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:12.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0fa8068df0 0x7f0fa814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 -- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fa8155930 msgr2=0x7f0fa80c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fa8155930 0x7f0fa80c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 -- 172.21.15.3:0/3792952931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009420 con 0x7f0fa8155d00 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fade80700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa81505e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001460 tx=0x7f0fa0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000a870 con 0x7f0fa8155d00 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0fa000a9d0 con 0x7f0fa8155d00 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa80b0280 con 0x7f0fa8155d00 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000ad50 con 0x7f0fa8155d00 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa80b0840 con 0x7f0fa8155d00 2023-10-08T16:15:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.989+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa804be40 con 0x7f0fa8155d00 2023-10-08T16:15:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.993+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0fa0007300 con 0x7f0fa8155d00 2023-10-08T16:15:13.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.993+0000 7f0f9d7fa700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f8c060550 0x7f0f8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.993+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5892+0+0 (secure 0 0 0) 0x7f0fa007cb60 con 0x7f0fa8155d00 2023-10-08T16:15:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.993+0000 7f0fad67f700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f8c060550 0x7f0f8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:13.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.993+0000 7f0fad67f700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f8c060550 0x7f0f8c062a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009da0 tx=0x7f0fa4009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:13.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:12.997+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0fa004d160 con 0x7f0fa8155d00 2023-10-08T16:15:13.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.161+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fa80b0a30 con 0x7f0fa8155d00 2023-10-08T16:15:13.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.841+0000 7f0f9d7fa700 1 -- 172.21.15.3:0/3792952931 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0fa0050780 con 0x7f0fa8155d00 2023-10-08T16:15:13.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.845+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f8c060550 msgr2=0x7f0f8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:13.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.845+0000 7f0fae681700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f8c060550 0x7f0f8c062a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009da0 tx=0x7f0fa4009120 comp rx=0 tx=0).stop 2023-10-08T16:15:13.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.845+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 msgr2=0x7f0fa81505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:13.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.845+0000 7f0fae681700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa81505e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001460 tx=0x7f0fa0001a40 comp rx=0 tx=0).stop 2023-10-08T16:15:13.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 shutdown_connections 2023-10-08T16:15:13.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f0f8c060550 0x7f0f8c062a00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fa8155d00 0x7f0fa81505e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fa8155930 0x7f0fa80c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 --2- 172.21.15.3:0/3792952931 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0fa8068df0 0x7f0fa814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 >> 172.21.15.3:0/3792952931 conn(0x7f0fa80c8c30 msgr2=0x7f0fa80ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 shutdown_connections 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.849+0000 7f0fae681700 1 -- 172.21.15.3:0/3792952931 wait complete. 2023-10-08T16:15:13.864 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:15:13.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:15:13.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 Processor -- start 2023-10-08T16:15:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 -- start start 2023-10-08T16:15:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b8067c80 0x7fe8b80680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe8b815a780 0x7fe8b815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b815b100 con 0x7fe8b80c7c30 2023-10-08T16:15:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be1c5700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe8b80c7c30 0x7fe8b806e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56006/0 (socket says 172.21.15.3:56006) 2023-10-08T16:15:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be1c5700 1 -- 172.21.15.3:0/1470942070 learned_addr learned my addr 172.21.15.3:0/1470942070 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b806d220 con 0x7fe8b815a780 2023-10-08T16:15:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b806d500 con 0x7fe8b8067c80 2023-10-08T16:15:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be9c6700 1 --2- 172.21.15.3:0/1470942070 >> v2:172.21.15.27:3300/0 conn(0x7fe8b815a780 0x7fe8b815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bd9c4700 1 --2- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b8067c80 0x7fe8b80680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bd1c3700 1 -- 172.21.15.3:0/1470942070 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202251343 0 0) 0x7fe8b815b100 con 0x7fe8b80c7c30 2023-10-08T16:15:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8bd1c3700 1 -- 172.21.15.3:0/1470942070 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a4003570 con 0x7fe8b80c7c30 2023-10-08T16:15:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be9c6700 1 -- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b8067c80 msgr2=0x7fe8b80680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be9c6700 1 --2- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b8067c80 0x7fe8b80680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be9c6700 1 -- 172.21.15.3:0/1470942070 >> v1:172.21.15.3:6789/0 conn(0x7fe8b80c7c30 legacy=0x7fe8b806e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.981+0000 7fe8be9c6700 1 -- 172.21.15.3:0/1470942070 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b806d7e0 con 0x7fe8b815a780 2023-10-08T16:15:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8be9c6700 1 --2- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b815abc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009e60 tx=0x7fe8b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74c8ebfc12d7eae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bd1c3700 1 -- 172.21.15.3:0/1470942070 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000e070 con 0x7fe8b815a780 2023-10-08T16:15:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bd1c3700 1 -- 172.21.15.3:0/1470942070 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe8b000bb60 con 0x7fe8b815a780 2023-10-08T16:15:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bd1c3700 1 -- 172.21.15.3:0/1470942070 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0012430 con 0x7fe8b815a780 2023-10-08T16:15:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 msgr2=0x7fe8b815abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b815abc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009e60 tx=0x7fe8b0009780 comp rx=0 tx=0).stop 2023-10-08T16:15:13.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 shutdown_connections 2023-10-08T16:15:13.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b815abc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/1470942070 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b8067c80 0x7fe8b80680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:13.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.985+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 >> 172.21.15.3:0/1470942070 conn(0x7fe8b80c8c30 msgr2=0x7fe8b80c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:13.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.989+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 shutdown_connections 2023-10-08T16:15:13.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.989+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/1470942070 wait complete. 2023-10-08T16:15:13.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 Processor -- start 2023-10-08T16:15:13.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 -- start start 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 0x7fe8b80b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b80c7c30 0x7fe8b80aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b8150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80af4a0 con 0x7fe8b8067c80 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8151350 con 0x7fe8b815a780 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8165f30 con 0x7fe8b80c7c30 2023-10-08T16:15:14.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 0x7fe8b80b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 0x7fe8b80b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34810/0 (socket says 172.21.15.3:34810) 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 -- 172.21.15.3:0/4245518915 learned_addr learned my addr 172.21.15.3:0/4245518915 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be9c6700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b8150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bd9c4700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b80c7c30 0x7fe8b80aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 -- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b80c7c30 msgr2=0x7fe8b80aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b80c7c30 0x7fe8b80aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 -- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 msgr2=0x7fe8b8150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:14.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b8150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:14.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 -- 172.21.15.3:0/4245518915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009a20 con 0x7fe8b8067c80 2023-10-08T16:15:14.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8be1c5700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 0x7fe8b80b1480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c560 tx=0x7fe8b4007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:14.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40072e0 con 0x7fe8b8067c80 2023-10-08T16:15:14.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe8b4007460 con 0x7fe8b8067c80 2023-10-08T16:15:14.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40057f0 con 0x7fe8b8067c80 2023-10-08T16:15:14.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b80af6b0 con 0x7fe8b8067c80 2023-10-08T16:15:14.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.993+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b80afc70 con 0x7fe8b8067c80 2023-10-08T16:15:14.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.997+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe8b4005be0 con 0x7fe8b8067c80 2023-10-08T16:15:14.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.997+0000 7fe8ae7fc700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe89c060550 0x7fe89c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:14.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.997+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5454+0+0 (secure 0 0 0) 0x7fe8b407bb80 con 0x7fe8b8067c80 2023-10-08T16:15:14.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.997+0000 7fe8bd9c4700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe89c060550 0x7fe89c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:14.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.997+0000 7fe8bd9c4700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe89c060550 0x7fe89c062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81516b0 tx=0x7fe8a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:14.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:13.997+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b804be40 con 0x7fe8b8067c80 2023-10-08T16:15:14.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.005+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe8b404c2f0 con 0x7fe8b8067c80 2023-10-08T16:15:14.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.193+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8b806cd30 con 0x7fe8b8067c80 2023-10-08T16:15:14.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:14.230 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:14.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.845+0000 7fe8ae7fc700 1 -- 172.21.15.3:0/4245518915 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8b4017020 con 0x7fe8b8067c80 2023-10-08T16:15:14.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe89c060550 msgr2=0x7fe89c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:14.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe89c060550 0x7fe89c062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81516b0 tx=0x7fe8a8008040 comp rx=0 tx=0).stop 2023-10-08T16:15:14.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 msgr2=0x7fe8b80b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:14.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 0x7fe8b80b1480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c560 tx=0x7fe8b4007c60 comp rx=0 tx=0).stop 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 shutdown_connections 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fe89c060550 0x7fe89c062a00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b815a780 0x7fe8b8150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fe8b80c7c30 0x7fe8b80aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 --2- 172.21.15.3:0/4245518915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8b8067c80 0x7fe8b80b1480 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.849+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 >> 172.21.15.3:0/4245518915 conn(0x7fe8b80c8c30 msgr2=0x7fe8b80caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:14.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.853+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 shutdown_connections 2023-10-08T16:15:14.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:14.853+0000 7fe8bf1c7700 1 -- 172.21.15.3:0/4245518915 wait complete. 2023-10-08T16:15:14.860 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T16:15:14.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm client client_inject_fixed_oldest_tid 2023-10-08T16:15:15.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.045+0000 7f1db60f4700 1 Processor -- start 2023-10-08T16:15:15.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.045+0000 7f1db60f4700 1 -- start start 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1db60f4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1db015c1d0 0x7f1db006aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1db60f4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 0x7f1db00cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1db60f4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db006c700 con 0x7f1db015c5a0 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1db60f4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db006b040 con 0x7f1db015c1d0 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1db60f4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db006b320 con 0x7f1db00adf10 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 0x7f1db00cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1db015c1d0 0x7f1db006aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 0x7f1db00cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:50756/0 (socket says 172.21.15.3:50756) 2023-10-08T16:15:15.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 -- 172.21.15.3:0/218319543 learned_addr learned my addr 172.21.15.3:0/218319543 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:15.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 -- 172.21.15.3:0/218319543 >> v2:172.21.15.27:3300/0 conn(0x7f1db015c1d0 msgr2=0x7f1db006aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:15.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 --2- 172.21.15.3:0/218319543 >> v2:172.21.15.27:3300/0 conn(0x7f1db015c1d0 0x7f1db006aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 -- 172.21.15.3:0/218319543 >> v1:172.21.15.27:6789/0 conn(0x7f1db015c5a0 legacy=0x7f1db00ad800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:15:15.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 -- 172.21.15.3:0/218319543 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db006b600 con 0x7f1db00adf10 2023-10-08T16:15:15.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1daffff700 1 --2- 172.21.15.3:0/218319543 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 0x7f1db00cafe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1da40099b0 tx=0x7f1da4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105963f1f7fc0c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1dae7fc700 1 -- 172.21.15.3:0/218319543 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4009ea0 con 0x7f1db00adf10 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1dae7fc700 1 -- 172.21.15.3:0/218319543 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f1da400b820 con 0x7f1db00adf10 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.049+0000 7f1dae7fc700 1 -- 172.21.15.3:0/218319543 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400bba0 con 0x7f1db00adf10 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 -- 172.21.15.3:0/218319543 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 msgr2=0x7f1db00cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 --2- 172.21.15.3:0/218319543 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 0x7f1db00cafe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1da40099b0 tx=0x7f1da4009250 comp rx=0 tx=0).stop 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 -- 172.21.15.3:0/218319543 shutdown_connections 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 --2- 172.21.15.3:0/218319543 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db00adf10 0x7f1db00cafe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 --2- 172.21.15.3:0/218319543 >> v2:172.21.15.27:3300/0 conn(0x7f1db015c1d0 0x7f1db006aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 -- 172.21.15.3:0/218319543 >> 172.21.15.3:0/218319543 conn(0x7f1db00cc440 msgr2=0x7f1db00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:15.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 -- 172.21.15.3:0/218319543 shutdown_connections 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.053+0000 7f1db60f4700 1 -- 172.21.15.3:0/218319543 wait complete. 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 Processor -- start 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 -- start start 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db00adf10 0x7f1db0175e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db015c1d0 0x7f1db0150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 0x7f1db01533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db014fd90 con 0x7f1db00adf10 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01795a0 con 0x7f1db0086670 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1db60f4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01764a0 con 0x7f1db015c1d0 2023-10-08T16:15:15.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1daffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 0x7f1db01533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1daffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 0x7f1db01533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:60190/0 (socket says 172.21.15.3:60190) 2023-10-08T16:15:15.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.057+0000 7f1daffff700 1 -- 172.21.15.3:0/1571233929 learned_addr learned my addr 172.21.15.3:0/1571233929 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1daffff700 1 -- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db015c1d0 msgr2=0x7f1db0150000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1daffff700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db015c1d0 0x7f1db0150000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1daffff700 1 -- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db00adf10 msgr2=0x7f1db0175e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1daffff700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db00adf10 0x7f1db0175e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1daffff700 1 -- 172.21.15.3:0/1571233929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40094f0 con 0x7f1db0086670 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1daffff700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 0x7f1db01533d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1db006b460 tx=0x7f1da4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400ba10 con 0x7f1db0086670 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f1da4020070 con 0x7f1db0086670 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da401b6a0 con 0x7f1db0086670 2023-10-08T16:15:15.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db0176780 con 0x7f1db0086670 2023-10-08T16:15:15.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.061+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db0176d40 con 0x7f1db0086670 2023-10-08T16:15:15.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.065+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1da4022030 con 0x7f1db0086670 2023-10-08T16:15:15.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.069+0000 7f1d977fe700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1d9c0606a0 0x7f1d9c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.069+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f1da407e330 con 0x7f1db0086670 2023-10-08T16:15:15.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.069+0000 7f1daf7fe700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1d9c0606a0 0x7f1d9c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.069+0000 7f1daf7fe700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1d9c0606a0 0x7f1d9c062b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1db0156300 tx=0x7f1da8011040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.069+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db01796e0 con 0x7f1db0086670 2023-10-08T16:15:15.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.077+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1db01796e0 con 0x7f1db0086670 2023-10-08T16:15:15.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.421+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "client", "name": "client_inject_fixed_oldest_tid"} v 0) v1 -- 0x7f1db004be40 con 0x7f1db0086670 2023-10-08T16:15:15.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.433+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 7 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da404ec50 con 0x7f1db0086670 2023-10-08T16:15:15.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1d977fe700 1 -- 172.21.15.3:0/1571233929 <== mon.1 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "client", "name": "client_inject_fixed_oldest_tid"}]=0 v20) v1 ==== 116+0+0 (secure 0 0 0) 0x7f1da4052450 con 0x7f1db0086670 2023-10-08T16:15:15.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1d9c0606a0 msgr2=0x7f1d9c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1d9c0606a0 0x7f1d9c062b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1db0156300 tx=0x7f1da8011040 comp rx=0 tx=0).stop 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 msgr2=0x7f1db01533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 0x7f1db01533d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1db006b460 tx=0x7f1da4009250 comp rx=0 tx=0).stop 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 shutdown_connections 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1d9c0606a0 0x7f1d9c062b50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db0086670 0x7f1db01533d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f1db015c1d0 0x7f1db0150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 --2- 172.21.15.3:0/1571233929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db00adf10 0x7f1db0175e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 >> 172.21.15.3:0/1571233929 conn(0x7f1db00cc440 msgr2=0x7f1db015b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 shutdown_connections 2023-10-08T16:15:15.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.437+0000 7f1db60f4700 1 -- 172.21.15.3:0/1571233929 wait complete. 2023-10-08T16:15:15.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_completed_requests 2023-10-08T16:15:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.573+0000 7fb9af59e700 1 Processor -- start 2023-10-08T16:15:15.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.573+0000 7fb9af59e700 1 -- start start 2023-10-08T16:15:15.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9af59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9b0155d80 0x7fb9b00b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9af59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b006d5f0 con 0x7fb9b00af000 2023-10-08T16:15:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9af59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b006e190 con 0x7fb9b00b14c0 2023-10-08T16:15:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9af59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b006c700 con 0x7fb9b0155d80 2023-10-08T16:15:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9ae59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb9b00af000 0x7fb9b006da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56018/0 (socket says 172.21.15.3:56018) 2023-10-08T16:15:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9ae59c700 1 -- 172.21.15.3:0/3447372885 learned_addr learned my addr 172.21.15.3:0/3447372885 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9a7fff700 1 --2- 172.21.15.3:0/3447372885 >> v2:172.21.15.27:3300/0 conn(0x7fb9b0155d80 0x7fb9b00b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9add9b700 1 -- 172.21.15.3:0/3447372885 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73747647 0 0) 0x7fb9b006d5f0 con 0x7fb9b00af000 2023-10-08T16:15:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9add9b700 1 -- 172.21.15.3:0/3447372885 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb99c003570 con 0x7fb9b00af000 2023-10-08T16:15:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9a7fff700 1 -- 172.21.15.3:0/3447372885 >> v1:172.21.15.27:6789/0 conn(0x7fb9b00b14c0 legacy=0x7fb9b00af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9a7fff700 1 -- 172.21.15.3:0/3447372885 >> v1:172.21.15.3:6789/0 conn(0x7fb9b00af000 legacy=0x7fb9b006da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9a7fff700 1 -- 172.21.15.3:0/3447372885 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b006c9e0 con 0x7fb9b0155d80 2023-10-08T16:15:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9a7fff700 1 --2- 172.21.15.3:0/3447372885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b0155d80 0x7fb9b00b0f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00098e0 tx=0x7fb9a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9a5e6ca0f27b2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9add9b700 1 -- 172.21.15.3:0/3447372885 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000b640 con 0x7fb9b0155d80 2023-10-08T16:15:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9add9b700 1 -- 172.21.15.3:0/3447372885 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a000b7a0 con 0x7fb9b0155d80 2023-10-08T16:15:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.577+0000 7fb9add9b700 1 -- 172.21.15.3:0/3447372885 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000bb20 con 0x7fb9b0155d80 2023-10-08T16:15:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- 172.21.15.3:0/3447372885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b0155d80 msgr2=0x7fb9b00b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 --2- 172.21.15.3:0/3447372885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b0155d80 0x7fb9b00b0f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00098e0 tx=0x7fb9a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- 172.21.15.3:0/3447372885 shutdown_connections 2023-10-08T16:15:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 --2- 172.21.15.3:0/3447372885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b0155d80 0x7fb9b00b0f80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- 172.21.15.3:0/3447372885 >> 172.21.15.3:0/3447372885 conn(0x7fb9b0067b30 msgr2=0x7fb9b00adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- 172.21.15.3:0/3447372885 shutdown_connections 2023-10-08T16:15:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- 172.21.15.3:0/3447372885 wait complete. 2023-10-08T16:15:15.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 Processor -- start 2023-10-08T16:15:15.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- start start 2023-10-08T16:15:15.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb9b00af000 0x7fb9b014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b00b14c0 0x7fb9b00abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 0x7fb9b014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00c57a0 con 0x7fb9b0155d80 2023-10-08T16:15:15.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00ac560 con 0x7fb9b00b14c0 2023-10-08T16:15:15.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9af59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00ac840 con 0x7fb9b00af000 2023-10-08T16:15:15.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 0x7fb9b014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9a7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b00b14c0 0x7fb9b00abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 0x7fb9b014c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34820/0 (socket says 172.21.15.3:34820) 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 -- 172.21.15.3:0/493986240 learned_addr learned my addr 172.21.15.3:0/493986240 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9ae59c700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb9b00af000 0x7fb9b014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 -- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb9b00af000 msgr2=0x7fb9b014add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb9b00af000 0x7fb9b014add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 -- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b00b14c0 msgr2=0x7fb9b00abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b00b14c0 0x7fb9b00abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 -- 172.21.15.3:0/493986240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009420 con 0x7fb9b0155d80 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9aed9d700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 0x7fb9b014c7a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c910 tx=0x7fb9a80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.581+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8012630 con 0x7fb9b0155d80 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b00acb20 con 0x7fb9b0155d80 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80127b0 con 0x7fb9b0155d80 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8012b70 con 0x7fb9b0155d80 2023-10-08T16:15:15.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b014b310 con 0x7fb9b0155d80 2023-10-08T16:15:15.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b004be40 con 0x7fb9b0155d80 2023-10-08T16:15:15.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb9a8003030 con 0x7fb9b0155d80 2023-10-08T16:15:15.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9a67fc700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb990060550 0x7fb990062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fb9a807c480 con 0x7fb9b0155d80 2023-10-08T16:15:15.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9ae59c700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb990060550 0x7fb990062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.585+0000 7fb9ae59c700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb990060550 0x7fb990062a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb998007fd0 tx=0x7fb998009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.593+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9a804cd40 con 0x7fb9b0155d80 2023-10-08T16:15:15.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.757+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_completed_requests"} v 0) v1 -- 0x7fb9b00c58e0 con 0x7fb9b0155d80 2023-10-08T16:15:15.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9a67fc700 1 -- 172.21.15.3:0/493986240 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_completed_requests"}]=0 v21) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb9a8050360 con 0x7fb9b0155d80 2023-10-08T16:15:15.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb990060550 msgr2=0x7fb990062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb990060550 0x7fb990062a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb998007fd0 tx=0x7fb998009040 comp rx=0 tx=0).stop 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 msgr2=0x7fb9b014c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 0x7fb9b014c7a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c910 tx=0x7fb9a80016d0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 shutdown_connections 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fb990060550 0x7fb990062a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9b0155d80 0x7fb9b014c7a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b00b14c0 0x7fb9b00abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 --2- 172.21.15.3:0/493986240 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fb9b00af000 0x7fb9b014add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 >> 172.21.15.3:0/493986240 conn(0x7fb9b0067b30 msgr2=0x7fb9b014dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:15.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 shutdown_connections 2023-10-08T16:15:15.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.765+0000 7fb9af59e700 1 -- 172.21.15.3:0/493986240 wait complete. 2023-10-08T16:15:15.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:15:15.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.881+0000 7f4652873700 1 Processor -- start 2023-10-08T16:15:15.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.881+0000 7f4652873700 1 -- start start 2023-10-08T16:15:15.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f464c0cd420 0x7f464c06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f464c159410 0x7f464c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0cb380 con 0x7f464c159040 2023-10-08T16:15:15.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0caa90 con 0x7f464c0cd420 2023-10-08T16:15:15.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c06b850 con 0x7f464c159410 2023-10-08T16:15:15.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f464c0cd420 0x7f464c06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f464c0cd420 0x7f464c06aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34830/0 (socket says 172.21.15.3:34830) 2023-10-08T16:15:15.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 -- 172.21.15.3:0/2689818253 learned_addr learned my addr 172.21.15.3:0/2689818253 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:15.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4650e10700 1 --2- 172.21.15.3:0/2689818253 >> v2:172.21.15.27:3300/0 conn(0x7f464c159410 0x7f464c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 -- 172.21.15.3:0/2689818253 >> v2:172.21.15.27:3300/0 conn(0x7f464c159410 msgr2=0x7f464c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 --2- 172.21.15.3:0/2689818253 >> v2:172.21.15.27:3300/0 conn(0x7f464c159410 0x7f464c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 -- 172.21.15.3:0/2689818253 >> v1:172.21.15.3:6789/0 conn(0x7f464c159040 legacy=0x7f464c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 -- 172.21.15.3:0/2689818253 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0cad30 con 0x7f464c0cd420 2023-10-08T16:15:15.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4650e10700 1 --2- 172.21.15.3:0/2689818253 >> v2:172.21.15.27:3300/0 conn(0x7f464c159410 0x7f464c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464b7fe700 1 --2- 172.21.15.3:0/2689818253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c0cd420 0x7f464c06aed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f464c0cb2f0 tx=0x7f4640009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91effe09fe9893e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464affd700 1 -- 172.21.15.3:0/2689818253 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464000b860 con 0x7f464c0cd420 2023-10-08T16:15:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464affd700 1 -- 172.21.15.3:0/2689818253 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464000b9c0 con 0x7f464c0cd420 2023-10-08T16:15:15.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f464affd700 1 -- 172.21.15.3:0/2689818253 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464000bd60 con 0x7f464c0cd420 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- 172.21.15.3:0/2689818253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c0cd420 msgr2=0x7f464c06aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 --2- 172.21.15.3:0/2689818253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c0cd420 0x7f464c06aed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f464c0cb2f0 tx=0x7f4640009250 comp rx=0 tx=0).stop 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- 172.21.15.3:0/2689818253 shutdown_connections 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 --2- 172.21.15.3:0/2689818253 >> v2:172.21.15.27:3300/0 conn(0x7f464c159410 0x7f464c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 --2- 172.21.15.3:0/2689818253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c0cd420 0x7f464c06aed0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- 172.21.15.3:0/2689818253 >> 172.21.15.3:0/2689818253 conn(0x7f464c0d0920 msgr2=0x7f464c0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- 172.21.15.3:0/2689818253 shutdown_connections 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- 172.21.15.3:0/2689818253 wait complete. 2023-10-08T16:15:15.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 Processor -- start 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.885+0000 7f4652873700 1 -- start start 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0cd420 0x7f464c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 0x7f464c1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f464c0b59f0 0x7f464c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c6f00 con 0x7f464c159040 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c7710 con 0x7f464c0cd420 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c7150 con 0x7f464c0b59f0 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 0x7f464c1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0cd420 0x7f464c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 0x7f464c1525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34836/0 (socket says 172.21.15.3:34836) 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 -- 172.21.15.3:0/2561810043 learned_addr learned my addr 172.21.15.3:0/2561810043 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4650e10700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f464c0b59f0 0x7f464c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 -- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f464c0b59f0 msgr2=0x7f464c0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f464c0b59f0 0x7f464c0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 -- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0cd420 msgr2=0x7f464c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0cd420 0x7f464c155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 -- 172.21.15.3:0/2561810043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400094f0 con 0x7f464c159040 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464bfff700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0cd420 0x7f464c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f464b7fe700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 0x7f464c1525d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4640006fd0 tx=0x7f4640017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640024440 con 0x7f464c159040 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400245a0 con 0x7f464c159040 2023-10-08T16:15:15.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0c7430 con 0x7f464c159040 2023-10-08T16:15:15.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640024960 con 0x7f464c159040 2023-10-08T16:15:15.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0b4590 con 0x7f464c159040 2023-10-08T16:15:15.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.889+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c071180 con 0x7f464c159040 2023-10-08T16:15:15.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.893+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f464001a420 con 0x7f464c159040 2023-10-08T16:15:15.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.893+0000 7f4633fff700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4638060580 0x7f4638062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:15.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.893+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f464007e860 con 0x7f464c159040 2023-10-08T16:15:15.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.893+0000 7f464bfff700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4638060580 0x7f4638062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:15.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.893+0000 7f464bfff700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4638060580 0x7f4638062a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f463c001dc0 tx=0x7f463c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:15.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:15.901+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f464004f1a0 con 0x7f464c159040 2023-10-08T16:15:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.057+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f464c0b4780 con 0x7f464c159040 2023-10-08T16:15:16.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.065+0000 7f4633fff700 1 -- 172.21.15.3:0/2561810043 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46400527c0 con 0x7f464c159040 2023-10-08T16:15:16.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4638060580 msgr2=0x7f4638062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4638060580 0x7f4638062a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f463c001dc0 tx=0x7f463c009040 comp rx=0 tx=0).stop 2023-10-08T16:15:16.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 msgr2=0x7f464c1525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 0x7f464c1525d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4640006fd0 tx=0x7f4640017000 comp rx=0 tx=0).stop 2023-10-08T16:15:16.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 shutdown_connections 2023-10-08T16:15:16.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f4638060580 0x7f4638062a30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f464c0b59f0 0x7f464c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f464c159040 0x7f464c1525d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 --2- 172.21.15.3:0/2561810043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0cd420 0x7f464c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 >> 172.21.15.3:0/2561810043 conn(0x7f464c0d0920 msgr2=0x7f464c0c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:16.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 shutdown_connections 2023-10-08T16:15:16.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.069+0000 7f4652873700 1 -- 172.21.15.3:0/2561810043 wait complete. 2023-10-08T16:15:16.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_metadata_threshold 2023-10-08T16:15:16.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 Processor -- start 2023-10-08T16:15:16.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 -- start start 2023-10-08T16:15:16.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc02006ce10 0x7fc02006a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02015a440 0x7fc0200ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200c63d0 con 0x7fc02015a070 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02006b790 con 0x7fc02006ce10 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc027c8b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02006ab80 con 0x7fc02015a440 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc025a27700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc02015a070 0x7fc02006c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56046/0 (socket says 172.21.15.3:56046) 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc025a27700 1 -- 172.21.15.3:0/971693787 learned_addr learned my addr 172.21.15.3:0/971693787 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc026228700 1 --2- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02015a440 0x7fc0200ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.185+0000 7fc025226700 1 --2- 172.21.15.3:0/971693787 >> v2:172.21.15.27:3300/0 conn(0x7fc02006ce10 0x7fc02006a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc024a25700 1 -- 172.21.15.3:0/971693787 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501159987 0 0) 0x7fc0200c63d0 con 0x7fc02015a070 2023-10-08T16:15:16.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc024a25700 1 -- 172.21.15.3:0/971693787 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc00c003570 con 0x7fc02015a070 2023-10-08T16:15:16.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc025226700 1 -- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02015a440 msgr2=0x7fc0200ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:16.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc025226700 1 --2- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02015a440 0x7fc0200ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc025226700 1 -- 172.21.15.3:0/971693787 >> v1:172.21.15.3:6789/0 conn(0x7fc02015a070 legacy=0x7fc02006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc025226700 1 -- 172.21.15.3:0/971693787 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02006ae60 con 0x7fc02006ce10 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc025226700 1 --2- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02006ce10 0x7fc02006a4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0100098e0 tx=0x7fc0100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41fe6ce74546fa10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc024a25700 1 -- 172.21.15.3:0/971693787 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc010011630 con 0x7fc02006ce10 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc024a25700 1 -- 172.21.15.3:0/971693787 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc010011790 con 0x7fc02006ce10 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc024a25700 1 -- 172.21.15.3:0/971693787 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc010011b10 con 0x7fc02006ce10 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 -- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02006ce10 msgr2=0x7fc02006a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 --2- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02006ce10 0x7fc02006a4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0100098e0 tx=0x7fc0100091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 -- 172.21.15.3:0/971693787 shutdown_connections 2023-10-08T16:15:16.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 --2- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02015a440 0x7fc0200ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 --2- 172.21.15.3:0/971693787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02006ce10 0x7fc02006a4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 -- 172.21.15.3:0/971693787 >> 172.21.15.3:0/971693787 conn(0x7fc0200cc510 msgr2=0x7fc0200c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:16.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 -- 172.21.15.3:0/971693787 shutdown_connections 2023-10-08T16:15:16.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 -- 172.21.15.3:0/971693787 wait complete. 2023-10-08T16:15:16.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 Processor -- start 2023-10-08T16:15:16.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.189+0000 7fc027c8b700 1 -- start start 2023-10-08T16:15:16.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02006ce10 0x7fc0200ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02015a070 0x7fc0200aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 0x7fc0200af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200cb690 con 0x7fc02015a440 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200a8bb0 con 0x7fc02015a070 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200cab10 con 0x7fc02006ce10 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 0x7fc0200af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 0x7fc0200af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34844/0 (socket says 172.21.15.3:34844) 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 -- 172.21.15.3:0/111277162 learned_addr learned my addr 172.21.15.3:0/111277162 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc025226700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02015a070 0x7fc0200aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc025a27700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02006ce10 0x7fc0200ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 -- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02006ce10 msgr2=0x7fc0200ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02006ce10 0x7fc0200ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 -- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02015a070 msgr2=0x7fc0200aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02015a070 0x7fc0200aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 -- 172.21.15.3:0/111277162 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009420 con 0x7fc02015a440 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc025226700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02015a070 0x7fc0200aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:16.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc025a27700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02006ce10 0x7fc0200ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:16.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc026228700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 0x7fc0200af7d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc018009df0 tx=0x7fc01800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:16.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800cb50 con 0x7fc02015a440 2023-10-08T16:15:16.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800f040 con 0x7fc02015a440 2023-10-08T16:15:16.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0200cadf0 con 0x7fc02015a440 2023-10-08T16:15:16.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018014480 con 0x7fc02015a440 2023-10-08T16:15:16.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200cb3b0 con 0x7fc02015a440 2023-10-08T16:15:16.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc018014830 con 0x7fc02015a440 2023-10-08T16:15:16.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.193+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc020071180 con 0x7fc02015a440 2023-10-08T16:15:16.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.197+0000 7fc015ffb700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc004060580 0x7fc004062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.197+0000 7fc025a27700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc004060580 0x7fc004062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.197+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fc01807cea0 con 0x7fc02015a440 2023-10-08T16:15:16.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.197+0000 7fc025a27700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc004060580 0x7fc004062a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc01c007fd0 tx=0x7fc01c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:16.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.201+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc01804d6c0 con 0x7fc02015a440 2023-10-08T16:15:16.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.353+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_metadata_threshold"} v 0) v1 -- 0x7fc0200b1690 con 0x7fc02015a440 2023-10-08T16:15:16.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.365+0000 7fc015ffb700 1 -- 172.21.15.3:0/111277162 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_metadata_threshold"}]=0 v23) v1 ==== 113+0+0 (secure 0 0 0) 0x7fc0180180b0 con 0x7fc02015a440 2023-10-08T16:15:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc004060580 msgr2=0x7fc004062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc004060580 0x7fc004062a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc01c007fd0 tx=0x7fc01c009040 comp rx=0 tx=0).stop 2023-10-08T16:15:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 msgr2=0x7fc0200af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 0x7fc0200af7d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc018009df0 tx=0x7fc01800b040 comp rx=0 tx=0).stop 2023-10-08T16:15:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 shutdown_connections 2023-10-08T16:15:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc004060580 0x7fc004062a30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc02015a440 0x7fc0200af7d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc02015a070 0x7fc0200aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 --2- 172.21.15.3:0/111277162 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc02006ce10 0x7fc0200ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 >> 172.21.15.3:0/111277162 conn(0x7fc0200cc510 msgr2=0x7fc0201557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 shutdown_connections 2023-10-08T16:15:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.369+0000 7fc027c8b700 1 -- 172.21.15.3:0/111277162 wait complete. 2023-10-08T16:15:16.392 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2023-10-08T16:15:16.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 Processor -- start 2023-10-08T16:15:16.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 -- start start 2023-10-08T16:15:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f215413eed0 0x7f21540c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2154068990 0x7f21540c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21540c7fb0 con 0x7f21540c7ac0 2023-10-08T16:15:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21540c8290 con 0x7f215413eed0 2023-10-08T16:15:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.485+0000 7f2153fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21540c8570 con 0x7f2154068990 2023-10-08T16:15:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f215413eed0 0x7f21540c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f215413eed0 0x7f21540c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34858/0 (socket says 172.21.15.3:34858) 2023-10-08T16:15:16.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 -- 172.21.15.3:0/672215573 learned_addr learned my addr 172.21.15.3:0/672215573 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f214bfff700 1 --1- 172.21.15.3:0/672215573 >> v1:172.21.15.3:6789/0 conn(0x7f21540c7ac0 0x7f2154068280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56052/0 (socket says 172.21.15.3:56052) 2023-10-08T16:15:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f21537fe700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2154068990 0x7f21540c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 -- 172.21.15.3:0/672215573 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2154068990 msgr2=0x7f21540c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2154068990 0x7f21540c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 -- 172.21.15.3:0/672215573 >> v1:172.21.15.3:6789/0 conn(0x7f21540c7ac0 legacy=0x7f2154068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 -- 172.21.15.3:0/672215573 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540c8850 con 0x7f215413eed0 2023-10-08T16:15:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f21537fe700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2154068990 0x7f21540c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2152ffd700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f21540c7580 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f214400bc40 tx=0x7f214400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad62ccf52d735cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f21527fc700 1 -- 172.21.15.3:0/672215573 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400db40 con 0x7f215413eed0 2023-10-08T16:15:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f21527fc700 1 -- 172.21.15.3:0/672215573 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400dca0 con 0x7f215413eed0 2023-10-08T16:15:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f21527fc700 1 -- 172.21.15.3:0/672215573 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144017640 con 0x7f215413eed0 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 -- 172.21.15.3:0/672215573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 msgr2=0x7f21540c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f21540c7580 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f214400bc40 tx=0x7f214400b4e0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 -- 172.21.15.3:0/672215573 shutdown_connections 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f2154068990 0x7f21540c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 --2- 172.21.15.3:0/672215573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f21540c7580 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 -- 172.21.15.3:0/672215573 >> 172.21.15.3:0/672215573 conn(0x7f21540c8c90 msgr2=0x7f21540c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:16.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 -- 172.21.15.3:0/672215573 shutdown_connections 2023-10-08T16:15:16.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 -- 172.21.15.3:0/672215573 wait complete. 2023-10-08T16:15:16.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 Processor -- start 2023-10-08T16:15:16.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.489+0000 7f2153fff700 1 -- start start 2023-10-08T16:15:16.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2154068990 0x7f215412c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f21540c7ac0 0x7f215412e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f215412eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154157340 con 0x7f215413eed0 2023-10-08T16:15:16.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21540b1f60 con 0x7f2154068990 2023-10-08T16:15:16.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2154156a10 con 0x7f21540c7ac0 2023-10-08T16:15:16.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f215412eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f215412eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34872/0 (socket says 172.21.15.3:34872) 2023-10-08T16:15:16.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 -- 172.21.15.3:0/2860333603 learned_addr learned my addr 172.21.15.3:0/2860333603 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2152ffd700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2154068990 0x7f215412c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f214bfff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f21540c7ac0 0x7f215412e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 -- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f21540c7ac0 msgr2=0x7f215412e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f21540c7ac0 0x7f215412e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 -- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2154068990 msgr2=0x7f215412c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2154068990 0x7f215412c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 -- 172.21.15.3:0/2860333603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214400b780 con 0x7f215413eed0 2023-10-08T16:15:16.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f21537fe700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f215412eda0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f214c00d0d0 tx=0x7f214c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:16.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00dc10 con 0x7f215413eed0 2023-10-08T16:15:16.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00f040 con 0x7f215413eed0 2023-10-08T16:15:16.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2154156cf0 con 0x7f215413eed0 2023-10-08T16:15:16.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c015440 con 0x7f215413eed0 2023-10-08T16:15:16.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.493+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215412ccf0 con 0x7f215413eed0 2023-10-08T16:15:16.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.497+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21541574b0 con 0x7f215413eed0 2023-10-08T16:15:16.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.497+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f214c01e3b0 con 0x7f215413eed0 2023-10-08T16:15:16.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.497+0000 7f214affd700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2134060550 0x7f2134062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:16.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.497+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f214c07c950 con 0x7f215413eed0 2023-10-08T16:15:16.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.497+0000 7f2152ffd700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2134060550 0x7f2134062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:16.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.497+0000 7f2152ffd700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2134060550 0x7f2134062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f214400b520 tx=0x7f2144019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:16.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.505+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f214c04d210 con 0x7f215413eed0 2023-10-08T16:15:16.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.721+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) v1 -- 0x7f215404be40 con 0x7f215413eed0 2023-10-08T16:15:16.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.873+0000 7f214affd700 1 -- 172.21.15.3:0/2860333603 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v331) v1 ==== 162+0+0 (secure 0 0 0) 0x7f214c050830 con 0x7f215413eed0 2023-10-08T16:15:16.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2134060550 msgr2=0x7f2134062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2134060550 0x7f2134062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f214400b520 tx=0x7f2144019000 comp rx=0 tx=0).stop 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 msgr2=0x7f215412eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f215412eda0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f214c00d0d0 tx=0x7f214c0099f0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 shutdown_connections 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f2134060550 0x7f2134062a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f215413eed0 0x7f215412eda0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f21540c7ac0 0x7f215412e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 --2- 172.21.15.3:0/2860333603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2154068990 0x7f215412c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 >> 172.21.15.3:0/2860333603 conn(0x7f21540c8c90 msgr2=0x7f21540ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 shutdown_connections 2023-10-08T16:15:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:16.877+0000 7f2153fff700 1 -- 172.21.15.3:0/2860333603 wait complete. 2023-10-08T16:15:16.903 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the ... ERROR 2023-10-08T16:15:16.903 INFO:tasks.cephfs_test_runner: 2023-10-08T16:15:16.903 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T16:15:16.903 INFO:tasks.cephfs_test_runner:ERROR: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_client_limits.py", line 282, in test_client_blocklisted_oldest_tid 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner: self.assertGreater(pd['mds_sessions']['md_thresh_evicted'], 0) 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:KeyError: 'md_thresh_evicted' 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner: 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:Ran 2 tests in 485.015s 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner: 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-08T16:15:16.904 INFO:tasks.cephfs_test_runner: 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner:ERROR: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_client_limits.py", line 282, in test_client_blocklisted_oldest_tid 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner: self.assertGreater(pd['mds_sessions']['md_thresh_evicted'], 0) 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner:KeyError: 'md_thresh_evicted' 2023-10-08T16:15:16.905 INFO:tasks.cephfs_test_runner: 2023-10-08T16:15:16.905 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-10-08T16:15:16.967 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c5afd8b3b3af4104b832a1f3b18ddf59 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-10-08T16:15:16.968 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-08T16:15:16.977 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-08T16:15:16.985 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-08T16:15:16.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:16.986 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-10-08T16:15:17.007 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:15:17.007 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:15:17.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:15:17.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.025 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:15:17.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2023-10-08T16:15:17.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.213 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-08T16:15:17.221 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:15:17.221 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:15:17.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.221 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:15:17.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:15:17.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:17.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-10-08T16:15:17.421 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T16:15:17.430 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-08T16:15:17.431 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8698b700 1 Processor -- start 2023-10-08T16:15:17.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8698b700 1 -- start start 2023-10-08T16:15:17.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8698b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbf8006d9f0 0x7fbf800aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8698b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8006c260 con 0x7fbf80159e20 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8698b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8006b650 con 0x7fbf800aa960 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8698b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8006b930 con 0x7fbf8006d9f0 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8618a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbf80159e20 0x7fbf80160a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56066/0 (socket says 172.21.15.3:56066) 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf8618a700 1 -- 172.21.15.3:0/1219236548 learned_addr learned my addr 172.21.15.3:0/1219236548 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf85188700 1 --2- 172.21.15.3:0/1219236548 >> v2:172.21.15.27:3300/0 conn(0x7fbf8006d9f0 0x7fbf800aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813519081 0 0) 0x7fbf8006c260 con 0x7fbf80159e20 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf6c003570 con 0x7fbf80159e20 2023-10-08T16:15:17.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104750852 0 0) 0x7fbf6c003570 con 0x7fbf80159e20 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.541+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 >> v2:172.21.15.27:3300/0 conn(0x7fbf8006d9f0 msgr2=0x7fbf800aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 --2- 172.21.15.3:0/1219236548 >> v2:172.21.15.27:3300/0 conn(0x7fbf8006d9f0 0x7fbf800aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 >> v1:172.21.15.27:6789/0 conn(0x7fbf800aa960 legacy=0x7fbf800c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8006bc10 con 0x7fbf80159e20 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fbf780017f0 con 0x7fbf80159e20 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 >> v1:172.21.15.3:6789/0 conn(0x7fbf80159e20 legacy=0x7fbf80160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf6c003a90 0x7fbf6c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c004810 0x7fbf6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf6c005210 0x7fbf6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8006b930 con 0x7fbf6c005210 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c00c130 con 0x7fbf6c004810 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c00c2c0 con 0x7fbf6c003a90 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf6c005210 0x7fbf6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf85188700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c004810 0x7fbf6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf85989700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf6c003a90 0x7fbf6c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 -- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf6c003a90 msgr2=0x7fbf6c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf6c003a90 0x7fbf6c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 -- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c004810 msgr2=0x7fbf6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:17.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c004810 0x7fbf6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 -- 172.21.15.3:0/1219236548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c003570 con 0x7fbf6c005210 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 -- 172.21.15.3:0/1219236548 reap_dead start 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8618a700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf6c005210 0x7fbf6c00ba60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800a960 tx=0x7fbf780021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3231ee600f6abe89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780070d0 con 0x7fbf6c005210 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78007230 con 0x7fbf6c005210 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf84987700 1 -- 172.21.15.3:0/1219236548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780075d0 con 0x7fbf6c005210 2023-10-08T16:15:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 -- 172.21.15.3:0/1219236548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf6c005210 msgr2=0x7fbf6c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf6c005210 0x7fbf6c00ba60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800a960 tx=0x7fbf780021d0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 -- 172.21.15.3:0/1219236548 shutdown_connections 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 --2- 172.21.15.3:0/1219236548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf6c005210 0x7fbf6c00ba60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 -- 172.21.15.3:0/1219236548 >> 172.21.15.3:0/1219236548 conn(0x7fbf800c83d0 msgr2=0x7fbf800c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 -- 172.21.15.3:0/1219236548 shutdown_connections 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.545+0000 7fbf8698b700 1 -- 172.21.15.3:0/1219236548 wait complete. 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 Processor -- start 2023-10-08T16:15:17.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 -- start start 2023-10-08T16:15:17.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c005210 0x7fbf80169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 0x7fbf80157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf80167250 0x7fbf80158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800c57c0 con 0x7fbf80166de0 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800c33e0 con 0x7fbf6c005210 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8698b700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801571e0 con 0x7fbf80167250 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 0x7fbf80157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 0x7fbf80157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34894/0 (socket says 172.21.15.3:34894) 2023-10-08T16:15:17.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 -- 172.21.15.3:0/3042306008 learned_addr learned my addr 172.21.15.3:0/3042306008 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85989700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c005210 0x7fbf80169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf8618a700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf80167250 0x7fbf80158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 -- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf80167250 msgr2=0x7fbf80158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf80167250 0x7fbf80158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 -- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c005210 msgr2=0x7fbf80169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c005210 0x7fbf80169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.549+0000 7fbf85188700 1 -- 172.21.15.3:0/3042306008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800c2ab0 con 0x7fbf80166de0 2023-10-08T16:15:17.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf85188700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 0x7fbf80157c40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbf74006ac0 tx=0x7fbf740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74011ec0 con 0x7fbf80166de0 2023-10-08T16:15:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400f940 con 0x7fbf80166de0 2023-10-08T16:15:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400fcc0 con 0x7fbf80166de0 2023-10-08T16:15:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf800c2d90 con 0x7fbf80166de0 2023-10-08T16:15:17.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8016a070 con 0x7fbf80166de0 2023-10-08T16:15:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf800c3550 con 0x7fbf80166de0 2023-10-08T16:15:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbf74014650 con 0x7fbf80166de0 2023-10-08T16:15:17.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf71ffb700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbf64060550 0x7fbf64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fbf74018030 con 0x7fbf80166de0 2023-10-08T16:15:17.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.553+0000 7fbf85989700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbf64060550 0x7fbf64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.557+0000 7fbf85989700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbf64060550 0x7fbf64062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c000c00 tx=0x7fbf7c00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:17.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.561+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf74051100 con 0x7fbf80166de0 2023-10-08T16:15:17.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.721+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf8004be40 con 0x7fbf80166de0 2023-10-08T16:15:17.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf71ffb700 1 -- 172.21.15.3:0/3042306008 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+12226 (secure 0 0 0) 0x7fbf74022020 con 0x7fbf80166de0 2023-10-08T16:15:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:17.732 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":50,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:15:14.837447+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:6837/1848134842":"2023-10-09T16:15:11.818135+0000","172.21.15.3:6836/1848134842":"2023-10-09T16:15:11.818135+0000","192.168.0.1:0/3875502896":"2023-10-08T17:15:06.455191+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:17.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbf64060550 msgr2=0x7fbf64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbf64060550 0x7fbf64062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c000c00 tx=0x7fbf7c00c040 comp rx=0 tx=0).stop 2023-10-08T16:15:17.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 msgr2=0x7fbf80157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 0x7fbf80157c40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbf74006ac0 tx=0x7fbf740091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 shutdown_connections 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fbf64060550 0x7fbf64062a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fbf80167250 0x7fbf80158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf80166de0 0x7fbf80157c40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 --2- 172.21.15.3:0/3042306008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6c005210 0x7fbf80169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 >> 172.21.15.3:0/3042306008 conn(0x7fbf800c83d0 msgr2=0x7fbf800ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:17.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 shutdown_connections 2023-10-08T16:15:17.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.725+0000 7fbf8698b700 1 -- 172.21.15.3:0/3042306008 wait complete. 2023-10-08T16:15:17.747 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:15:17.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:15:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.841+0000 7fa75359e700 1 Processor -- start 2023-10-08T16:15:17.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.841+0000 7fa75359e700 1 -- start start 2023-10-08T16:15:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7540c9680 0x7fa7540c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa75415d740 0x7fa7540c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540c7200 con 0x7fa7540cb880 2023-10-08T16:15:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540c6ff0 con 0x7fa7540c9680 2023-10-08T16:15:17.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c74e0 con 0x7fa75415d740 2023-10-08T16:15:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7540c9680 0x7fa7540c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7540c9680 0x7fa7540c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:60300/0 (socket says 172.21.15.3:60300) 2023-10-08T16:15:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 -- 172.21.15.3:0/130889655 learned_addr learned my addr 172.21.15.3:0/130889655 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa751d9b700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa75415d740 0x7fa7540c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa752d9d700 1 --1- 172.21.15.3:0/130889655 >> v1:172.21.15.27:6789/0 conn(0x7fa7540cb880 0x7fa7540aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:45416/0 (socket says 172.21.15.3:45416) 2023-10-08T16:15:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 -- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa75415d740 msgr2=0x7fa7540c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 --2- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa75415d740 0x7fa7540c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 -- 172.21.15.3:0/130889655 >> v1:172.21.15.27:6789/0 conn(0x7fa7540cb880 legacy=0x7fa7540aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 -- 172.21.15.3:0/130889655 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540c77c0 con 0x7fa7540c9680 2023-10-08T16:15:17.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75259c700 1 --2- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa7540c9a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009f20 tx=0x7fa74c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d70ebe3eb5a8dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75159a700 1 -- 172.21.15.3:0/130889655 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00e070 con 0x7fa7540c9680 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75159a700 1 -- 172.21.15.3:0/130889655 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c00b9d0 con 0x7fa7540c9680 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75159a700 1 -- 172.21.15.3:0/130889655 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0092e0 con 0x7fa7540c9680 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 -- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 msgr2=0x7fa7540c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 --2- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa7540c9a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009f20 tx=0x7fa74c009840 comp rx=0 tx=0).stop 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 -- 172.21.15.3:0/130889655 shutdown_connections 2023-10-08T16:15:17.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 --2- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa75415d740 0x7fa7540c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 --2- 172.21.15.3:0/130889655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa7540c9a50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.845+0000 7fa75359e700 1 -- 172.21.15.3:0/130889655 >> 172.21.15.3:0/130889655 conn(0x7fa75406b6b0 msgr2=0x7fa75406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- 172.21.15.3:0/130889655 shutdown_connections 2023-10-08T16:15:17.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- 172.21.15.3:0/130889655 wait complete. 2023-10-08T16:15:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 Processor -- start 2023-10-08T16:15:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- start start 2023-10-08T16:15:17.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa75416ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa7540cb880 0x7fa7540c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 0x7fa75416c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c5360 con 0x7fa75415d740 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c3570 con 0x7fa7540c9680 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c4a30 con 0x7fa7540cb880 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 0x7fa75416c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 0x7fa75416c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34896/0 (socket says 172.21.15.3:34896) 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 -- 172.21.15.3:0/3016441021 learned_addr learned my addr 172.21.15.3:0/3016441021 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75259c700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa75416ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa751d9b700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa7540cb880 0x7fa7540c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 -- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa7540cb880 msgr2=0x7fa7540c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa7540cb880 0x7fa7540c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 -- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 msgr2=0x7fa75416ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:17.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa75416ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 -- 172.21.15.3:0/3016441021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c009ae0 con 0x7fa75415d740 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa752d9d700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 0x7fa75416c590 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c7c0 tx=0x7fa744007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744005a70 con 0x7fa75415d740 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7540c4d10 con 0x7fa75415d740 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.849+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744005bd0 con 0x7fa75415d740 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.853+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75416b340 con 0x7fa75415d740 2023-10-08T16:15:17.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.853+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440070d0 con 0x7fa75415d740 2023-10-08T16:15:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.853+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540c5510 con 0x7fa75415d740 2023-10-08T16:15:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.853+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa744007480 con 0x7fa75415d740 2023-10-08T16:15:17.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.853+0000 7fa7427fc700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa734060550 0x7fa734062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.857+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fa74407b970 con 0x7fa75415d740 2023-10-08T16:15:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.857+0000 7fa75259c700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa734060550 0x7fa734062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:17.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.857+0000 7fa75259c700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa734060550 0x7fa734062a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7541588b0 tx=0x7fa74c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:17.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:17.861+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa7540c5510 con 0x7fa75415d740 2023-10-08T16:15:18.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.021+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa75404be40 con 0x7fa734060550 2023-10-08T16:15:18.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.025+0000 7fa7427fc700 1 -- 172.21.15.3:0/3016441021 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48740 (secure 0 0 0) 0x7fa75404be40 con 0x7fa734060550 2023-10-08T16:15:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:18.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa734060550 msgr2=0x7fa734062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa734060550 0x7fa734062a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7541588b0 tx=0x7fa74c018000 comp rx=0 tx=0).stop 2023-10-08T16:15:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 msgr2=0x7fa75416c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 0x7fa75416c590 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c7c0 tx=0x7fa744007eb0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 shutdown_connections 2023-10-08T16:15:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa734060550 0x7fa734062a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75415d740 0x7fa75416c590 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa7540cb880 0x7fa7540c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 --2- 172.21.15.3:0/3016441021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7540c9680 0x7fa75416ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 >> 172.21.15.3:0/3016441021 conn(0x7fa75406b6b0 msgr2=0x7fa75406cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 shutdown_connections 2023-10-08T16:15:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.029+0000 7fa75359e700 1 -- 172.21.15.3:0/3016441021 wait complete. 2023-10-08T16:15:18.039 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:15:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2023-10-08T16:15:17.991733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2437384,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752537336,"statfs":{"total":773094113280,"available":770598232064,"internally_reserved":0,"allocated":5971968,"data_stored":3127112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":144,"apply_latency_ms":144,"commit_latency_ns":144000000,"apply_latency_ns":144000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-181411715,"num_objects":-34773,"num_object_clones":0,"num_object_copies":-69546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34773,"num_whiteouts":0,"num_read":-394,"num_read_kb":0,"num_write":-63610,"num_write_kb":-229050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-187,"num_bytes_recovered":-707,"num_keys_recovered":0,"num_objects_omap":-22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.167625"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T16:15:14.040989+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:15:14.040989+0000","last_peered":"2023-10-08T16:15:14.040989+0000","last_clean":"2023-10-08T16:15:14.040989+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:15:14.040989+0000","last_undegraded":"2023-10-08T16:15:14.040989+0000","last_fullsized":"2023-10-08T16:15:14.040989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310740,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061100,"statfs":{"total":96636764160,"available":96318566400,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.92700000000000005},"min":{"1min":0.57399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96199999999999997,"5min":1.268,"15min":1.3460000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77900000000000003,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.42899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.93400000000000005},"min":{"1min":0.58399999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.085,"5min":1.3600000000000001,"15min":1.429},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91300000000000003,"15min":0.97799999999999998},"min":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.78300000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.873},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.94899999999999995,"15min":0.99199999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.5920000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.96999999999999997},"min":{"1min":0.67800000000000005,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.099,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.2110000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.0820000000000001},"min":{"1min":0.73499999999999999,"5min":0.67400000000000004,"15min":0.5},"max":{"1min":1.2929999999999999,"5min":1.837,"15min":1.837},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0509999999999999,"15min":1.091},"min":{"1min":0.83999999999999997,"5min":0.63400000000000001,"15min":0.621},"max":{"1min":1.53,"5min":1.53,"15min":1.702},"last":1.24}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1919999999999999,"15min":1.1830000000000001},"min":{"1min":0.83799999999999997,"5min":0.57499999999999996,"15min":0.51200000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.117},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2,"15min":1.1799999999999999},"min":{"1min":0.96099999999999997,"5min":0.85099999999999998,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":2.081,"15min":2.081},"last":1.1819999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":1.0009999999999999,"5min":0.77800000000000002,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":2.456,"15min":2.456},"last":1.268},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.90000000000000002,"5min":0.83099999999999996,"15min":0.72199999999999998},"max":{"1min":1.595,"5min":1.758,"15min":1.758},"last":1.145}]}]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.88900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.095,"5min":1.302,"15min":1.548},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85399999999999998,"15min":0.94999999999999996},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":1.1100000000000001,"5min":1.518,"15min":1.518},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.86799999999999999,"15min":0.92800000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.159,"5min":1.27,"15min":1.6739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.96399999999999997},"min":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.93300000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2689999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":2.1629999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.034,"15min":1.1240000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3100000000000001,"5min":1.46,"15min":2.286},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59299999999999997},"max":{"1min":1.371,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.024},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.746,"15min":1.746},"last":2.2490000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.5209999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1479999999999999,"15min":1.21},"min":{"1min":0.78800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4970000000000001,"5min":1.819,"15min":1.819},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0860000000000001,"15min":1.113},"min":{"1min":0.68799999999999994,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5129999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.877,"15min":0.877},"max":{"1min":1.48,"5min":1.984,"15min":1.984},"last":0.93700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.286,"15min":1.353},"min":{"1min":0.86699999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.587,"5min":2.1360000000000001,"15min":2.4529999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.78200000000000003},"max":{"1min":1.5229999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":2.3090000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76700000000000002,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.429},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.84299999999999997,"15min":0.90100000000000002},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.2230000000000001,"5min":1.76,"15min":1.76},"last":1.024}]},{"osd":1,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.3979999999999999,"5min":1.5129999999999999,"15min":1.8500000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.466,"5min":1.5529999999999999,"15min":1.734},"last":1.179}]},{"osd":2,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96199999999999997,"15min":0.96599999999999997},"min":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95599999999999996,"15min":1.004},"min":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3129999999999999,"5min":1.6739999999999999,"15min":2.0609999999999999},"last":1.1100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.71899999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5840000000000001,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.091,"15min":1.087},"min":{"1min":0.746,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.579,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.91400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0620000000000001,"15min":1.044},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.623,"5min":1.823,"15min":1.823},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.3,"5min":1.1799999999999999,"15min":1.2190000000000001},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6739999999999999,"5min":1.7909999999999999,"15min":2.101},"last":1.365}]},{"osd":6,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.70299999999999996},"max":{"1min":1.774,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.155},{"interface":"front","average":{"1min":1.262,"5min":1.2050000000000001,"15min":1.226},"min":{"1min":0.94699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.837,"5min":1.95,"15min":2.2559999999999998},"last":1.216}]},{"osd":7,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.284,"15min":1.3240000000000001},"min":{"1min":1.0369999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7709999999999999,"5min":1.9610000000000001,"15min":2.1869999999999998},"last":1.284},{"interface":"front","average":{"1min":1.351,"5min":1.3100000000000001,"15min":1.367},"min":{"1min":1.0840000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.8939999999999999,"5min":2.496,"15min":2.605},"last":1.2410000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.141,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84699999999999998,"15min":0.91200000000000003},"min":{"1min":0.58299999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3520000000000001,"5min":1.554,"15min":1.554},"last":1.1180000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.92300000000000004},"min":{"1min":0.63300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.169,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.871,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.7929999999999999},"last":0.86899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.88500000000000001},"min":{"1min":0.623,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3089999999999999,"5min":1.653,"15min":1.653},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.069},"min":{"1min":0.624,"5min":0.438,"15min":0.438},"max":{"1min":1.385,"5min":2.085,"15min":2.5859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.1080000000000001},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.052,"15min":1.091},"min":{"1min":0.755,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7729999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2110000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0720000000000001,"15min":1.167},"min":{"1min":0.66000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.605,"5min":1.605,"15min":2.7069999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.1910000000000001},"min":{"1min":0.89000000000000001,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":1.661,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0960000000000001,"15min":1.147},"min":{"1min":0.82499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.657,"5min":1.7789999999999999,"15min":2.0489999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.216,"15min":1.329},"min":{"1min":0.89700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.639,"5min":1.7749999999999999,"15min":2.758},"last":1.1830000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.3080000000000001},"min":{"1min":0.95799999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"max":{"1min":1.6399999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.347},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.23,"15min":1.302},"min":{"1min":1.0449999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.738,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.298}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63300000000000001,"15min":0.66100000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76000000000000001,"15min":0.72499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79700000000000004,"15min":0.79300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.497},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89200000000000002,"15min":0.90500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.65500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.0389999999999999,"15min":1.0920000000000001},"min":{"1min":0.70399999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0880000000000001,"15min":1.0660000000000001},"min":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1100000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1799999999999999,"15min":1.2170000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.871}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.27,"5min":1.2050000000000001,"15min":1.234},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":0.90000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60899999999999999,"15min":0.66000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.6559999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.29999999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.556},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":1.048,"5min":1.298,"15min":1.4910000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.78200000000000003},"min":{"1min":0.44500000000000001,"5min":0.42199999999999999,"15min":0.35699999999999998},"max":{"1min":1.034,"5min":1.284,"15min":1.4119999999999999},"last":1.012}]},{"osd":3,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.745,"15min":0.73099999999999998},"min":{"1min":0.58599999999999997,"5min":0.44,"15min":0.35999999999999999},"max":{"1min":1.0880000000000001,"5min":1.3660000000000001,"15min":1.4039999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84499999999999997,"15min":0.85199999999999998},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.4410000000000001,"15min":1.4690000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.72899999999999998,"5min":0.59899999999999998,"15min":0.52800000000000002},"max":{"1min":1.4750000000000001,"5min":1.538,"15min":1.583},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0049999999999999,"15min":1.0369999999999999},"min":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.58499999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0109999999999999,"15min":1.0469999999999999},"min":{"1min":0.68999999999999995,"5min":0.53900000000000003,"15min":0.51600000000000001},"max":{"1min":1.3149999999999999,"5min":1.742,"15min":1.742},"last":1.04},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1479999999999999},"min":{"1min":0.72099999999999997,"5min":0.66400000000000003,"15min":0.63800000000000001},"max":{"1min":1.415,"5min":1.5149999999999999,"15min":1.792},"last":1.125}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.095,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70699999999999996,"15min":0.54200000000000004},"max":{"1min":1.694,"5min":1.694,"15min":2.0070000000000001},"last":1.177},{"interface":"front","average":{"1min":1.077,"5min":1.0640000000000001,"15min":1.115},"min":{"1min":0.77200000000000002,"5min":0.64300000000000002,"15min":0.56899999999999995},"max":{"1min":1.407,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.139,"15min":1.157},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.8899999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.103,"15min":1.153},"min":{"1min":0.81200000000000006,"5min":0.79800000000000004,"15min":0.67800000000000005},"max":{"1min":1.335,"5min":1.996,"15min":1.996},"last":1.151}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306064,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065776,"statfs":{"total":96636764160,"available":96323354624,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":1.325,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.36299999999999999},"max":{"1min":1.341,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.85499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":1.208,"5min":1.75,"15min":1.75},"last":1.046}]},{"osd":3,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85899999999999999,"15min":0.81399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.39600000000000002},"max":{"1min":1.1639999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.87,"15min":0.83899999999999997},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42199999999999999},"max":{"1min":1.389,"5min":1.472,"15min":1.472},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.61399999999999999,"15min":0.57799999999999996},"max":{"1min":1.417,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.98899999999999999,"15min":0.96299999999999997},"min":{"1min":0.753,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5049999999999999,"5min":1.821,"15min":1.821},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.04,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.68300000000000005,"15min":0.53700000000000003},"max":{"1min":1.321,"5min":1.891,"15min":1.891},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0960000000000001,"15min":1.1020000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63700000000000001},"max":{"1min":1.6439999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0660000000000001,"15min":1.1040000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.60999999999999999},"max":{"1min":1.478,"5min":1.516,"15min":1.768},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.1299999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.748,"15min":0.628},"max":{"1min":1.4350000000000001,"5min":3.665,"15min":3.665},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.139,"15min":1.1539999999999999},"min":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7230000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.135,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.345,"5min":1.5880000000000001,"15min":2.0299999999999998},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.65700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28899999999999998},"max":{"1min":1.109,"5min":1.133,"15min":1.133},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.753},"min":{"1min":0.377,"5min":0.377,"15min":0.36499999999999999},"max":{"1min":1.147,"5min":1.208,"15min":1.3},"last":0.81499999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.272,"5min":1.423,"15min":1.423},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.484,"5min":1.484,"15min":2.0230000000000001},"last":1.1779999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7490000000000001,"5min":1.954,"15min":2.657},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94999999999999996,"15min":0.96499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.55800000000000005},"max":{"1min":1.2789999999999999,"5min":1.6699999999999999,"15min":2.012},"last":1.2070000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.115},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.65100000000000002},"max":{"1min":1.8600000000000001,"5min":2.129,"15min":2.7120000000000002},"last":1.272},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.145},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.54000000000000004},"max":{"1min":1.619,"5min":2.1259999999999999,"15min":2.2000000000000002},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57099999999999995},"max":{"1min":1.3440000000000001,"5min":1.605,"15min":2.2719999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.161,"15min":1.202},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7769999999999999,"5min":1.8100000000000001,"15min":2.9830000000000001},"last":1.327}]},{"osd":7,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.171,"15min":1.204},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8240000000000001,"5min":2.069,"15min":2.069},"last":1.236},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.171},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3759999999999999,"5min":1.8160000000000001,"15min":2.008},"last":1.103}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:15:18.052 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:15:18.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 Processor -- start 2023-10-08T16:15:18.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- start start 2023-10-08T16:15:18.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f623c0ca440 0x7f623c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c06c3a0 con 0x7f623c0ca070 2023-10-08T16:15:18.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c06c8a0 con 0x7f623c06aeb0 2023-10-08T16:15:18.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c06e010 con 0x7f623c0ca440 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f623c0ca440 0x7f623c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f623c0ca440 0x7f623c15ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34912/0 (socket says 172.21.15.3:34912) 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 -- 172.21.15.3:0/2129322252 learned_addr learned my addr 172.21.15.3:0/2129322252 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623a59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f623c0ca070 0x7f623c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56082/0 (socket says 172.21.15.3:56082) 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 -- 172.21.15.3:0/2129322252 >> v1:172.21.15.27:6789/0 conn(0x7f623c06aeb0 legacy=0x7f623c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 -- 172.21.15.3:0/2129322252 >> v1:172.21.15.3:6789/0 conn(0x7f623c0ca070 legacy=0x7f623c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 -- 172.21.15.3:0/2129322252 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c06cb40 con 0x7f623c0ca440 2023-10-08T16:15:18.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623ad9d700 1 --2- 172.21.15.3:0/2129322252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca440 0x7f623c15ce90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f62340099e0 tx=0x7f6234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ee37a8bf589b75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623959a700 1 -- 172.21.15.3:0/2129322252 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400b820 con 0x7f623c0ca440 2023-10-08T16:15:18.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623959a700 1 -- 172.21.15.3:0/2129322252 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400b980 con 0x7f623c0ca440 2023-10-08T16:15:18.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623959a700 1 -- 172.21.15.3:0/2129322252 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400bd20 con 0x7f623c0ca440 2023-10-08T16:15:18.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- 172.21.15.3:0/2129322252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca440 msgr2=0x7f623c15ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 --2- 172.21.15.3:0/2129322252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca440 0x7f623c15ce90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f62340099e0 tx=0x7f6234009250 comp rx=0 tx=0).stop 2023-10-08T16:15:18.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- 172.21.15.3:0/2129322252 shutdown_connections 2023-10-08T16:15:18.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 --2- 172.21.15.3:0/2129322252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca440 0x7f623c15ce90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.157+0000 7f623b59e700 1 -- 172.21.15.3:0/2129322252 >> 172.21.15.3:0/2129322252 conn(0x7f623c0c83d0 msgr2=0x7f623c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.161+0000 7f623b59e700 1 -- 172.21.15.3:0/2129322252 shutdown_connections 2023-10-08T16:15:18.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.161+0000 7f623b59e700 1 -- 172.21.15.3:0/2129322252 wait complete. 2023-10-08T16:15:18.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.161+0000 7f623b59e700 1 Processor -- start 2023-10-08T16:15:18.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.161+0000 7f623b59e700 1 -- start start 2023-10-08T16:15:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 0x7f623c1701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f623c0ca440 0x7f623c16de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f623c0b13f0 0x7f623c0c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c170720 con 0x7f623c0ca070 2023-10-08T16:15:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0c4790 con 0x7f623c0b13f0 2023-10-08T16:15:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0c3bf0 con 0x7f623c0ca440 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 0x7f623c1701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 0x7f623c1701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34924/0 (socket says 172.21.15.3:34924) 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 -- 172.21.15.3:0/1649918329 learned_addr learned my addr 172.21.15.3:0/1649918329 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623ad9d700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f623c0b13f0 0x7f623c0c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f6239d9b700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f623c0ca440 0x7f623c16de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 -- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f623c0ca440 msgr2=0x7f623c16de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f623c0ca440 0x7f623c16de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 -- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f623c0b13f0 msgr2=0x7f623c0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f623c0b13f0 0x7f623c0c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 -- 172.21.15.3:0/1649918329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340094f0 con 0x7f623c0ca070 2023-10-08T16:15:18.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623a59c700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 0x7f623c1701e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f622400c7f0 tx=0x7f6224007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224005a70 con 0x7f623c0ca070 2023-10-08T16:15:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6224005bf0 con 0x7f623c0ca070 2023-10-08T16:15:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c0c3e60 con 0x7f623c0ca070 2023-10-08T16:15:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240070d0 con 0x7f623c0ca070 2023-10-08T16:15:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.165+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c0c4420 con 0x7f623c0ca070 2023-10-08T16:15:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.169+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c04be40 con 0x7f623c0ca070 2023-10-08T16:15:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.169+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6224007480 con 0x7f623c0ca070 2023-10-08T16:15:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.169+0000 7f62327fc700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6220060550 0x7f6220062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.169+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f622407b9b0 con 0x7f623c0ca070 2023-10-08T16:15:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.169+0000 7f6239d9b700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6220060550 0x7f6220062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.169+0000 7f6239d9b700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6220060550 0x7f6220062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f623c0b0f20 tx=0x7f622c001650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.177+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f622404c1d0 con 0x7f623c0ca070 2023-10-08T16:15:18.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.337+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f623c0c48d0 con 0x7f6220060550 2023-10-08T16:15:18.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f62327fc700 1 -- 172.21.15.3:0/1649918329 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48740 (secure 0 0 0) 0x7f622c00e8c0 con 0x7f6220060550 2023-10-08T16:15:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6220060550 msgr2=0x7f6220062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6220060550 0x7f6220062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f623c0b0f20 tx=0x7f622c001650 comp rx=0 tx=0).stop 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 msgr2=0x7f623c1701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 0x7f623c1701e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f622400c7f0 tx=0x7f6224007f70 comp rx=0 tx=0).stop 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 shutdown_connections 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6220060550 0x7f6220062a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f623c0b13f0 0x7f623c0c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f623c0ca440 0x7f623c16de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 --2- 172.21.15.3:0/1649918329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f623c0ca070 0x7f623c1701e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 >> 172.21.15.3:0/1649918329 conn(0x7f623c0c83d0 msgr2=0x7f623c06d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 shutdown_connections 2023-10-08T16:15:18.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.341+0000 7f623b59e700 1 -- 172.21.15.3:0/1649918329 wait complete. 2023-10-08T16:15:18.351 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:15:18.362 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2023-10-08T16:15:17.991733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2437384,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752537336,"statfs":{"total":773094113280,"available":770598232064,"internally_reserved":0,"allocated":5971968,"data_stored":3127112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":144,"apply_latency_ms":144,"commit_latency_ns":144000000,"apply_latency_ns":144000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-181411715,"num_objects":-34773,"num_object_clones":0,"num_object_copies":-69546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34773,"num_whiteouts":0,"num_read":-394,"num_read_kb":0,"num_write":-63610,"num_write_kb":-229050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-187,"num_bytes_recovered":-707,"num_keys_recovered":0,"num_objects_omap":-22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.167625"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T16:15:14.040989+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:15:14.040989+0000","last_peered":"2023-10-08T16:15:14.040989+0000","last_clean":"2023-10-08T16:15:14.040989+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:15:14.040989+0000","last_undegraded":"2023-10-08T16:15:14.040989+0000","last_fullsized":"2023-10-08T16:15:14.040989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310740,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061100,"statfs":{"total":96636764160,"available":96318566400,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.92700000000000005},"min":{"1min":0.57399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96199999999999997,"5min":1.268,"15min":1.3460000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77900000000000003,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.42899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.93400000000000005},"min":{"1min":0.58399999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.085,"5min":1.3600000000000001,"15min":1.429},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91300000000000003,"15min":0.97799999999999998},"min":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.78300000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.873},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.94899999999999995,"15min":0.99199999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.5920000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.96999999999999997},"min":{"1min":0.67800000000000005,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.099,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.2110000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.0820000000000001},"min":{"1min":0.73499999999999999,"5min":0.67400000000000004,"15min":0.5},"max":{"1min":1.2929999999999999,"5min":1.837,"15min":1.837},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0509999999999999,"15min":1.091},"min":{"1min":0.83999999999999997,"5min":0.63400000000000001,"15min":0.621},"max":{"1min":1.53,"5min":1.53,"15min":1.702},"last":1.24}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1919999999999999,"15min":1.1830000000000001},"min":{"1min":0.83799999999999997,"5min":0.57499999999999996,"15min":0.51200000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.117},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2,"15min":1.1799999999999999},"min":{"1min":0.96099999999999997,"5min":0.85099999999999998,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":2.081,"15min":2.081},"last":1.1819999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":1.0009999999999999,"5min":0.77800000000000002,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":2.456,"15min":2.456},"last":1.268},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.90000000000000002,"5min":0.83099999999999996,"15min":0.72199999999999998},"max":{"1min":1.595,"5min":1.758,"15min":1.758},"last":1.145}]}]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.88900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.095,"5min":1.302,"15min":1.548},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85399999999999998,"15min":0.94999999999999996},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":1.1100000000000001,"5min":1.518,"15min":1.518},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.86799999999999999,"15min":0.92800000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.159,"5min":1.27,"15min":1.6739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.96399999999999997},"min":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.93300000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2689999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":2.1629999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.034,"15min":1.1240000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3100000000000001,"5min":1.46,"15min":2.286},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59299999999999997},"max":{"1min":1.371,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.024},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.746,"15min":1.746},"last":2.2490000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.5209999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1479999999999999,"15min":1.21},"min":{"1min":0.78800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4970000000000001,"5min":1.819,"15min":1.819},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0860000000000001,"15min":1.113},"min":{"1min":0.68799999999999994,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5129999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.877,"15min":0.877},"max":{"1min":1.48,"5min":1.984,"15min":1.984},"last":0.93700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.286,"15min":1.353},"min":{"1min":0.86699999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.587,"5min":2.1360000000000001,"15min":2.4529999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.78200000000000003},"max":{"1min":1.5229999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":2.3090000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76700000000000002,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.429},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.84299999999999997,"15min":0.90100000000000002},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.2230000000000001,"5min":1.76,"15min":1.76},"last":1.024}]},{"osd":1,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.3979999999999999,"5min":1.5129999999999999,"15min":1.8500000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.466,"5min":1.5529999999999999,"15min":1.734},"last":1.179}]},{"osd":2,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96199999999999997,"15min":0.96599999999999997},"min":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95599999999999996,"15min":1.004},"min":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3129999999999999,"5min":1.6739999999999999,"15min":2.0609999999999999},"last":1.1100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.71899999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5840000000000001,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.091,"15min":1.087},"min":{"1min":0.746,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.579,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.91400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0620000000000001,"15min":1.044},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.623,"5min":1.823,"15min":1.823},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.3,"5min":1.1799999999999999,"15min":1.2190000000000001},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6739999999999999,"5min":1.7909999999999999,"15min":2.101},"last":1.365}]},{"osd":6,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.70299999999999996},"max":{"1min":1.774,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.155},{"interface":"front","average":{"1min":1.262,"5min":1.2050000000000001,"15min":1.226},"min":{"1min":0.94699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.837,"5min":1.95,"15min":2.2559999999999998},"last":1.216}]},{"osd":7,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.284,"15min":1.3240000000000001},"min":{"1min":1.0369999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7709999999999999,"5min":1.9610000000000001,"15min":2.1869999999999998},"last":1.284},{"interface":"front","average":{"1min":1.351,"5min":1.3100000000000001,"15min":1.367},"min":{"1min":1.0840000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.8939999999999999,"5min":2.496,"15min":2.605},"last":1.2410000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.141,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84699999999999998,"15min":0.91200000000000003},"min":{"1min":0.58299999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3520000000000001,"5min":1.554,"15min":1.554},"last":1.1180000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.92300000000000004},"min":{"1min":0.63300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.169,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.871,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.7929999999999999},"last":0.86899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.88500000000000001},"min":{"1min":0.623,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3089999999999999,"5min":1.653,"15min":1.653},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.069},"min":{"1min":0.624,"5min":0.438,"15min":0.438},"max":{"1min":1.385,"5min":2.085,"15min":2.5859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.1080000000000001},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.052,"15min":1.091},"min":{"1min":0.755,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7729999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2110000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0720000000000001,"15min":1.167},"min":{"1min":0.66000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.605,"5min":1.605,"15min":2.7069999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.1910000000000001},"min":{"1min":0.89000000000000001,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":1.661,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0960000000000001,"15min":1.147},"min":{"1min":0.82499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.657,"5min":1.7789999999999999,"15min":2.0489999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.216,"15min":1.329},"min":{"1min":0.89700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.639,"5min":1.7749999999999999,"15min":2.758},"last":1.1830000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.3080000000000001},"min":{"1min":0.95799999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"max":{"1min":1.6399999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.347},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.23,"15min":1.302},"min":{"1min":1.0449999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.738,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.298}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63300000000000001,"15min":0.66100000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76000000000000001,"15min":0.72499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79700000000000004,"15min":0.79300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.497},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89200000000000002,"15min":0.90500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.65500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.0389999999999999,"15min":1.0920000000000001},"min":{"1min":0.70399999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0880000000000001,"15min":1.0660000000000001},"min":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1100000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1799999999999999,"15min":1.2170000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.871}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.27,"5min":1.2050000000000001,"15min":1.234},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":0.90000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60899999999999999,"15min":0.66000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.6559999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.29999999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.556},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":1.048,"5min":1.298,"15min":1.4910000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.78200000000000003},"min":{"1min":0.44500000000000001,"5min":0.42199999999999999,"15min":0.35699999999999998},"max":{"1min":1.034,"5min":1.284,"15min":1.4119999999999999},"last":1.012}]},{"osd":3,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.745,"15min":0.73099999999999998},"min":{"1min":0.58599999999999997,"5min":0.44,"15min":0.35999999999999999},"max":{"1min":1.0880000000000001,"5min":1.3660000000000001,"15min":1.4039999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84499999999999997,"15min":0.85199999999999998},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.4410000000000001,"15min":1.4690000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.72899999999999998,"5min":0.59899999999999998,"15min":0.52800000000000002},"max":{"1min":1.4750000000000001,"5min":1.538,"15min":1.583},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0049999999999999,"15min":1.0369999999999999},"min":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.58499999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0109999999999999,"15min":1.0469999999999999},"min":{"1min":0.68999999999999995,"5min":0.53900000000000003,"15min":0.51600000000000001},"max":{"1min":1.3149999999999999,"5min":1.742,"15min":1.742},"last":1.04},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1479999999999999},"min":{"1min":0.72099999999999997,"5min":0.66400000000000003,"15min":0.63800000000000001},"max":{"1min":1.415,"5min":1.5149999999999999,"15min":1.792},"last":1.125}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.095,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70699999999999996,"15min":0.54200000000000004},"max":{"1min":1.694,"5min":1.694,"15min":2.0070000000000001},"last":1.177},{"interface":"front","average":{"1min":1.077,"5min":1.0640000000000001,"15min":1.115},"min":{"1min":0.77200000000000002,"5min":0.64300000000000002,"15min":0.56899999999999995},"max":{"1min":1.407,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.139,"15min":1.157},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.8899999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.103,"15min":1.153},"min":{"1min":0.81200000000000006,"5min":0.79800000000000004,"15min":0.67800000000000005},"max":{"1min":1.335,"5min":1.996,"15min":1.996},"last":1.151}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306064,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065776,"statfs":{"total":96636764160,"available":96323354624,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":1.325,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.36299999999999999},"max":{"1min":1.341,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.85499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":1.208,"5min":1.75,"15min":1.75},"last":1.046}]},{"osd":3,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85899999999999999,"15min":0.81399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.39600000000000002},"max":{"1min":1.1639999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.87,"15min":0.83899999999999997},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42199999999999999},"max":{"1min":1.389,"5min":1.472,"15min":1.472},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.61399999999999999,"15min":0.57799999999999996},"max":{"1min":1.417,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.98899999999999999,"15min":0.96299999999999997},"min":{"1min":0.753,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5049999999999999,"5min":1.821,"15min":1.821},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.04,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.68300000000000005,"15min":0.53700000000000003},"max":{"1min":1.321,"5min":1.891,"15min":1.891},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0960000000000001,"15min":1.1020000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63700000000000001},"max":{"1min":1.6439999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0660000000000001,"15min":1.1040000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.60999999999999999},"max":{"1min":1.478,"5min":1.516,"15min":1.768},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.1299999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.748,"15min":0.628},"max":{"1min":1.4350000000000001,"5min":3.665,"15min":3.665},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.139,"15min":1.1539999999999999},"min":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7230000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.135,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.345,"5min":1.5880000000000001,"15min":2.0299999999999998},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.65700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28899999999999998},"max":{"1min":1.109,"5min":1.133,"15min":1.133},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.753},"min":{"1min":0.377,"5min":0.377,"15min":0.36499999999999999},"max":{"1min":1.147,"5min":1.208,"15min":1.3},"last":0.81499999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.272,"5min":1.423,"15min":1.423},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.484,"5min":1.484,"15min":2.0230000000000001},"last":1.1779999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7490000000000001,"5min":1.954,"15min":2.657},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94999999999999996,"15min":0.96499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.55800000000000005},"max":{"1min":1.2789999999999999,"5min":1.6699999999999999,"15min":2.012},"last":1.2070000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.115},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.65100000000000002},"max":{"1min":1.8600000000000001,"5min":2.129,"15min":2.7120000000000002},"last":1.272},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.145},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.54000000000000004},"max":{"1min":1.619,"5min":2.1259999999999999,"15min":2.2000000000000002},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57099999999999995},"max":{"1min":1.3440000000000001,"5min":1.605,"15min":2.2719999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.161,"15min":1.202},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7769999999999999,"5min":1.8100000000000001,"15min":2.9830000000000001},"last":1.327}]},{"osd":7,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.171,"15min":1.204},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8240000000000001,"5min":2.069,"15min":2.069},"last":1.236},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.171},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3759999999999999,"5min":1.8160000000000001,"15min":2.008},"last":1.103}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:15:18.364 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:15:18.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:15:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87ffff700 1 Processor -- start 2023-10-08T16:15:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87ffff700 1 -- start start 2023-10-08T16:15:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 0x7fd8800caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88006ce20 con 0x7fd8801591f0 2023-10-08T16:15:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87ffff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8800cb090 con 0x7fd880067060 2023-10-08T16:15:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800cb370 con 0x7fd8800ca5d0 2023-10-08T16:15:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87effd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd8801591f0 0x7fd8800b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56098/0 (socket says 172.21.15.3:56098) 2023-10-08T16:15:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87effd700 1 -- 172.21.15.3:0/3176532125 learned_addr learned my addr 172.21.15.3:0/3176532125 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87e7fc700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 0x7fd8800caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217128850 0 0) 0x7fd88006ce20 con 0x7fd8801591f0 2023-10-08T16:15:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd86c003570 con 0x7fd8801591f0 2023-10-08T16:15:18.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065481257 0 0) 0x7fd86c003570 con 0x7fd8801591f0 2023-10-08T16:15:18.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 msgr2=0x7fd8800caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:18.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 0x7fd8800caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 >> v1:172.21.15.27:6789/0 conn(0x7fd880067060 legacy=0x7fd88006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800cb650 con 0x7fd8801591f0 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 409463555 0 0) 0x7fd868001470 con 0x7fd8801591f0 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 >> v1:172.21.15.3:6789/0 conn(0x7fd8801591f0 legacy=0x7fd8800b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd86c003a90 0x7fd86c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c004810 0x7fd86c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 0x7fd86c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800cb370 con 0x7fd86c003a90 2023-10-08T16:15:18.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c00bb10 con 0x7fd86c004810 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c00bcd0 con 0x7fd8800ca5d0 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87effd700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd86c003a90 0x7fd86c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87e7fc700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c004810 0x7fd86c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.469+0000 7fd87f7fe700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 0x7fd86c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87effd700 1 -- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 msgr2=0x7fd86c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87effd700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8800ca5d0 0x7fd86c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87effd700 1 -- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c004810 msgr2=0x7fd86c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87effd700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c004810 0x7fd86c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87effd700 1 -- 172.21.15.3:0/3176532125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c003570 con 0x7fd86c003a90 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87effd700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd86c003a90 0x7fd86c003e60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd86800c3c0 tx=0x7fd868001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f92f255b27d256f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800cc90 con 0x7fd86c003a90 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800ce10 con 0x7fd86c003a90 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87dffb700 1 -- 172.21.15.3:0/3176532125 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868005b70 con 0x7fd86c003a90 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 -- 172.21.15.3:0/3176532125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd86c003a90 msgr2=0x7fd86c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 --2- 172.21.15.3:0/3176532125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd86c003a90 0x7fd86c003e60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd86800c3c0 tx=0x7fd868001e70 comp rx=0 tx=0).stop 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87f7fe700 1 -- 172.21.15.3:0/3176532125 reap_dead start 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 -- 172.21.15.3:0/3176532125 shutdown_connections 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 -- 172.21.15.3:0/3176532125 >> 172.21.15.3:0/3176532125 conn(0x7fd8800cfd80 msgr2=0x7fd8800d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 -- 172.21.15.3:0/3176532125 shutdown_connections 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 -- 172.21.15.3:0/3176532125 wait complete. 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 Processor -- start 2023-10-08T16:15:18.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.473+0000 7fd87ffff700 1 -- start start 2023-10-08T16:15:18.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c003a90 0x7fd8800b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8801554d0 0x7fd880157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 0x7fd880157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd880151910 con 0x7fd880155940 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c41e0 con 0x7fd86c003a90 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c47a0 con 0x7fd8801554d0 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 0x7fd880157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 0x7fd880157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34944/0 (socket says 172.21.15.3:34944) 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 -- 172.21.15.3:0/1612926170 learned_addr learned my addr 172.21.15.3:0/1612926170 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:18.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87e7fc700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8801554d0 0x7fd880157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87effd700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c003a90 0x7fd8800b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 -- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8801554d0 msgr2=0x7fd880157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8801554d0 0x7fd880157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 -- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c003a90 msgr2=0x7fd8800b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c003a90 0x7fd8800b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 -- 172.21.15.3:0/1612926170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880158060 con 0x7fd880155940 2023-10-08T16:15:18.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87f7fe700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 0x7fd880157680 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd8800ca350 tx=0x7fd870007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870003450 con 0x7fd880155940 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870013600 con 0x7fd880155940 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd880158340 con 0x7fd880155940 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8700139c0 con 0x7fd880155940 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8800b57f0 con 0x7fd880155940 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd87001c400 con 0x7fd880155940 2023-10-08T16:15:18.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.477+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88004be40 con 0x7fd880155940 2023-10-08T16:15:18.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.481+0000 7fd876ffd700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd860060550 0x7fd860062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.481+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fd87007c690 con 0x7fd880155940 2023-10-08T16:15:18.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.481+0000 7fd87effd700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd860060550 0x7fd860062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.481+0000 7fd87effd700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd860060550 0x7fd860062a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd868007cf0 tx=0x7fd868015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.485+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd87004d000 con 0x7fd880155940 2023-10-08T16:15:18.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.645+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd88006e730 con 0x7fd860060550 2023-10-08T16:15:18.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.649+0000 7fd876ffd700 1 -- 172.21.15.3:0/1612926170 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48740 (secure 0 0 0) 0x7fd88006e730 con 0x7fd860060550 2023-10-08T16:15:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:18.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd860060550 msgr2=0x7fd860062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd860060550 0x7fd860062a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd868007cf0 tx=0x7fd868015000 comp rx=0 tx=0).stop 2023-10-08T16:15:18.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 msgr2=0x7fd880157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 0x7fd880157680 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd8800ca350 tx=0x7fd870007d10 comp rx=0 tx=0).stop 2023-10-08T16:15:18.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 shutdown_connections 2023-10-08T16:15:18.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd860060550 0x7fd860062a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd880155940 0x7fd880157680 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd8801554d0 0x7fd880157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 --2- 172.21.15.3:0/1612926170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c003a90 0x7fd8800b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 >> 172.21.15.3:0/1612926170 conn(0x7fd8800cfd80 msgr2=0x7fd8800d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 shutdown_connections 2023-10-08T16:15:18.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.653+0000 7fd87ffff700 1 -- 172.21.15.3:0/1612926170 wait complete. 2023-10-08T16:15:18.663 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:15:18.672 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2023-10-08T16:15:17.991733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2437384,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752537336,"statfs":{"total":773094113280,"available":770598232064,"internally_reserved":0,"allocated":5971968,"data_stored":3127112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":144,"apply_latency_ms":144,"commit_latency_ns":144000000,"apply_latency_ns":144000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-181411715,"num_objects":-34773,"num_object_clones":0,"num_object_copies":-69546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34773,"num_whiteouts":0,"num_read":-394,"num_read_kb":0,"num_write":-63610,"num_write_kb":-229050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-187,"num_bytes_recovered":-707,"num_keys_recovered":0,"num_objects_omap":-22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.167625"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T16:15:14.040989+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:15:14.040989+0000","last_peered":"2023-10-08T16:15:14.040989+0000","last_clean":"2023-10-08T16:15:14.040989+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:15:14.040989+0000","last_undegraded":"2023-10-08T16:15:14.040989+0000","last_fullsized":"2023-10-08T16:15:14.040989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310740,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061100,"statfs":{"total":96636764160,"available":96318566400,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.92700000000000005},"min":{"1min":0.57399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96199999999999997,"5min":1.268,"15min":1.3460000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77900000000000003,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.42899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.93400000000000005},"min":{"1min":0.58399999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.085,"5min":1.3600000000000001,"15min":1.429},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91300000000000003,"15min":0.97799999999999998},"min":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.78300000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.873},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.94899999999999995,"15min":0.99199999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.5920000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.96999999999999997},"min":{"1min":0.67800000000000005,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.099,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.2110000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.0820000000000001},"min":{"1min":0.73499999999999999,"5min":0.67400000000000004,"15min":0.5},"max":{"1min":1.2929999999999999,"5min":1.837,"15min":1.837},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0509999999999999,"15min":1.091},"min":{"1min":0.83999999999999997,"5min":0.63400000000000001,"15min":0.621},"max":{"1min":1.53,"5min":1.53,"15min":1.702},"last":1.24}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1919999999999999,"15min":1.1830000000000001},"min":{"1min":0.83799999999999997,"5min":0.57499999999999996,"15min":0.51200000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.117},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2,"15min":1.1799999999999999},"min":{"1min":0.96099999999999997,"5min":0.85099999999999998,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":2.081,"15min":2.081},"last":1.1819999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":1.0009999999999999,"5min":0.77800000000000002,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":2.456,"15min":2.456},"last":1.268},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.90000000000000002,"5min":0.83099999999999996,"15min":0.72199999999999998},"max":{"1min":1.595,"5min":1.758,"15min":1.758},"last":1.145}]}]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.88900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.095,"5min":1.302,"15min":1.548},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85399999999999998,"15min":0.94999999999999996},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":1.1100000000000001,"5min":1.518,"15min":1.518},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.86799999999999999,"15min":0.92800000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.159,"5min":1.27,"15min":1.6739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.96399999999999997},"min":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.93300000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2689999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":2.1629999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.034,"15min":1.1240000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3100000000000001,"5min":1.46,"15min":2.286},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59299999999999997},"max":{"1min":1.371,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.024},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.746,"15min":1.746},"last":2.2490000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.5209999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1479999999999999,"15min":1.21},"min":{"1min":0.78800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4970000000000001,"5min":1.819,"15min":1.819},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0860000000000001,"15min":1.113},"min":{"1min":0.68799999999999994,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5129999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.877,"15min":0.877},"max":{"1min":1.48,"5min":1.984,"15min":1.984},"last":0.93700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.286,"15min":1.353},"min":{"1min":0.86699999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.587,"5min":2.1360000000000001,"15min":2.4529999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.78200000000000003},"max":{"1min":1.5229999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":2.3090000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76700000000000002,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.429},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.84299999999999997,"15min":0.90100000000000002},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.2230000000000001,"5min":1.76,"15min":1.76},"last":1.024}]},{"osd":1,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.3979999999999999,"5min":1.5129999999999999,"15min":1.8500000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.466,"5min":1.5529999999999999,"15min":1.734},"last":1.179}]},{"osd":2,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96199999999999997,"15min":0.96599999999999997},"min":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95599999999999996,"15min":1.004},"min":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3129999999999999,"5min":1.6739999999999999,"15min":2.0609999999999999},"last":1.1100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.71899999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5840000000000001,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.091,"15min":1.087},"min":{"1min":0.746,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.579,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.91400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0620000000000001,"15min":1.044},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.623,"5min":1.823,"15min":1.823},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.3,"5min":1.1799999999999999,"15min":1.2190000000000001},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6739999999999999,"5min":1.7909999999999999,"15min":2.101},"last":1.365}]},{"osd":6,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.70299999999999996},"max":{"1min":1.774,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.155},{"interface":"front","average":{"1min":1.262,"5min":1.2050000000000001,"15min":1.226},"min":{"1min":0.94699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.837,"5min":1.95,"15min":2.2559999999999998},"last":1.216}]},{"osd":7,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.284,"15min":1.3240000000000001},"min":{"1min":1.0369999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7709999999999999,"5min":1.9610000000000001,"15min":2.1869999999999998},"last":1.284},{"interface":"front","average":{"1min":1.351,"5min":1.3100000000000001,"15min":1.367},"min":{"1min":1.0840000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.8939999999999999,"5min":2.496,"15min":2.605},"last":1.2410000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.141,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84699999999999998,"15min":0.91200000000000003},"min":{"1min":0.58299999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3520000000000001,"5min":1.554,"15min":1.554},"last":1.1180000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.92300000000000004},"min":{"1min":0.63300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.169,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.871,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.7929999999999999},"last":0.86899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.88500000000000001},"min":{"1min":0.623,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3089999999999999,"5min":1.653,"15min":1.653},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.069},"min":{"1min":0.624,"5min":0.438,"15min":0.438},"max":{"1min":1.385,"5min":2.085,"15min":2.5859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.1080000000000001},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.052,"15min":1.091},"min":{"1min":0.755,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7729999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2110000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0720000000000001,"15min":1.167},"min":{"1min":0.66000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.605,"5min":1.605,"15min":2.7069999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.1910000000000001},"min":{"1min":0.89000000000000001,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":1.661,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0960000000000001,"15min":1.147},"min":{"1min":0.82499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.657,"5min":1.7789999999999999,"15min":2.0489999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.216,"15min":1.329},"min":{"1min":0.89700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.639,"5min":1.7749999999999999,"15min":2.758},"last":1.1830000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.3080000000000001},"min":{"1min":0.95799999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"max":{"1min":1.6399999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.347},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.23,"15min":1.302},"min":{"1min":1.0449999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.738,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.298}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63300000000000001,"15min":0.66100000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76000000000000001,"15min":0.72499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79700000000000004,"15min":0.79300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.497},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89200000000000002,"15min":0.90500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.65500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.0389999999999999,"15min":1.0920000000000001},"min":{"1min":0.70399999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0880000000000001,"15min":1.0660000000000001},"min":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1100000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1799999999999999,"15min":1.2170000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.871}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.27,"5min":1.2050000000000001,"15min":1.234},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":0.90000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60899999999999999,"15min":0.66000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.6559999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.29999999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.556},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":1.048,"5min":1.298,"15min":1.4910000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.78200000000000003},"min":{"1min":0.44500000000000001,"5min":0.42199999999999999,"15min":0.35699999999999998},"max":{"1min":1.034,"5min":1.284,"15min":1.4119999999999999},"last":1.012}]},{"osd":3,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.745,"15min":0.73099999999999998},"min":{"1min":0.58599999999999997,"5min":0.44,"15min":0.35999999999999999},"max":{"1min":1.0880000000000001,"5min":1.3660000000000001,"15min":1.4039999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84499999999999997,"15min":0.85199999999999998},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.4410000000000001,"15min":1.4690000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.72899999999999998,"5min":0.59899999999999998,"15min":0.52800000000000002},"max":{"1min":1.4750000000000001,"5min":1.538,"15min":1.583},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0049999999999999,"15min":1.0369999999999999},"min":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.58499999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0109999999999999,"15min":1.0469999999999999},"min":{"1min":0.68999999999999995,"5min":0.53900000000000003,"15min":0.51600000000000001},"max":{"1min":1.3149999999999999,"5min":1.742,"15min":1.742},"last":1.04},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1479999999999999},"min":{"1min":0.72099999999999997,"5min":0.66400000000000003,"15min":0.63800000000000001},"max":{"1min":1.415,"5min":1.5149999999999999,"15min":1.792},"last":1.125}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.095,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70699999999999996,"15min":0.54200000000000004},"max":{"1min":1.694,"5min":1.694,"15min":2.0070000000000001},"last":1.177},{"interface":"front","average":{"1min":1.077,"5min":1.0640000000000001,"15min":1.115},"min":{"1min":0.77200000000000002,"5min":0.64300000000000002,"15min":0.56899999999999995},"max":{"1min":1.407,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.139,"15min":1.157},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.8899999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.103,"15min":1.153},"min":{"1min":0.81200000000000006,"5min":0.79800000000000004,"15min":0.67800000000000005},"max":{"1min":1.335,"5min":1.996,"15min":1.996},"last":1.151}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306064,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065776,"statfs":{"total":96636764160,"available":96323354624,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":1.325,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.36299999999999999},"max":{"1min":1.341,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.85499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":1.208,"5min":1.75,"15min":1.75},"last":1.046}]},{"osd":3,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85899999999999999,"15min":0.81399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.39600000000000002},"max":{"1min":1.1639999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.87,"15min":0.83899999999999997},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42199999999999999},"max":{"1min":1.389,"5min":1.472,"15min":1.472},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.61399999999999999,"15min":0.57799999999999996},"max":{"1min":1.417,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.98899999999999999,"15min":0.96299999999999997},"min":{"1min":0.753,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5049999999999999,"5min":1.821,"15min":1.821},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.04,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.68300000000000005,"15min":0.53700000000000003},"max":{"1min":1.321,"5min":1.891,"15min":1.891},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0960000000000001,"15min":1.1020000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63700000000000001},"max":{"1min":1.6439999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0660000000000001,"15min":1.1040000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.60999999999999999},"max":{"1min":1.478,"5min":1.516,"15min":1.768},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.1299999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.748,"15min":0.628},"max":{"1min":1.4350000000000001,"5min":3.665,"15min":3.665},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.139,"15min":1.1539999999999999},"min":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7230000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.135,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.345,"5min":1.5880000000000001,"15min":2.0299999999999998},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.65700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28899999999999998},"max":{"1min":1.109,"5min":1.133,"15min":1.133},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.753},"min":{"1min":0.377,"5min":0.377,"15min":0.36499999999999999},"max":{"1min":1.147,"5min":1.208,"15min":1.3},"last":0.81499999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.272,"5min":1.423,"15min":1.423},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.484,"5min":1.484,"15min":2.0230000000000001},"last":1.1779999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7490000000000001,"5min":1.954,"15min":2.657},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94999999999999996,"15min":0.96499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.55800000000000005},"max":{"1min":1.2789999999999999,"5min":1.6699999999999999,"15min":2.012},"last":1.2070000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.115},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.65100000000000002},"max":{"1min":1.8600000000000001,"5min":2.129,"15min":2.7120000000000002},"last":1.272},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.145},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.54000000000000004},"max":{"1min":1.619,"5min":2.1259999999999999,"15min":2.2000000000000002},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57099999999999995},"max":{"1min":1.3440000000000001,"5min":1.605,"15min":2.2719999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.161,"15min":1.202},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7769999999999999,"5min":1.8100000000000001,"15min":2.9830000000000001},"last":1.327}]},{"osd":7,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.171,"15min":1.204},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8240000000000001,"5min":2.069,"15min":2.069},"last":1.236},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.171},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3759999999999999,"5min":1.8160000000000001,"15min":2.008},"last":1.103}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:15:18.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:18.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 Processor -- start 2023-10-08T16:15:18.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 -- start start 2023-10-08T16:15:18.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a340cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5a34156980 0x7f5a34156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340ad520 con 0x7f5a340c95c0 2023-10-08T16:15:18.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340c9dc0 con 0x7f5a34156980 2023-10-08T16:15:18.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a3a09a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340ac250 con 0x7f5a340c9990 2023-10-08T16:15:18.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a39899700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5a34156980 0x7f5a34156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a38897700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a340cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a39098700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5a340c95c0 0x7f5a340ac630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:45438/0 (socket says 172.21.15.3:45438) 2023-10-08T16:15:18.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.769+0000 7f5a39098700 1 -- 172.21.15.3:0/889212514 learned_addr learned my addr 172.21.15.3:0/889212514 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:18.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a2bfff700 1 -- 172.21.15.3:0/889212514 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494407754 0 0) 0x7f5a340ad520 con 0x7f5a340c95c0 2023-10-08T16:15:18.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a2bfff700 1 -- 172.21.15.3:0/889212514 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a20003570 con 0x7f5a340c95c0 2023-10-08T16:15:18.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a39899700 1 -- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 msgr2=0x7f5a340cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:18.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a39899700 1 --2- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a340cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a39899700 1 -- 172.21.15.3:0/889212514 >> v1:172.21.15.27:6789/0 conn(0x7f5a340c95c0 legacy=0x7f5a340ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a39899700 1 -- 172.21.15.3:0/889212514 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340aef80 con 0x7f5a34156980 2023-10-08T16:15:18.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a38897700 1 --2- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a340cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:18.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a39899700 1 --2- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a34156e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009910 tx=0x7f5a2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d8015f192439b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a2bfff700 1 -- 172.21.15.3:0/889212514 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c011630 con 0x7f5a34156980 2023-10-08T16:15:18.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a2bfff700 1 -- 172.21.15.3:0/889212514 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c011790 con 0x7f5a34156980 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a2bfff700 1 -- 172.21.15.3:0/889212514 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c011b30 con 0x7f5a34156980 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 -- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 msgr2=0x7f5a34156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a34156e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009910 tx=0x7f5a2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 -- 172.21.15.3:0/889212514 shutdown_connections 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a34156e00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/889212514 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a340cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 -- 172.21.15.3:0/889212514 >> 172.21.15.3:0/889212514 conn(0x7f5a3406b6b0 msgr2=0x7f5a3406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 -- 172.21.15.3:0/889212514 shutdown_connections 2023-10-08T16:15:18.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.773+0000 7f5a3a09a700 1 -- 172.21.15.3:0/889212514 wait complete. 2023-10-08T16:15:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 Processor -- start 2023-10-08T16:15:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 -- start start 2023-10-08T16:15:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 0x7f5a34153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a3415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a340c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3415b270 con 0x7f5a340c95c0 2023-10-08T16:15:18.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3415bc40 con 0x7f5a34156980 2023-10-08T16:15:18.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3415ac90 con 0x7f5a340c9990 2023-10-08T16:15:18.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39098700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 0x7f5a34153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39098700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 0x7f5a34153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34960/0 (socket says 172.21.15.3:34960) 2023-10-08T16:15:18.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39098700 1 -- 172.21.15.3:0/827254029 learned_addr learned my addr 172.21.15.3:0/827254029 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:18.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a340c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a38897700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a3415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 -- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 msgr2=0x7f5a3415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a3415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 -- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 msgr2=0x7f5a34153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 0x7f5a34153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 -- 172.21.15.3:0/827254029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24009420 con 0x7f5a34156980 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39098700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 0x7f5a34153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a39899700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a340c79b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c016000 tx=0x7f5a2c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c011a50 con 0x7f5a34156980 2023-10-08T16:15:18.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c026430 con 0x7f5a34156980 2023-10-08T16:15:18.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0267f0 con 0x7f5a34156980 2023-10-08T16:15:18.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c009420 con 0x7f5a34156980 2023-10-08T16:15:18.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.777+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a34159240 con 0x7f5a34156980 2023-10-08T16:15:18.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.781+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3415aaf0 con 0x7f5a34156980 2023-10-08T16:15:18.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.781+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5a2c023030 con 0x7f5a34156980 2023-10-08T16:15:18.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.781+0000 7f5a297fa700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5a18060550 0x7f5a18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:18.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.781+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f5a2c07de10 con 0x7f5a34156980 2023-10-08T16:15:18.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.781+0000 7f5a39098700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5a18060550 0x7f5a18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:18.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.781+0000 7f5a39098700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5a18060550 0x7f5a18062a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5a30002250 tx=0x7f5a30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:18.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.793+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5a3415aaf0 con 0x7f5a34156980 2023-10-08T16:15:18.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.957+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a3415aaf0 con 0x7f5a34156980 2023-10-08T16:15:18.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a297fa700 1 -- 172.21.15.3:0/827254029 <== mon.1 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+12226 (secure 0 0 0) 0x7f5a3415aaf0 con 0x7f5a34156980 2023-10-08T16:15:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":50,"fsid":"3007c8b5-937d-4f26-8e83-7370fb7a9cb4","created":"2023-10-08T16:06:15.488546+0000","modified":"2023-10-08T16:15:14.837447+0000","last_up_change":"2023-10-08T16:06:27.047222+0000","last_in_change":"2023-10-08T16:06:17.947622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:06:27.882653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"141cc8f2-f2bc-485b-9209-0d8bb852fb14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33489},{"type":"v1","addr":"172.21.15.3:6801","nonce":33489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33489},{"type":"v1","addr":"172.21.15.3:6803","nonce":33489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6809","nonce":33489},{"type":"v1","addr":"172.21.15.3:6812","nonce":33489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":33489},{"type":"v1","addr":"172.21.15.3:6807","nonce":33489}]},"public_addr":"172.21.15.3:6801/33489","cluster_addr":"172.21.15.3:6803/33489","heartbeat_back_addr":"172.21.15.3:6812/33489","heartbeat_front_addr":"172.21.15.3:6807/33489","state":["exists","up"]},{"osd":1,"uuid":"2cb792db-0837-4f4d-b645-12d5f3fc5afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33488},{"type":"v1","addr":"172.21.15.3:6806","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33488},{"type":"v1","addr":"172.21.15.3:6810","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33488},{"type":"v1","addr":"172.21.15.3:6815","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6811","nonce":33488},{"type":"v1","addr":"172.21.15.3:6813","nonce":33488}]},"public_addr":"172.21.15.3:6806/33488","cluster_addr":"172.21.15.3:6810/33488","heartbeat_back_addr":"172.21.15.3:6815/33488","heartbeat_front_addr":"172.21.15.3:6813/33488","state":["exists","up"]},{"osd":2,"uuid":"26ac4b95-9e4e-4688-b8f0-0441d50d0350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":33499},{"type":"v1","addr":"172.21.15.3:6825","nonce":33499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33499},{"type":"v1","addr":"172.21.15.3:6827","nonce":33499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33499},{"type":"v1","addr":"172.21.15.3:6831","nonce":33499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":33499},{"type":"v1","addr":"172.21.15.3:6829","nonce":33499}]},"public_addr":"172.21.15.3:6825/33499","cluster_addr":"172.21.15.3:6827/33499","heartbeat_back_addr":"172.21.15.3:6831/33499","heartbeat_front_addr":"172.21.15.3:6829/33499","state":["exists","up"]},{"osd":3,"uuid":"f628415a-e2bc-4a78-9612-626aff31178c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33490},{"type":"v1","addr":"172.21.15.3:6817","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33490},{"type":"v1","addr":"172.21.15.3:6819","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33490},{"type":"v1","addr":"172.21.15.3:6823","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":33490},{"type":"v1","addr":"172.21.15.3:6821","nonce":33490}]},"public_addr":"172.21.15.3:6817/33490","cluster_addr":"172.21.15.3:6819/33490","heartbeat_back_addr":"172.21.15.3:6823/33490","heartbeat_front_addr":"172.21.15.3:6821/33490","state":["exists","up"]},{"osd":4,"uuid":"224fc661-d05e-48e6-b388-5c22ea990499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33605},{"type":"v1","addr":"172.21.15.27:6801","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33605},{"type":"v1","addr":"172.21.15.27:6803","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33605},{"type":"v1","addr":"172.21.15.27:6807","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33605},{"type":"v1","addr":"172.21.15.27:6805","nonce":33605}]},"public_addr":"172.21.15.27:6801/33605","cluster_addr":"172.21.15.27:6803/33605","heartbeat_back_addr":"172.21.15.27:6807/33605","heartbeat_front_addr":"172.21.15.27:6805/33605","state":["exists","up"]},{"osd":5,"uuid":"e9ef314e-7fb8-483c-987a-79d4ed749c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33604},{"type":"v1","addr":"172.21.15.27:6817","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33604},{"type":"v1","addr":"172.21.15.27:6819","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33604},{"type":"v1","addr":"172.21.15.27:6823","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33604},{"type":"v1","addr":"172.21.15.27:6821","nonce":33604}]},"public_addr":"172.21.15.27:6817/33604","cluster_addr":"172.21.15.27:6819/33604","heartbeat_back_addr":"172.21.15.27:6823/33604","heartbeat_front_addr":"172.21.15.27:6821/33604","state":["exists","up"]},{"osd":6,"uuid":"01c26efd-8a3d-4000-a8b8-29447b790b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33606},{"type":"v1","addr":"172.21.15.27:6809","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33606},{"type":"v1","addr":"172.21.15.27:6811","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33606},{"type":"v1","addr":"172.21.15.27:6815","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33606},{"type":"v1","addr":"172.21.15.27:6813","nonce":33606}]},"public_addr":"172.21.15.27:6809/33606","cluster_addr":"172.21.15.27:6811/33606","heartbeat_back_addr":"172.21.15.27:6815/33606","heartbeat_front_addr":"172.21.15.27:6813/33606","state":["exists","up"]},{"osd":7,"uuid":"6acc100b-c7fb-4966-8373-536007deab14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33607},{"type":"v1","addr":"172.21.15.27:6825","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33607},{"type":"v1","addr":"172.21.15.27:6827","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33607},{"type":"v1","addr":"172.21.15.27:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33607},{"type":"v1","addr":"172.21.15.27:6829","nonce":33607}]},"public_addr":"172.21.15.27:6825/33607","cluster_addr":"172.21.15.27:6827/33607","heartbeat_back_addr":"172.21.15.27:6831/33607","heartbeat_front_addr":"172.21.15.27:6829/33607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.062340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.149508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.383754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.955313+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:22.925081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.404471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.168074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:06:23.445239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:6837/1848134842":"2023-10-09T16:15:11.818135+0000","172.21.15.3:6836/1848134842":"2023-10-09T16:15:11.818135+0000","192.168.0.1:0/3875502896":"2023-10-08T17:15:06.455191+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:18.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5a18060550 msgr2=0x7f5a18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5a18060550 0x7f5a18062a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5a30002250 tx=0x7f5a30009040 comp rx=0 tx=0).stop 2023-10-08T16:15:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 msgr2=0x7f5a340c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a340c79b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c016000 tx=0x7f5a2c017000 comp rx=0 tx=0).stop 2023-10-08T16:15:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 shutdown_connections 2023-10-08T16:15:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f5a18060550 0x7f5a18062a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a34156980 0x7f5a340c79b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f5a340c9990 0x7f5a3415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 --2- 172.21.15.3:0/827254029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340c95c0 0x7f5a34153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:18.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 >> 172.21.15.3:0/827254029 conn(0x7f5a3406b6b0 msgr2=0x7f5a34155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:18.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 shutdown_connections 2023-10-08T16:15:18.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:18.961+0000 7f5a3a09a700 1 -- 172.21.15.3:0/827254029 wait complete. 2023-10-08T16:15:19.984 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T16:15:19.984 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:20.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 Processor -- start 2023-10-08T16:15:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 -- start start 2023-10-08T16:15:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6750151410 0x7f67500c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f675015ae50 0x7f67500ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67500caaf0 con 0x7f6750151040 2023-10-08T16:15:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67500cadd0 con 0x7f6750151410 2023-10-08T16:15:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67500cb0b0 con 0x7f675015ae50 2023-10-08T16:15:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6750151410 0x7f67500c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6750151410 0x7f67500c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41010/0 (socket says 172.21.15.3:41010) 2023-10-08T16:15:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 -- 172.21.15.3:0/2005886192 learned_addr learned my addr 172.21.15.3:0/2005886192 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674f7fe700 1 --2- 172.21.15.3:0/2005886192 >> v2:172.21.15.27:3300/0 conn(0x7f675015ae50 0x7f67500ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 -- 172.21.15.3:0/2005886192 >> v2:172.21.15.27:3300/0 conn(0x7f675015ae50 msgr2=0x7f67500ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 --2- 172.21.15.3:0/2005886192 >> v2:172.21.15.27:3300/0 conn(0x7f675015ae50 0x7f67500ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 -- 172.21.15.3:0/2005886192 >> v1:172.21.15.27:6789/0 conn(0x7f6750151040 legacy=0x7f675015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 -- 172.21.15.3:0/2005886192 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500cb390 con 0x7f6750151410 2023-10-08T16:15:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f6747fff700 1 --2- 172.21.15.3:0/2005886192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6750151410 0x7f67500c9d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f67500cb670 tx=0x7f6738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec635fa52eaed94e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674e7fc700 1 -- 172.21.15.3:0/2005886192 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738009e70 con 0x7f6750151410 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674e7fc700 1 -- 172.21.15.3:0/2005886192 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673800b860 con 0x7f6750151410 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.101+0000 7f674e7fc700 1 -- 172.21.15.3:0/2005886192 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800bc00 con 0x7f6750151410 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- 172.21.15.3:0/2005886192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6750151410 msgr2=0x7f67500c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 --2- 172.21.15.3:0/2005886192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6750151410 0x7f67500c9d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f67500cb670 tx=0x7f6738009250 comp rx=0 tx=0).stop 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- 172.21.15.3:0/2005886192 shutdown_connections 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 --2- 172.21.15.3:0/2005886192 >> v2:172.21.15.27:3300/0 conn(0x7f675015ae50 0x7f67500ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 --2- 172.21.15.3:0/2005886192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6750151410 0x7f67500c9d80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- 172.21.15.3:0/2005886192 >> 172.21.15.3:0/2005886192 conn(0x7f67500cc410 msgr2=0x7f67500c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- 172.21.15.3:0/2005886192 shutdown_connections 2023-10-08T16:15:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- 172.21.15.3:0/2005886192 wait complete. 2023-10-08T16:15:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 Processor -- start 2023-10-08T16:15:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- start start 2023-10-08T16:15:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6750151040 0x7f67501517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f675015ae50 0x7f6750155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750154d60 0x7f675014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750154b40 con 0x7f675015ae50 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750155e70 con 0x7f6750154d60 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.105+0000 7f674ffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500c0b90 con 0x7f6750151040 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f675015ae50 0x7f6750155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f675015ae50 0x7f6750155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41024/0 (socket says 172.21.15.3:41024) 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 -- 172.21.15.3:0/3844660032 learned_addr learned my addr 172.21.15.3:0/3844660032 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f674effd700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6750151040 0x7f67501517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f674f7fe700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750154d60 0x7f675014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 -- 172.21.15.3:0/3844660032 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6750151040 msgr2=0x7f67501517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6750151040 0x7f67501517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 -- 172.21.15.3:0/3844660032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750154d60 msgr2=0x7f675014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750154d60 0x7f675014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 -- 172.21.15.3:0/3844660032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380094f0 con 0x7f675015ae50 2023-10-08T16:15:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6747fff700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f675015ae50 0x7f6750155770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f67500c82d0 tx=0x7f6738017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800bbe0 con 0x7f675015ae50 2023-10-08T16:15:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738011420 con 0x7f675015ae50 2023-10-08T16:15:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67500c0e70 con 0x7f675015ae50 2023-10-08T16:15:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380117c0 con 0x7f675015ae50 2023-10-08T16:15:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67500c1430 con 0x7f675015ae50 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.109+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67500ca740 con 0x7f675015ae50 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6738011bf0 con 0x7f675015ae50 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6730060550 0x7f6730062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f673807d9c0 con 0x7f675015ae50 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f674effd700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6730060550 0x7f6730062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f67300663f0 0x7f6730068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 --> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6730068eb0 con 0x7f67300663f0 2023-10-08T16:15:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6738082240 con 0x7f675015ae50 2023-10-08T16:15:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f674f7fe700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f67300663f0 0x7f6730068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f674effd700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6730060550 0x7f6730062a00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6740003a80 tx=0x7f6740007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f674f7fe700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f67300663f0 0x7f6730068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.113+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== osd.0 v2:172.21.15.3:6800/33489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6730068eb0 con 0x7f67300663f0 2023-10-08T16:15:20.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 --> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f675004be40 con 0x7f67300663f0 2023-10-08T16:15:20.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f6746ffd700 1 -- 172.21.15.3:0/3844660032 <== osd.0 v2:172.21.15.3:6800/33489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f675004be40 con 0x7f67300663f0 2023-10-08T16:15:20.140 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f67300663f0 msgr2=0x7f6730068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6800/33489,v1:172.21.15.3:6801/33489] conn(0x7f67300663f0 0x7f6730068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6730060550 msgr2=0x7f6730062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6730060550 0x7f6730062a00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6740003a80 tx=0x7f6740007ec0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f675015ae50 msgr2=0x7f6750155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 --2- 172.21.15.3:0/3844660032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f675015ae50 0x7f6750155770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f67500c82d0 tx=0x7f6738017000 comp rx=0 tx=0).stop 2023-10-08T16:15:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674f7fe700 1 -- 172.21.15.3:0/3844660032 reap_dead start 2023-10-08T16:15:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 shutdown_connections 2023-10-08T16:15:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 >> 172.21.15.3:0/3844660032 conn(0x7f67500cc410 msgr2=0x7f675006ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 shutdown_connections 2023-10-08T16:15:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.133+0000 7f674ffff700 1 -- 172.21.15.3:0/3844660032 wait complete. 2023-10-08T16:15:20.154 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T16:15:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 Processor -- start 2023-10-08T16:15:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 -- start start 2023-10-08T16:15:20.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f37680ca070 0x7f37680ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f376806d900 0x7f376815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376806c3a0 con 0x7f376806aeb0 2023-10-08T16:15:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376806c8a0 con 0x7f376806d900 2023-10-08T16:15:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376d73f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376806cb40 con 0x7f37680ca070 2023-10-08T16:15:20.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f376806d900 0x7f376815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f3767fff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f37680ca070 0x7f37680ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f376806d900 0x7f376815ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:40028/0 (socket says 172.21.15.3:40028) 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 -- 172.21.15.3:0/2809021964 learned_addr learned my addr 172.21.15.3:0/2809021964 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 -- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f37680ca070 msgr2=0x7f37680ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 --2- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f37680ca070 0x7f37680ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 -- 172.21.15.3:0/2809021964 >> v1:172.21.15.27:6789/0 conn(0x7f376806aeb0 legacy=0x7f376806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f3766ffd700 1 -- 172.21.15.3:0/2809021964 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336883920 0 0) 0x7f376806c3a0 con 0x7f376806aeb0 2023-10-08T16:15:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.265+0000 7f376cf3e700 1 -- 172.21.15.3:0/2809021964 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376806ce20 con 0x7f376806d900 2023-10-08T16:15:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376cf3e700 1 --2- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376806d900 0x7f376815ce90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37600099b0 tx=0x7f3760009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c2998c1ed32d336 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f3766ffd700 1 -- 172.21.15.3:0/2809021964 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760009ea0 con 0x7f376806d900 2023-10-08T16:15:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f3766ffd700 1 -- 172.21.15.3:0/2809021964 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000b860 con 0x7f376806d900 2023-10-08T16:15:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f3766ffd700 1 -- 172.21.15.3:0/2809021964 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000bc00 con 0x7f376806d900 2023-10-08T16:15:20.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376806d900 msgr2=0x7f376815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 --2- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376806d900 0x7f376815ce90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37600099b0 tx=0x7f3760009250 comp rx=0 tx=0).stop 2023-10-08T16:15:20.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- 172.21.15.3:0/2809021964 shutdown_connections 2023-10-08T16:15:20.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 --2- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376806d900 0x7f376815ce90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 --2- 172.21.15.3:0/2809021964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f37680ca070 0x7f37680ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- 172.21.15.3:0/2809021964 >> 172.21.15.3:0/2809021964 conn(0x7f37680c83d0 msgr2=0x7f37680c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- 172.21.15.3:0/2809021964 shutdown_connections 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- 172.21.15.3:0/2809021964 wait complete. 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 Processor -- start 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- start start 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f376806d900 0x7f37680b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 0x7f376815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376814f2a0 0x7f376815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c5a60 con 0x7f37680ca070 2023-10-08T16:15:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680aef60 con 0x7f376814f2a0 2023-10-08T16:15:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376d73f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c5780 con 0x7f376806d900 2023-10-08T16:15:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f37677fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 0x7f376815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f37677fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 0x7f376815a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41036/0 (socket says 172.21.15.3:41036) 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f37677fe700 1 -- 172.21.15.3:0/3446908410 learned_addr learned my addr 172.21.15.3:0/3446908410 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f3767fff700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f376806d900 0x7f37680b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.269+0000 7f376cf3e700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376814f2a0 0x7f376815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f37677fe700 1 -- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f376806d900 msgr2=0x7f37680b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f37677fe700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f376806d900 0x7f37680b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f37677fe700 1 -- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376814f2a0 msgr2=0x7f376815ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f37677fe700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376814f2a0 0x7f376815ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f37677fe700 1 -- 172.21.15.3:0/3446908410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600094f0 con 0x7f37680ca070 2023-10-08T16:15:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f37677fe700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 0x7f376815a6e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f375800c810 tx=0x7f3758007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758012700 con 0x7f37680ca070 2023-10-08T16:15:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37580128a0 con 0x7f37680ca070 2023-10-08T16:15:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37680ae910 con 0x7f37680ca070 2023-10-08T16:15:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758012c60 con 0x7f37680ca070 2023-10-08T16:15:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37680b1590 con 0x7f37680ca070 2023-10-08T16:15:20.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376804be40 con 0x7f37680ca070 2023-10-08T16:15:20.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f375801b400 con 0x7f37680ca070 2023-10-08T16:15:20.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f375ffff700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3748060550 0x7f3748062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f375807c0e0 con 0x7f37680ca070 2023-10-08T16:15:20.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.273+0000 7f3767fff700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3748060550 0x7f3748062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.277+0000 7f3767fff700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3748060550 0x7f3748062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3750007600 tx=0x7f375000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.285+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f375804c9a0 con 0x7f37680ca070 2023-10-08T16:15:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.449+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f376806d100 con 0x7f3748060550 2023-10-08T16:15:20.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f375ffff700 1 -- 172.21.15.3:0/3446908410 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f376806d100 con 0x7f3748060550 2023-10-08T16:15:20.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3748060550 msgr2=0x7f3748062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3748060550 0x7f3748062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3750007600 tx=0x7f375000b040 comp rx=0 tx=0).stop 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 msgr2=0x7f376815a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 0x7f376815a6e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f375800c810 tx=0x7f3758007df0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 shutdown_connections 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3748060550 0x7f3748062a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376814f2a0 0x7f376815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37680ca070 0x7f376815a6e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 --2- 172.21.15.3:0/3446908410 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f376806d900 0x7f37680b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 >> 172.21.15.3:0/3446908410 conn(0x7f37680c83d0 msgr2=0x7f37680c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 shutdown_connections 2023-10-08T16:15:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.453+0000 7f376d73f700 1 -- 172.21.15.3:0/3446908410 wait complete. 2023-10-08T16:15:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T16:15:20.474 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T16:15:20.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:20.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 Processor -- start 2023-10-08T16:15:20.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 -- start start 2023-10-08T16:15:20.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f998c15ea10 0x7f998c0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c06c770 0x7f998c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0aea80 con 0x7f998c15d630 2023-10-08T16:15:20.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0ae870 con 0x7f998c15ea10 2023-10-08T16:15:20.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f999105f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0aed60 con 0x7f998c06c770 2023-10-08T16:15:20.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f998c15ea10 0x7f998c0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f998c15ea10 0x7f998c0afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41052/0 (socket says 172.21.15.3:41052) 2023-10-08T16:15:20.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 -- 172.21.15.3:0/3031475758 learned_addr learned my addr 172.21.15.3:0/3031475758 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998ad9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f998c15d630 0x7f998c06d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40456/0 (socket says 172.21.15.3:40456) 2023-10-08T16:15:20.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998b59e700 1 --2- 172.21.15.3:0/3031475758 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c06c770 0x7f998c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 -- 172.21.15.3:0/3031475758 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c06c770 msgr2=0x7f998c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:20.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 --2- 172.21.15.3:0/3031475758 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c06c770 0x7f998c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 -- 172.21.15.3:0/3031475758 >> v1:172.21.15.3:6789/0 conn(0x7f998c15d630 legacy=0x7f998c06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f9989d9b700 1 -- 172.21.15.3:0/3031475758 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495989990 0 0) 0x7f998c0aea80 con 0x7f998c15d630 2023-10-08T16:15:20.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 -- 172.21.15.3:0/3031475758 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0af040 con 0x7f998c15ea10 2023-10-08T16:15:20.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f998a59c700 1 --2- 172.21.15.3:0/3031475758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c15ea10 0x7f998c0afb20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f997c0099b0 tx=0x7f997c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d7c4ec04250fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f9989d9b700 1 -- 172.21.15.3:0/3031475758 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c009ea0 con 0x7f998c15ea10 2023-10-08T16:15:20.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f9989d9b700 1 -- 172.21.15.3:0/3031475758 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c00b8f0 con 0x7f998c15ea10 2023-10-08T16:15:20.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.585+0000 7f9989d9b700 1 -- 172.21.15.3:0/3031475758 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00bc90 con 0x7f998c15ea10 2023-10-08T16:15:20.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 -- 172.21.15.3:0/3031475758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c15ea10 msgr2=0x7f998c0afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 --2- 172.21.15.3:0/3031475758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c15ea10 0x7f998c0afb20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f997c0099b0 tx=0x7f997c009250 comp rx=0 tx=0).stop 2023-10-08T16:15:20.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 -- 172.21.15.3:0/3031475758 shutdown_connections 2023-10-08T16:15:20.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 --2- 172.21.15.3:0/3031475758 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c06c770 0x7f998c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 --2- 172.21.15.3:0/3031475758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c15ea10 0x7f998c0afb20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 -- 172.21.15.3:0/3031475758 >> 172.21.15.3:0/3031475758 conn(0x7f998c0cc560 msgr2=0x7f998c0ad550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 -- 172.21.15.3:0/3031475758 shutdown_connections 2023-10-08T16:15:20.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 -- 172.21.15.3:0/3031475758 wait complete. 2023-10-08T16:15:20.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 Processor -- start 2023-10-08T16:15:20.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.589+0000 7f999105f700 1 -- start start 2023-10-08T16:15:20.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c06c770 0x7f998c171560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f998c15d630 0x7f998c16e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c0c72b0 0x7f998c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c16ef20 con 0x7f998c06c770 2023-10-08T16:15:20.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c16bdb0 con 0x7f998c15d630 2023-10-08T16:15:20.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c171c60 con 0x7f998c0c72b0 2023-10-08T16:15:20.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c06c770 0x7f998c171560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c06c770 0x7f998c171560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41058/0 (socket says 172.21.15.3:41058) 2023-10-08T16:15:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 -- 172.21.15.3:0/3351760964 learned_addr learned my addr 172.21.15.3:0/3351760964 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998b59e700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c0c72b0 0x7f998c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998a59c700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f998c15d630 0x7f998c16e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 -- 172.21.15.3:0/3351760964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c0c72b0 msgr2=0x7f998c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f998c0c72b0 0x7f998c1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 -- 172.21.15.3:0/3351760964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f998c15d630 msgr2=0x7f998c16e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f998c15d630 0x7f998c16e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 -- 172.21.15.3:0/3351760964 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c0094f0 con 0x7f998c06c770 2023-10-08T16:15:20.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f998ad9d700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c06c770 0x7f998c171560 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f998000c7e0 tx=0x7f9980007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980007300 con 0x7f998c06c770 2023-10-08T16:15:20.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9980007460 con 0x7f998c06c770 2023-10-08T16:15:20.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c171f40 con 0x7f998c06c770 2023-10-08T16:15:20.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980004830 con 0x7f998c06c770 2023-10-08T16:15:20.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.593+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c0c7720 con 0x7f998c06c770 2023-10-08T16:15:20.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f998c16bba0 con 0x7f998c06c770 2023-10-08T16:15:20.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9980004be0 con 0x7f998c06c770 2023-10-08T16:15:20.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f9972ffd700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9978060550 0x7f9978062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f998007c160 con 0x7f998c06c770 2023-10-08T16:15:20.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f9972ffd700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7f99780663f0 0x7f9978068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f998a59c700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9978060550 0x7f9978062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 --> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9978068eb0 con 0x7f99780663f0 2023-10-08T16:15:20.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f998007c530 con 0x7f998c06c770 2023-10-08T16:15:20.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f998b59e700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7f99780663f0 0x7f9978068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f998a59c700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9978060550 0x7f9978062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f997c0099b0 tx=0x7f997c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.597+0000 7f998b59e700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7f99780663f0 0x7f9978068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.601+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== osd.1 v2:172.21.15.3:6804/33488 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9978068eb0 con 0x7f99780663f0 2023-10-08T16:15:20.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.613+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 --> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f998c071180 con 0x7f99780663f0 2023-10-08T16:15:20.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f9972ffd700 1 -- 172.21.15.3:0/3351760964 <== osd.1 v2:172.21.15.3:6804/33488 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f998c071180 con 0x7f99780663f0 2023-10-08T16:15:20.623 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:20.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7f99780663f0 msgr2=0x7f9978068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6804/33488,v1:172.21.15.3:6806/33488] conn(0x7f99780663f0 0x7f9978068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9978060550 msgr2=0x7f9978062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9978060550 0x7f9978062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f997c0099b0 tx=0x7f997c017000 comp rx=0 tx=0).stop 2023-10-08T16:15:20.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c06c770 msgr2=0x7f998c171560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 --2- 172.21.15.3:0/3351760964 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f998c06c770 0x7f998c171560 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f998000c7e0 tx=0x7f9980007e10 comp rx=0 tx=0).stop 2023-10-08T16:15:20.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f998b59e700 1 -- 172.21.15.3:0/3351760964 reap_dead start 2023-10-08T16:15:20.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 shutdown_connections 2023-10-08T16:15:20.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 >> 172.21.15.3:0/3351760964 conn(0x7f998c0cc560 msgr2=0x7f998c15f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 shutdown_connections 2023-10-08T16:15:20.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.617+0000 7f999105f700 1 -- 172.21.15.3:0/3351760964 wait complete. 2023-10-08T16:15:20.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T16:15:20.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.741+0000 7f80ef0e4700 1 Processor -- start 2023-10-08T16:15:20.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.741+0000 7f80ef0e4700 1 -- start start 2023-10-08T16:15:20.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f80e8156e40 0x7f80e80c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80e8068280 0x7f80e8068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80c8690 con 0x7f80e8068fd0 2023-10-08T16:15:20.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e8068bc0 con 0x7f80e8156e40 2023-10-08T16:15:20.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80c70b0 con 0x7f80e8068280 2023-10-08T16:15:20.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee0e2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f80e8156e40 0x7f80e80c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ed8e1700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f80e8068fd0 0x7f80e80c6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40466/0 (socket says 172.21.15.3:40466) 2023-10-08T16:15:20.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ed8e1700 1 -- 172.21.15.3:0/3087517176 learned_addr learned my addr 172.21.15.3:0/3087517176 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:20.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee8e3700 1 --2- 172.21.15.3:0/3087517176 >> v2:172.21.15.27:3300/0 conn(0x7f80e8068280 0x7f80e8068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee0e2700 1 -- 172.21.15.3:0/3087517176 >> v2:172.21.15.27:3300/0 conn(0x7f80e8068280 msgr2=0x7f80e8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee0e2700 1 --2- 172.21.15.3:0/3087517176 >> v2:172.21.15.27:3300/0 conn(0x7f80e8068280 0x7f80e8068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee0e2700 1 -- 172.21.15.3:0/3087517176 >> v1:172.21.15.3:6789/0 conn(0x7f80e8068fd0 legacy=0x7f80e80c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ed0e0700 1 -- 172.21.15.3:0/3087517176 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235501139 0 0) 0x7f80e80c8690 con 0x7f80e8068fd0 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee0e2700 1 -- 172.21.15.3:0/3087517176 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80c7390 con 0x7f80e8156e40 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ee0e2700 1 --2- 172.21.15.3:0/3087517176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c8150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f80e806f360 tx=0x7f80e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9c96ce84725693 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ed0e0700 1 -- 172.21.15.3:0/3087517176 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011630 con 0x7f80e8156e40 2023-10-08T16:15:20.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ed0e0700 1 -- 172.21.15.3:0/3087517176 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4011790 con 0x7f80e8156e40 2023-10-08T16:15:20.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ed0e0700 1 -- 172.21.15.3:0/3087517176 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011b30 con 0x7f80e8156e40 2023-10-08T16:15:20.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- 172.21.15.3:0/3087517176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 msgr2=0x7f80e80c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/3087517176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c8150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f80e806f360 tx=0x7f80e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- 172.21.15.3:0/3087517176 shutdown_connections 2023-10-08T16:15:20.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/3087517176 >> v2:172.21.15.27:3300/0 conn(0x7f80e8068280 0x7f80e8068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/3087517176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c8150 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- 172.21.15.3:0/3087517176 >> 172.21.15.3:0/3087517176 conn(0x7f80e80c8c90 msgr2=0x7f80e80c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- 172.21.15.3:0/3087517176 shutdown_connections 2023-10-08T16:15:20.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.745+0000 7f80ef0e4700 1 -- 172.21.15.3:0/3087517176 wait complete. 2023-10-08T16:15:20.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 Processor -- start 2023-10-08T16:15:20.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 -- start start 2023-10-08T16:15:20.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80e8068280 0x7f80e80a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f80e8068fd0 0x7f80e8155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80a9ac0 con 0x7f80e8156e40 2023-10-08T16:15:20.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8156050 con 0x7f80e8068280 2023-10-08T16:15:20.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ef0e4700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80a8eb0 con 0x7f80e8068fd0 2023-10-08T16:15:20.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ee8e3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ee8e3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41072/0 (socket says 172.21.15.3:41072) 2023-10-08T16:15:20.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ee8e3700 1 -- 172.21.15.3:0/1550140786 learned_addr learned my addr 172.21.15.3:0/1550140786 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:20.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ee0e2700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80e8068280 0x7f80e80a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.749+0000 7f80ed8e1700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f80e8068fd0 0x7f80e8155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee8e3700 1 -- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f80e8068fd0 msgr2=0x7f80e8155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee8e3700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f80e8068fd0 0x7f80e8155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee8e3700 1 -- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80e8068280 msgr2=0x7f80e80a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee8e3700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80e8068280 0x7f80e80a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee8e3700 1 -- 172.21.15.3:0/1550140786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4009420 con 0x7f80e8156e40 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee8e3700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c29f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009df0 tx=0x7f80e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000caa0 con 0x7f80e8156e40 2023-10-08T16:15:20.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000f040 con 0x7f80e8156e40 2023-10-08T16:15:20.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80a9190 con 0x7f80e8156e40 2023-10-08T16:15:20.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000ce70 con 0x7f80e8156e40 2023-10-08T16:15:20.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80a9750 con 0x7f80e8156e40 2023-10-08T16:15:20.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e80a9c30 con 0x7f80e8156e40 2023-10-08T16:15:20.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f80e0014690 con 0x7f80e8156e40 2023-10-08T16:15:20.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80de7fc700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f80cc060550 0x7f80cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:20.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f80e007cd80 con 0x7f80e8156e40 2023-10-08T16:15:20.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.753+0000 7f80ee0e2700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f80cc060550 0x7f80cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:20.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.757+0000 7f80ee0e2700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f80cc060550 0x7f80cc062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f80e40093f0 tx=0x7f80e4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:20.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.761+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80e00510d0 con 0x7f80e8156e40 2023-10-08T16:15:20.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.917+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f80e804be40 con 0x7f80cc060550 2023-10-08T16:15:20.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.921+0000 7f80de7fc700 1 -- 172.21.15.3:0/1550140786 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80e804be40 con 0x7f80cc060550 2023-10-08T16:15:20.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f80cc060550 msgr2=0x7f80cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f80cc060550 0x7f80cc062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f80e40093f0 tx=0x7f80e4017000 comp rx=0 tx=0).stop 2023-10-08T16:15:20.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 msgr2=0x7f80e80c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:20.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c29f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009df0 tx=0x7f80e000b040 comp rx=0 tx=0).stop 2023-10-08T16:15:20.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 shutdown_connections 2023-10-08T16:15:20.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f80cc060550 0x7f80cc062a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e8156e40 0x7f80e80c29f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f80e8068fd0 0x7f80e8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 --2- 172.21.15.3:0/1550140786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80e8068280 0x7f80e80a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:20.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 >> 172.21.15.3:0/1550140786 conn(0x7f80e80c8c90 msgr2=0x7f80e80b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:20.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 shutdown_connections 2023-10-08T16:15:20.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:20.925+0000 7f80ef0e4700 1 -- 172.21.15.3:0/1550140786 wait complete. 2023-10-08T16:15:20.934 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T16:15:20.948 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T16:15:20.949 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:21.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.049+0000 7fd158dc6700 1 Processor -- start 2023-10-08T16:15:21.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.049+0000 7fd158dc6700 1 -- start start 2023-10-08T16:15:21.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 0x7fd1540c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd1540b1290 0x7fd1540c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15415bb70 con 0x7fd1541571f0 2023-10-08T16:15:21.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540ae410 con 0x7fd154156e20 2023-10-08T16:15:21.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15415b6e0 con 0x7fd1540b1290 2023-10-08T16:15:21.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 0x7fd1540c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd152d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd1540b1290 0x7fd1540c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 0x7fd1540c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41080/0 (socket says 172.21.15.3:41080) 2023-10-08T16:15:21.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15259c700 1 -- 172.21.15.3:0/3371043556 learned_addr learned my addr 172.21.15.3:0/3371043556 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd152d9d700 1 -- 172.21.15.3:0/3371043556 >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 msgr2=0x7fd1540c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd152d9d700 1 --2- 172.21.15.3:0/3371043556 >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 0x7fd1540c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd152d9d700 1 -- 172.21.15.3:0/3371043556 >> v1:172.21.15.27:6789/0 conn(0x7fd1541571f0 legacy=0x7fd1540b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15159a700 1 -- 172.21.15.3:0/3371043556 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159120630 0 0) 0x7fd144001490 con 0x7fd1541571f0 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd152d9d700 1 -- 172.21.15.3:0/3371043556 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15415adb0 con 0x7fd1540b1290 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15259c700 1 --2- 172.21.15.3:0/3371043556 >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 0x7fd1540c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:21.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd152d9d700 1 --2- 172.21.15.3:0/3371043556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 0x7fd1540c89b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd1540687a0 tx=0x7fd14c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f111b3d1be263a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15159a700 1 -- 172.21.15.3:0/3371043556 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c011630 con 0x7fd1540b1290 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15159a700 1 -- 172.21.15.3:0/3371043556 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c011790 con 0x7fd1540b1290 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd15159a700 1 -- 172.21.15.3:0/3371043556 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c011b30 con 0x7fd1540b1290 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- 172.21.15.3:0/3371043556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 msgr2=0x7fd1540c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 --2- 172.21.15.3:0/3371043556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 0x7fd1540c89b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd1540687a0 tx=0x7fd14c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- 172.21.15.3:0/3371043556 shutdown_connections 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 --2- 172.21.15.3:0/3371043556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 0x7fd1540c89b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 --2- 172.21.15.3:0/3371043556 >> v2:172.21.15.3:3300/0 conn(0x7fd154156e20 0x7fd1540c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- 172.21.15.3:0/3371043556 >> 172.21.15.3:0/3371043556 conn(0x7fd1540cc560 msgr2=0x7fd1540ad550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- 172.21.15.3:0/3371043556 shutdown_connections 2023-10-08T16:15:21.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.053+0000 7fd158dc6700 1 -- 172.21.15.3:0/3371043556 wait complete. 2023-10-08T16:15:21.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 Processor -- start 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 -- start start 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 0x7fd154148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd154156e20 0x7fd154167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1541571f0 0x7fd154148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541489d0 con 0x7fd154156e20 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15414bfb0 con 0x7fd1540b1290 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd158dc6700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154168420 con 0x7fd1541571f0 2023-10-08T16:15:21.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd154156e20 0x7fd154167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd154156e20 0x7fd154167ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41096/0 (socket says 172.21.15.3:41096) 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 -- 172.21.15.3:0/472506451 learned_addr learned my addr 172.21.15.3:0/472506451 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd152d9d700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1541571f0 0x7fd154148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd15259c700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 0x7fd154148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 -- 172.21.15.3:0/472506451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1541571f0 msgr2=0x7fd154148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd1541571f0 0x7fd154148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 -- 172.21.15.3:0/472506451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 msgr2=0x7fd154148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1540b1290 0x7fd154148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 -- 172.21.15.3:0/472506451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0094f0 con 0x7fd154156e20 2023-10-08T16:15:21.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.057+0000 7fd151d9b700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd154156e20 0x7fd154167ee0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c910 tx=0x7fd144001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144012630 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1440127b0 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c009420 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144012b70 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15414b680 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd154071180 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd144003030 con 0x7fd154156e20 2023-10-08T16:15:21.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd134060550 0x7fd134062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fd14407c2e0 con 0x7fd154156e20 2023-10-08T16:15:21.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd15259c700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd134060550 0x7fd134062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7fd1340663f0 0x7fd134068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 --> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd134068eb0 con 0x7fd1340663f0 2023-10-08T16:15:21.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd14407e920 con 0x7fd154156e20 2023-10-08T16:15:21.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.061+0000 7fd152d9d700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7fd1340663f0 0x7fd134068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.065+0000 7fd15259c700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd134060550 0x7fd134062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd154151830 tx=0x7fd13c009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.065+0000 7fd152d9d700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7fd1340663f0 0x7fd134068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.065+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== osd.2 v2:172.21.15.3:6824/33499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd134068eb0 con 0x7fd1340663f0 2023-10-08T16:15:21.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.081+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 --> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd15415bb70 con 0x7fd1340663f0 2023-10-08T16:15:21.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.081+0000 7fd14a7fc700 1 -- 172.21.15.3:0/472506451 <== osd.2 v2:172.21.15.3:6824/33499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd15415bb70 con 0x7fd1340663f0 2023-10-08T16:15:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:21.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.081+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7fd1340663f0 msgr2=0x7fd134068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.081+0000 7fd158dc6700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6824/33499,v1:172.21.15.3:6825/33499] conn(0x7fd1340663f0 0x7fd134068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.081+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd134060550 msgr2=0x7fd134062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd134060550 0x7fd134062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd154151830 tx=0x7fd13c009250 comp rx=0 tx=0).stop 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd154156e20 msgr2=0x7fd154167ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 --2- 172.21.15.3:0/472506451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd154156e20 0x7fd154167ee0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c910 tx=0x7fd144001700 comp rx=0 tx=0).stop 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd152d9d700 1 -- 172.21.15.3:0/472506451 reap_dead start 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 shutdown_connections 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 >> 172.21.15.3:0/472506451 conn(0x7fd1540cc560 msgr2=0x7fd15406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 shutdown_connections 2023-10-08T16:15:21.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.085+0000 7fd158dc6700 1 -- 172.21.15.3:0/472506451 wait complete. 2023-10-08T16:15:21.103 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T16:15:21.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.201+0000 7fd2dea45700 1 Processor -- start 2023-10-08T16:15:21.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.201+0000 7fd2dea45700 1 -- start start 2023-10-08T16:15:21.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd2d8068fd0 0x7fd2d80c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068280 0x7fd2d80686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d8068c00 con 0x7fd2d8156e40 2023-10-08T16:15:21.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80c70b0 con 0x7fd2d8068fd0 2023-10-08T16:15:21.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c7390 con 0x7fd2d8068280 2023-10-08T16:15:21.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dd242700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd2d8068fd0 0x7fd2d80c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dda43700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd2d8156e40 0x7fd2d80c8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40478/0 (socket says 172.21.15.3:40478) 2023-10-08T16:15:21.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dda43700 1 -- 172.21.15.3:0/868367045 learned_addr learned my addr 172.21.15.3:0/868367045 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:21.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2de244700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068280 0x7fd2d80686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dca41700 1 -- 172.21.15.3:0/868367045 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262984917 0 0) 0x7fd2d8068c00 con 0x7fd2d8156e40 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dca41700 1 -- 172.21.15.3:0/868367045 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c4003570 con 0x7fd2d8156e40 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dd242700 1 -- 172.21.15.3:0/868367045 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068280 msgr2=0x7fd2d80686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dd242700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068280 0x7fd2d80686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dd242700 1 -- 172.21.15.3:0/868367045 >> v1:172.21.15.3:6789/0 conn(0x7fd2d8156e40 legacy=0x7fd2d80c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dca41700 1 -- 172.21.15.3:0/868367045 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 581504982 0 0) 0x7fd2c4003570 con 0x7fd2d8156e40 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dd242700 1 -- 172.21.15.3:0/868367045 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80c7670 con 0x7fd2d8068fd0 2023-10-08T16:15:21.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2de244700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068280 0x7fd2d80686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dd242700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8068fd0 0x7fd2d80c6860 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80098e0 tx=0x7fd2c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18708f3b29d5346c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dca41700 1 -- 172.21.15.3:0/868367045 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4001470 con 0x7fd2d8068fd0 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dca41700 1 -- 172.21.15.3:0/868367045 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8011420 con 0x7fd2d8068fd0 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dca41700 1 -- 172.21.15.3:0/868367045 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80117a0 con 0x7fd2d8068fd0 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 -- 172.21.15.3:0/868367045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8068fd0 msgr2=0x7fd2d80c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8068fd0 0x7fd2d80c6860 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80098e0 tx=0x7fd2c80091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 -- 172.21.15.3:0/868367045 shutdown_connections 2023-10-08T16:15:21.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.205+0000 7fd2dea45700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068280 0x7fd2d80686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 --2- 172.21.15.3:0/868367045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8068fd0 0x7fd2d80c6860 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- 172.21.15.3:0/868367045 >> 172.21.15.3:0/868367045 conn(0x7fd2d80c8c90 msgr2=0x7fd2d80c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- 172.21.15.3:0/868367045 shutdown_connections 2023-10-08T16:15:21.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- 172.21.15.3:0/868367045 wait complete. 2023-10-08T16:15:21.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 Processor -- start 2023-10-08T16:15:21.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- start start 2023-10-08T16:15:21.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d8068280 0x7fd2d81524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068fd0 0x7fd2d8150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 0x7fd2d80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8167cc0 con 0x7fd2d8156e40 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8167060 con 0x7fd2d8068280 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dea45700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8167340 con 0x7fd2d8068fd0 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 0x7fd2d80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 0x7fd2d80acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41120/0 (socket says 172.21.15.3:41120) 2023-10-08T16:15:21.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dda43700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d8068280 0x7fd2d81524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 -- 172.21.15.3:0/3240800592 learned_addr learned my addr 172.21.15.3:0/3240800592 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2dd242700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068fd0 0x7fd2d8150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 -- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068fd0 msgr2=0x7fd2d8150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068fd0 0x7fd2d8150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 -- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d8068280 msgr2=0x7fd2d81524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d8068280 0x7fd2d81524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 -- 172.21.15.3:0/3240800592 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009a20 con 0x7fd2d8156e40 2023-10-08T16:15:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2de244700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 0x7fd2d80acb10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009f20 tx=0x7fd2d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.209+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000cb70 con 0x7fd2d8156e40 2023-10-08T16:15:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.213+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000f040 con 0x7fd2d8156e40 2023-10-08T16:15:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.213+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c8009420 con 0x7fd2d8156e40 2023-10-08T16:15:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.213+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0014480 con 0x7fd2d8156e40 2023-10-08T16:15:21.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.213+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d8167900 con 0x7fd2d8156e40 2023-10-08T16:15:21.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.213+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d804be40 con 0x7fd2d8156e40 2023-10-08T16:15:21.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.217+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd2d0003020 con 0x7fd2d8156e40 2023-10-08T16:15:21.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.217+0000 7fd2cdffb700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd2bc060550 0x7fd2bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.217+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fd2d007d8a0 con 0x7fd2d8156e40 2023-10-08T16:15:21.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.217+0000 7fd2dda43700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd2bc060550 0x7fd2bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.217+0000 7fd2dda43700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd2bc060550 0x7fd2bc062a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4004e60 tx=0x7fd2d4001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.221+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd2d004e140 con 0x7fd2d8156e40 2023-10-08T16:15:21.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.389+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2d8167e00 con 0x7fd2bc060550 2023-10-08T16:15:21.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.389+0000 7fd2cdffb700 1 -- 172.21.15.3:0/3240800592 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2d400f9e0 con 0x7fd2bc060550 2023-10-08T16:15:21.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd2bc060550 msgr2=0x7fd2bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd2bc060550 0x7fd2bc062a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4004e60 tx=0x7fd2d4001a10 comp rx=0 tx=0).stop 2023-10-08T16:15:21.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 msgr2=0x7fd2d80acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 0x7fd2d80acb10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009f20 tx=0x7fd2d000b040 comp rx=0 tx=0).stop 2023-10-08T16:15:21.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 shutdown_connections 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd2bc060550 0x7fd2bc062a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2d8156e40 0x7fd2d80acb10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd2d8068fd0 0x7fd2d8150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 --2- 172.21.15.3:0/3240800592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d8068280 0x7fd2d81524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 >> 172.21.15.3:0/3240800592 conn(0x7fd2d80c8c90 msgr2=0x7fd2d80adc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 shutdown_connections 2023-10-08T16:15:21.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.393+0000 7fd2dea45700 1 -- 172.21.15.3:0/3240800592 wait complete. 2023-10-08T16:15:21.404 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T16:15:21.412 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T16:15:21.412 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.521+0000 7f3c79856700 1 Processor -- start 2023-10-08T16:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.521+0000 7f3c79856700 1 -- start start 2023-10-08T16:15:21.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3c74155830 0x7f3c7415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c74157020 con 0x7f3c740cbec0 2023-10-08T16:15:21.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740c2700 con 0x7f3c74156c10 2023-10-08T16:15:21.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c740c85f0 con 0x7f3c74155830 2023-10-08T16:15:21.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c73fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3c740cbec0 0x7f3c740ca860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40488/0 (socket says 172.21.15.3:40488) 2023-10-08T16:15:21.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c73fff700 1 -- 172.21.15.3:0/2343351503 learned_addr learned my addr 172.21.15.3:0/2343351503 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:21.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c78854700 1 --2- 172.21.15.3:0/2343351503 >> v2:172.21.15.27:3300/0 conn(0x7f3c74155830 0x7f3c7415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c737fe700 1 -- 172.21.15.3:0/2343351503 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829104568 0 0) 0x7f3c74157020 con 0x7f3c740cbec0 2023-10-08T16:15:21.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c737fe700 1 -- 172.21.15.3:0/2343351503 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c5c003570 con 0x7f3c740cbec0 2023-10-08T16:15:21.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c78854700 1 -- 172.21.15.3:0/2343351503 >> v1:172.21.15.27:6789/0 conn(0x7f3c74156c10 legacy=0x7f3c740caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c78854700 1 -- 172.21.15.3:0/2343351503 >> v1:172.21.15.3:6789/0 conn(0x7f3c740cbec0 legacy=0x7f3c740ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c737fe700 1 -- 172.21.15.3:0/2343351503 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3043489918 0 0) 0x7f3c5c003570 con 0x7f3c740cbec0 2023-10-08T16:15:21.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c78854700 1 -- 172.21.15.3:0/2343351503 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740c1810 con 0x7f3c74155830 2023-10-08T16:15:21.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c78854700 1 --2- 172.21.15.3:0/2343351503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c74155830 0x7f3c7415a0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c640098e0 tx=0x7f3c640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afc8f7f3a6fc0863 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c737fe700 1 -- 172.21.15.3:0/2343351503 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400b640 con 0x7f3c74155830 2023-10-08T16:15:21.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c737fe700 1 -- 172.21.15.3:0/2343351503 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400b7a0 con 0x7f3c74155830 2023-10-08T16:15:21.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c737fe700 1 -- 172.21.15.3:0/2343351503 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400bb40 con 0x7f3c74155830 2023-10-08T16:15:21.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 -- 172.21.15.3:0/2343351503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c74155830 msgr2=0x7f3c7415a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 --2- 172.21.15.3:0/2343351503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c74155830 0x7f3c7415a0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c640098e0 tx=0x7f3c640091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 -- 172.21.15.3:0/2343351503 shutdown_connections 2023-10-08T16:15:21.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.525+0000 7f3c79856700 1 --2- 172.21.15.3:0/2343351503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c74155830 0x7f3c7415a0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- 172.21.15.3:0/2343351503 >> 172.21.15.3:0/2343351503 conn(0x7f3c7406b4a0 msgr2=0x7f3c7406b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- 172.21.15.3:0/2343351503 shutdown_connections 2023-10-08T16:15:21.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- 172.21.15.3:0/2343351503 wait complete. 2023-10-08T16:15:21.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 Processor -- start 2023-10-08T16:15:21.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- start start 2023-10-08T16:15:21.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c740cbec0 0x7f3c74158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c74155830 0x7f3c7416d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c74156c10 0x7f3c74152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7414b070 con 0x7f3c74155830 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74150260 con 0x7f3c740cbec0 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79856700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74150540 con 0x7f3c74156c10 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c74155830 0x7f3c7416d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c78854700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c740cbec0 0x7f3c74158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c78854700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c740cbec0 0x7f3c74158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:40120/0 (socket says 172.21.15.3:40120) 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c78854700 1 -- 172.21.15.3:0/4095033230 learned_addr learned my addr 172.21.15.3:0/4095033230 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:21.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c74155830 0x7f3c7416d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41122/0 (socket says 172.21.15.3:41122) 2023-10-08T16:15:21.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.529+0000 7f3c79055700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c74156c10 0x7f3c74152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c73fff700 1 -- 172.21.15.3:0/4095033230 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c74156c10 msgr2=0x7f3c74152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c73fff700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f3c74156c10 0x7f3c74152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c73fff700 1 -- 172.21.15.3:0/4095033230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c740cbec0 msgr2=0x7f3c74158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c73fff700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c740cbec0 0x7f3c74158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c73fff700 1 -- 172.21.15.3:0/4095033230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64009420 con 0x7f3c74155830 2023-10-08T16:15:21.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c78854700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c740cbec0 0x7f3c74158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:21.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c73fff700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c74155830 0x7f3c7416d1d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000c00 tx=0x7f3c68007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68007360 con 0x7f3c74155830 2023-10-08T16:15:21.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680074c0 con 0x7f3c74155830 2023-10-08T16:15:21.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c74150820 con 0x7f3c74155830 2023-10-08T16:15:21.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68004830 con 0x7f3c74155830 2023-10-08T16:15:21.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7416ccb0 con 0x7f3c74155830 2023-10-08T16:15:21.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3c68004ba0 con 0x7f3c74155830 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c7404be40 con 0x7f3c74155830 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c70ff9700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c60060550 0x7f3c60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f3c6807c100 con 0x7f3c74155830 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.533+0000 7f3c78854700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c60060550 0x7f3c60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c70ff9700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f3c600663f0 0x7f3c60068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 --> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c60068eb0 con 0x7f3c600663f0 2023-10-08T16:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c6807e740 con 0x7f3c74155830 2023-10-08T16:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c79055700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f3c600663f0 0x7f3c60068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c78854700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c60060550 0x7f3c60062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c640093a0 tx=0x7f3c64017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c79055700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f3c600663f0 0x7f3c60068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.537+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== osd.3 v2:172.21.15.3:6816/33490 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3c60068eb0 con 0x7f3c600663f0 2023-10-08T16:15:21.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.553+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 --> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c740c1af0 con 0x7f3c600663f0 2023-10-08T16:15:21.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.553+0000 7f3c70ff9700 1 -- 172.21.15.3:0/4095033230 <== osd.3 v2:172.21.15.3:6816/33490 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3c740c1af0 con 0x7f3c600663f0 2023-10-08T16:15:21.563 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:21.563 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:21.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f3c600663f0 msgr2=0x7f3c60068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6816/33490,v1:172.21.15.3:6817/33490] conn(0x7f3c600663f0 0x7f3c60068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c60060550 msgr2=0x7f3c60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f3c60060550 0x7f3c60062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c640093a0 tx=0x7f3c64017000 comp rx=0 tx=0).stop 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c74155830 msgr2=0x7f3c7416d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 --2- 172.21.15.3:0/4095033230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c74155830 0x7f3c7416d1d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000c00 tx=0x7f3c68007af0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79055700 1 -- 172.21.15.3:0/4095033230 reap_dead start 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 shutdown_connections 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 >> 172.21.15.3:0/4095033230 conn(0x7f3c7406b4a0 msgr2=0x7f3c74067840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 shutdown_connections 2023-10-08T16:15:21.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.557+0000 7f3c79856700 1 -- 172.21.15.3:0/4095033230 wait complete. 2023-10-08T16:15:21.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T16:15:21.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e914f1700 1 Processor -- start 2023-10-08T16:15:21.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e914f1700 1 -- start start 2023-10-08T16:15:21.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e914f1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e914f1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c06ce20 con 0x7f8e8c1591f0 2023-10-08T16:15:21.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e914f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c0cb090 con 0x7f8e8c067060 2023-10-08T16:15:21.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e914f1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0cb370 con 0x7f8e8c0ca5d0 2023-10-08T16:15:21.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8e8c1591f0 0x7f8e8c0b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40492/0 (socket says 172.21.15.3:40492) 2023-10-08T16:15:21.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8bfff700 1 -- 172.21.15.3:0/3973010949 learned_addr learned my addr 172.21.15.3:0/3973010949 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:21.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8b7fe700 1 --2- 172.21.15.3:0/3973010949 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846813960 0 0) 0x7f8e8c06ce20 con 0x7f8e8c1591f0 2023-10-08T16:15:21.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e74003570 con 0x7f8e8c1591f0 2023-10-08T16:15:21.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558936878 0 0) 0x7f8e8c0cb090 con 0x7f8e8c067060 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c06ce20 con 0x7f8e8c067060 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8b7fe700 1 -- 172.21.15.3:0/3973010949 >> v1:172.21.15.27:6789/0 conn(0x7f8e8c067060 legacy=0x7f8e8c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8b7fe700 1 -- 172.21.15.3:0/3973010949 >> v1:172.21.15.3:6789/0 conn(0x7f8e8c1591f0 legacy=0x7f8e8c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8b7fe700 1 -- 172.21.15.3:0/3973010949 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0cb650 con 0x7f8e8c0ca5d0 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8b7fe700 1 --2- 172.21.15.3:0/3973010949 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0caa40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009910 tx=0x7f8e7c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee311c8ffc063ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c011630 con 0x7f8e8c0ca5d0 2023-10-08T16:15:21.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c011790 con 0x7f8e8c0ca5d0 2023-10-08T16:15:21.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.681+0000 7f8e8affd700 1 -- 172.21.15.3:0/3973010949 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c011b10 con 0x7f8e8c0ca5d0 2023-10-08T16:15:21.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- 172.21.15.3:0/3973010949 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 msgr2=0x7f8e8c0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 --2- 172.21.15.3:0/3973010949 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0caa40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009910 tx=0x7f8e7c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- 172.21.15.3:0/3973010949 shutdown_connections 2023-10-08T16:15:21.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 --2- 172.21.15.3:0/3973010949 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0caa40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- 172.21.15.3:0/3973010949 >> 172.21.15.3:0/3973010949 conn(0x7f8e8c0cfd80 msgr2=0x7f8e8c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- 172.21.15.3:0/3973010949 shutdown_connections 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- 172.21.15.3:0/3973010949 wait complete. 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 Processor -- start 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- start start 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e8c067060 0x7f8e8c0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 0x7f8e8c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0c3160 con 0x7f8e8c1591f0 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c16a270 con 0x7f8e8c067060 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e914f1700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c169980 con 0x7f8e8c0ca5d0 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 0x7f8e8c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 0x7f8e8c0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41134/0 (socket says 172.21.15.3:41134) 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 -- 172.21.15.3:0/340799531 learned_addr learned my addr 172.21.15.3:0/340799531 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:21.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e8bfff700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e8c067060 0x7f8e8c0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e8b7fe700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 -- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 msgr2=0x7f8e8c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 -- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e8c067060 msgr2=0x7f8e8c0c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e8c067060 0x7f8e8c0c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e90cf0700 1 -- 172.21.15.3:0/340799531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009420 con 0x7f8e8c1591f0 2023-10-08T16:15:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.685+0000 7f8e8bfff700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e8c067060 0x7f8e8c0c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e90cf0700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 0x7f8e8c0ce1c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c820 tx=0x7f8e84002680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012630 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84012790 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012b50 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c16dcc0 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c169f00 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c16a400 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e8401b400 con 0x7f8e8c1591f0 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e73fff700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e78060550 0x7f8e78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f8e8407c810 con 0x7f8e8c1591f0 2023-10-08T16:15:21.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.689+0000 7f8e8bfff700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e78060550 0x7f8e78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.693+0000 7f8e8bfff700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e78060550 0x7f8e78062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0d0800 tx=0x7f8e80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.697+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e8404d0d0 con 0x7f8e8c1591f0 2023-10-08T16:15:21.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.857+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e8c04be40 con 0x7f8e78060550 2023-10-08T16:15:21.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.857+0000 7f8e73fff700 1 -- 172.21.15.3:0/340799531 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e8c04be40 con 0x7f8e78060550 2023-10-08T16:15:21.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e78060550 msgr2=0x7f8e78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e78060550 0x7f8e78062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0d0800 tx=0x7f8e80009040 comp rx=0 tx=0).stop 2023-10-08T16:15:21.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 msgr2=0x7f8e8c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 0x7f8e8c0ce1c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c820 tx=0x7f8e84002680 comp rx=0 tx=0).stop 2023-10-08T16:15:21.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 shutdown_connections 2023-10-08T16:15:21.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e78060550 0x7f8e78062a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e8c1591f0 0x7f8e8c0ce1c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8e8c0ca5d0 0x7f8e8c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 --2- 172.21.15.3:0/340799531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e8c067060 0x7f8e8c0c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 >> 172.21.15.3:0/340799531 conn(0x7f8e8c0cfd80 msgr2=0x7f8e8c0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 shutdown_connections 2023-10-08T16:15:21.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.861+0000 7f8e914f1700 1 -- 172.21.15.3:0/340799531 wait complete. 2023-10-08T16:15:21.871 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T16:15:21.882 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T16:15:21.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 Processor -- start 2023-10-08T16:15:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 -- start start 2023-10-08T16:15:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f98b415a0d0 0x7f98b41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f98b40c8190 0x7f98b4159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b406cdf0 con 0x7f98b40c9c70 2023-10-08T16:15:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40afae0 con 0x7f98b415a0d0 2023-10-08T16:15:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98b8859700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40afcd0 con 0x7f98b40c8190 2023-10-08T16:15:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.981+0000 7f98aa59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f98b415a0d0 0x7f98b41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f98b415a0d0 0x7f98b41593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41146/0 (socket says 172.21.15.3:41146) 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 -- 172.21.15.3:0/2378251247 learned_addr learned my addr 172.21.15.3:0/2378251247 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b359e700 1 --2- 172.21.15.3:0/2378251247 >> v2:172.21.15.27:3300/0 conn(0x7f98b40c8190 0x7f98b4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 -- 172.21.15.3:0/2378251247 >> v2:172.21.15.27:3300/0 conn(0x7f98b40c8190 msgr2=0x7f98b4159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 --2- 172.21.15.3:0/2378251247 >> v2:172.21.15.27:3300/0 conn(0x7f98b40c8190 0x7f98b4159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 -- 172.21.15.3:0/2378251247 >> v1:172.21.15.27:6789/0 conn(0x7f98b40c9c70 legacy=0x7f98b40af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 -- 172.21.15.3:0/2378251247 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40affb0 con 0x7f98b415a0d0 2023-10-08T16:15:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b359e700 1 --2- 172.21.15.3:0/2378251247 >> v2:172.21.15.27:3300/0 conn(0x7f98b40c8190 0x7f98b4159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:21.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98aa59c700 1 --2- 172.21.15.3:0/2378251247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41593d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f98b40cbe10 tx=0x7f989c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac41aeb76779ddd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:21.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b259c700 1 -- 172.21.15.3:0/2378251247 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00b860 con 0x7f98b415a0d0 2023-10-08T16:15:21.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b259c700 1 -- 172.21.15.3:0/2378251247 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c00b9c0 con 0x7f98b415a0d0 2023-10-08T16:15:21.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b259c700 1 -- 172.21.15.3:0/2378251247 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00bd60 con 0x7f98b415a0d0 2023-10-08T16:15:21.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 -- 172.21.15.3:0/2378251247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 msgr2=0x7f98b41593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:21.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 --2- 172.21.15.3:0/2378251247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41593d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f98b40cbe10 tx=0x7f989c009250 comp rx=0 tx=0).stop 2023-10-08T16:15:21.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 -- 172.21.15.3:0/2378251247 shutdown_connections 2023-10-08T16:15:21.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 --2- 172.21.15.3:0/2378251247 >> v2:172.21.15.27:3300/0 conn(0x7f98b40c8190 0x7f98b4159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 --2- 172.21.15.3:0/2378251247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41593d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:21.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 -- 172.21.15.3:0/2378251247 >> 172.21.15.3:0/2378251247 conn(0x7f98b40cdb50 msgr2=0x7f98b40cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:21.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 -- 172.21.15.3:0/2378251247 shutdown_connections 2023-10-08T16:15:21.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.985+0000 7f98b8859700 1 -- 172.21.15.3:0/2378251247 wait complete. 2023-10-08T16:15:21.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 Processor -- start 2023-10-08T16:15:21.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- start start 2023-10-08T16:15:21.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f98b40c8190 0x7f98b40c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98b40c9c70 0x7f98b40b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:21.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40c6dc0 con 0x7f98b415a0d0 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40c7250 con 0x7f98b40c9c70 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40c61b0 con 0x7f98b40c8190 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41152/0 (socket says 172.21.15.3:41152) 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 -- 172.21.15.3:0/941705958 learned_addr learned my addr 172.21.15.3:0/941705958 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98aa59c700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98b40c9c70 0x7f98b40b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b2d9d700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f98b40c8190 0x7f98b40c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 -- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f98b40c8190 msgr2=0x7f98b40c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f98b40c8190 0x7f98b40c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 -- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98b40c9c70 msgr2=0x7f98b40b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98b40c9c70 0x7f98b40b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 -- 172.21.15.3:0/941705958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0094f0 con 0x7f98b415a0d0 2023-10-08T16:15:22.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b2d9d700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f98b40c8190 0x7f98b40c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b359e700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41577f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009fc0 tx=0x7f98ac0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00dc90 con 0x7f98b415a0d0 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00f040 con 0x7f98b415a0d0 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac015690 con 0x7f98b415a0d0 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b40c6490 con 0x7f98b415a0d0 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b40c6a50 con 0x7f98b415a0d0 2023-10-08T16:15:22.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.989+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98b404be40 con 0x7f98b415a0d0 2023-10-08T16:15:22.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f98ac01e3b0 con 0x7f98b415a0d0 2023-10-08T16:15:22.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98ab7fe700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9894060550 0x7f9894062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f98ac07c990 con 0x7f98b415a0d0 2023-10-08T16:15:22.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98b2d9d700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9894060550 0x7f9894062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98ab7fe700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f98940663f0 0x7f9894068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 --> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9894068eb0 con 0x7f98940663f0 2023-10-08T16:15:22.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98ac081240 con 0x7f98b415a0d0 2023-10-08T16:15:22.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98aa59c700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f98940663f0 0x7f9894068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98b2d9d700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9894060550 0x7f9894062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f98a4007fd0 tx=0x7f98a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.993+0000 7f98aa59c700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f98940663f0 0x7f9894068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:21.997+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== osd.4 v2:172.21.15.27:6800/33605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9894068eb0 con 0x7f98940663f0 2023-10-08T16:15:22.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 --> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98b404b600 con 0x7f98940663f0 2023-10-08T16:15:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98ab7fe700 1 -- 172.21.15.3:0/941705958 <== osd.4 v2:172.21.15.27:6800/33605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f98b404b600 con 0x7f98940663f0 2023-10-08T16:15:22.022 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:22.022 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:22.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f98940663f0 msgr2=0x7f9894068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.27:6800/33605,v1:172.21.15.27:6801/33605] conn(0x7f98940663f0 0x7f9894068800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9894060550 msgr2=0x7f9894062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9894060550 0x7f9894062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f98a4007fd0 tx=0x7f98a4009040 comp rx=0 tx=0).stop 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 msgr2=0x7f98b41577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 --2- 172.21.15.3:0/941705958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98b415a0d0 0x7f98b41577f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009fc0 tx=0x7f98ac0099b0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b359e700 1 -- 172.21.15.3:0/941705958 reap_dead start 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 shutdown_connections 2023-10-08T16:15:22.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 >> 172.21.15.3:0/941705958 conn(0x7f98b40cdb50 msgr2=0x7f98b40c2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 shutdown_connections 2023-10-08T16:15:22.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.013+0000 7f98b8859700 1 -- 172.21.15.3:0/941705958 wait complete. 2023-10-08T16:15:22.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T16:15:22.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 Processor -- start 2023-10-08T16:15:22.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 -- start start 2023-10-08T16:15:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f662806aeb0 0x7f66280ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f662806d900 0x7f662815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662806c3a0 con 0x7f66280ca070 2023-10-08T16:15:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662806c8a0 con 0x7f662806aeb0 2023-10-08T16:15:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662f041700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662806cb40 con 0x7f662806d900 2023-10-08T16:15:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662e840700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f662806d900 0x7f662815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662d83e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f662806aeb0 0x7f66280ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662d83e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f662806aeb0 0x7f66280ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.3:40162/0 (socket says 172.21.15.3:40162) 2023-10-08T16:15:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662d83e700 1 -- 172.21.15.3:0/3066734642 learned_addr learned my addr 172.21.15.3:0/3066734642 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.133+0000 7f662e840700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f662806d900 0x7f662815ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:36064/0 (socket says 172.21.15.3:36064) 2023-10-08T16:15:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d83e700 1 -- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f662806d900 msgr2=0x7f662815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d83e700 1 --2- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f662806d900 0x7f662815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d83e700 1 -- 172.21.15.3:0/3066734642 >> v1:172.21.15.27:6789/0 conn(0x7f66280ca070 legacy=0x7f662806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d83e700 1 -- 172.21.15.3:0/3066734642 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662806ce20 con 0x7f662806aeb0 2023-10-08T16:15:22.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d83e700 1 --2- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662806aeb0 0x7f66280ca440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6624009f50 tx=0x7f6624009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54491d65472ecce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d03d700 1 -- 172.21.15.3:0/3066734642 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400e070 con 0x7f662806aeb0 2023-10-08T16:15:22.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d03d700 1 -- 172.21.15.3:0/3066734642 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662400b9c0 con 0x7f662806aeb0 2023-10-08T16:15:22.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662d03d700 1 -- 172.21.15.3:0/3066734642 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240092e0 con 0x7f662806aeb0 2023-10-08T16:15:22.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 -- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662806aeb0 msgr2=0x7f66280ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 --2- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662806aeb0 0x7f66280ca440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6624009f50 tx=0x7f6624009840 comp rx=0 tx=0).stop 2023-10-08T16:15:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 -- 172.21.15.3:0/3066734642 shutdown_connections 2023-10-08T16:15:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 --2- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f662806d900 0x7f662815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 --2- 172.21.15.3:0/3066734642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662806aeb0 0x7f66280ca440 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 -- 172.21.15.3:0/3066734642 >> 172.21.15.3:0/3066734642 conn(0x7f66280c83d0 msgr2=0x7f66280c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 -- 172.21.15.3:0/3066734642 shutdown_connections 2023-10-08T16:15:22.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.137+0000 7f662f041700 1 -- 172.21.15.3:0/3066734642 wait complete. 2023-10-08T16:15:22.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 Processor -- start 2023-10-08T16:15:22.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 -- start start 2023-10-08T16:15:22.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 0x7f662814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f66280ca070 0x7f662815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628154ab0 0x7f662815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66281535d0 con 0x7f662806d900 2023-10-08T16:15:22.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628154620 con 0x7f6628154ab0 2023-10-08T16:15:22.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662f041700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6628153cf0 con 0x7f66280ca070 2023-10-08T16:15:22.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662e03f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 0x7f662814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662e03f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 0x7f662814ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41164/0 (socket says 172.21.15.3:41164) 2023-10-08T16:15:22.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662e03f700 1 -- 172.21.15.3:0/221253579 learned_addr learned my addr 172.21.15.3:0/221253579 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662d83e700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f66280ca070 0x7f662815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.141+0000 7f662e840700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628154ab0 0x7f662815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e03f700 1 -- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f66280ca070 msgr2=0x7f662815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e03f700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f66280ca070 0x7f662815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e03f700 1 -- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628154ab0 msgr2=0x7f662815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e03f700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628154ab0 0x7f662815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e03f700 1 -- 172.21.15.3:0/221253579 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009ae0 con 0x7f662806d900 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e840700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628154ab0 0x7f662815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662e03f700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 0x7f662814ed10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f661800c590 tx=0x7f6618007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618011590 con 0x7f662806d900 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618011730 con 0x7f662806d900 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628153fd0 con 0x7f662806d900 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618011af0 con 0x7f662806d900 2023-10-08T16:15:22.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6628155e50 con 0x7f662806d900 2023-10-08T16:15:22.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662804be40 con 0x7f662806d900 2023-10-08T16:15:22.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.145+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6618012420 con 0x7f662806d900 2023-10-08T16:15:22.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.149+0000 7f661e7fc700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6614060550 0x7f6614062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.149+0000 7f662d83e700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6614060550 0x7f6614062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.149+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f661807b870 con 0x7f662806d900 2023-10-08T16:15:22.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.149+0000 7f662d83e700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6614060550 0x7f6614062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66280c9310 tx=0x7f6624018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.157+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6618049be0 con 0x7f662806d900 2023-10-08T16:15:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f662806d100 con 0x7f6614060550 2023-10-08T16:15:22.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f661e7fc700 1 -- 172.21.15.3:0/221253579 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f662806d100 con 0x7f6614060550 2023-10-08T16:15:22.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6614060550 msgr2=0x7f6614062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6614060550 0x7f6614062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66280c9310 tx=0x7f6624018000 comp rx=0 tx=0).stop 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 msgr2=0x7f662814ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 0x7f662814ed10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f661800c590 tx=0x7f6618007f30 comp rx=0 tx=0).stop 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 shutdown_connections 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6614060550 0x7f6614062a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628154ab0 0x7f662815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f66280ca070 0x7f662815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 --2- 172.21.15.3:0/221253579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f662806d900 0x7f662814ed10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 >> 172.21.15.3:0/221253579 conn(0x7f66280c83d0 msgr2=0x7f6628160390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 shutdown_connections 2023-10-08T16:15:22.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.317+0000 7f662f041700 1 -- 172.21.15.3:0/221253579 wait complete. 2023-10-08T16:15:22.328 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T16:15:22.339 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T16:15:22.339 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:22.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8eaa3ac700 1 Processor -- start 2023-10-08T16:15:22.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8eaa3ac700 1 -- start start 2023-10-08T16:15:22.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8eaa3ac700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8ea406c9a0 0x7f8ea4067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8eaa3ac700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea406dab0 con 0x7f8ea40b2450 2023-10-08T16:15:22.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8eaa3ac700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea406cea0 con 0x7f8ea40b2080 2023-10-08T16:15:22.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8eaa3ac700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea406b400 con 0x7f8ea406c9a0 2023-10-08T16:15:22.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea8ba9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8ea406c9a0 0x7f8ea4067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea9bab700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8ea40b2450 0x7f8ea40ca850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40506/0 (socket says 172.21.15.3:40506) 2023-10-08T16:15:22.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea9bab700 1 -- 172.21.15.3:0/3894103675 learned_addr learned my addr 172.21.15.3:0/3894103675 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:22.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea93aa700 1 --1- 172.21.15.3:0/3894103675 >> v1:172.21.15.27:6789/0 conn(0x7f8ea40b2080 0x7f8ea406acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.3:41190/0 (socket says 172.21.15.3:41190) 2023-10-08T16:15:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820488610 0 0) 0x7f8ea406dab0 con 0x7f8ea40b2450 2023-10-08T16:15:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c003570 con 0x7f8ea40b2450 2023-10-08T16:15:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083513699 0 0) 0x7f8ea406cea0 con 0x7f8ea40b2080 2023-10-08T16:15:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.449+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea406dab0 con 0x7f8ea40b2080 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/3894103675 >> v1:172.21.15.27:6789/0 conn(0x7f8ea40b2080 legacy=0x7f8ea406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/3894103675 >> v1:172.21.15.3:6789/0 conn(0x7f8ea40b2450 legacy=0x7f8ea40ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/3894103675 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea406d180 con 0x7f8ea406c9a0 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea8ba9700 1 --2- 172.21.15.3:0/3894103675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea406c9a0 0x7f8ea4067060 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8e980098e0 tx=0x7f8e980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1b7f20500438b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011630 con 0x7f8ea406c9a0 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98011790 con 0x7f8ea406c9a0 2023-10-08T16:15:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8ea3fff700 1 -- 172.21.15.3:0/3894103675 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011b30 con 0x7f8ea406c9a0 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/3894103675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea406c9a0 msgr2=0x7f8ea4067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 --2- 172.21.15.3:0/3894103675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea406c9a0 0x7f8ea4067060 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8e980098e0 tx=0x7f8e980091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/3894103675 shutdown_connections 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 --2- 172.21.15.3:0/3894103675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea406c9a0 0x7f8ea4067060 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/3894103675 >> 172.21.15.3:0/3894103675 conn(0x7f8ea40cfd50 msgr2=0x7f8ea40d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/3894103675 shutdown_connections 2023-10-08T16:15:22.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/3894103675 wait complete. 2023-10-08T16:15:22.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 Processor -- start 2023-10-08T16:15:22.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.453+0000 7f8eaa3ac700 1 -- start start 2023-10-08T16:15:22.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ea406c9a0 0x7f8ea40c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea40b2080 0x7f8ea41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea40b2450 0x7f8ea415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea415ac70 con 0x7f8ea40b2080 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40b2b10 con 0x7f8ea40b2450 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c80e0 con 0x7f8ea406c9a0 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea40b2080 0x7f8ea41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea40b2080 0x7f8ea41478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41192/0 (socket says 172.21.15.3:41192) 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/570985937 learned_addr learned my addr 172.21.15.3:0/570985937 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea93aa700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ea406c9a0 0x7f8ea40c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea9bab700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea40b2450 0x7f8ea415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ea406c9a0 msgr2=0x7f8ea40c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f8ea406c9a0 0x7f8ea40c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea40b2450 msgr2=0x7f8ea415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea40b2450 0x7f8ea415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 -- 172.21.15.3:0/570985937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98009420 con 0x7f8ea40b2080 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea8ba9700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea40b2080 0x7f8ea41478d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40c6d30 tx=0x7f8e98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9801f070 con 0x7f8ea40b2080 2023-10-08T16:15:22.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98000bc0 con 0x7f8ea40b2080 2023-10-08T16:15:22.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40c77f0 con 0x7f8ea40b2080 2023-10-08T16:15:22.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98025420 con 0x7f8ea40b2080 2023-10-08T16:15:22.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea40c7a90 con 0x7f8ea40b2080 2023-10-08T16:15:22.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.457+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ea404be40 con 0x7f8ea40b2080 2023-10-08T16:15:22.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e98023070 con 0x7f8ea40b2080 2023-10-08T16:15:22.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea17fa700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e90060550 0x7f8e90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f8e9807d750 con 0x7f8ea40b2080 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea93aa700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e90060550 0x7f8e90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea17fa700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7f8e900663f0 0x7f8e90068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 --> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e90068eb0 con 0x7f8e900663f0 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e9807fd30 con 0x7f8ea40b2080 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea9bab700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7f8e900663f0 0x7f8e90068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea93aa700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e90060550 0x7f8e90062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c004f70 tx=0x7f8e9c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.461+0000 7f8ea9bab700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7f8e900663f0 0x7f8e90068800 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.465+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== osd.5 v2:172.21.15.27:6816/33604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8e90068eb0 con 0x7f8e900663f0 2023-10-08T16:15:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.477+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 --> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ea406b970 con 0x7f8e900663f0 2023-10-08T16:15:22.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8ea17fa700 1 -- 172.21.15.3:0/570985937 <== osd.5 v2:172.21.15.27:6816/33604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8ea406b970 con 0x7f8e900663f0 2023-10-08T16:15:22.487 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:22.488 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7f8e900663f0 msgr2=0x7f8e90068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.27:6816/33604,v1:172.21.15.27:6817/33604] conn(0x7f8e900663f0 0x7f8e90068800 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e90060550 msgr2=0x7f8e90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f8e90060550 0x7f8e90062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c004f70 tx=0x7f8e9c007d40 comp rx=0 tx=0).stop 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea40b2080 msgr2=0x7f8ea41478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 --2- 172.21.15.3:0/570985937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ea40b2080 0x7f8ea41478d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40c6d30 tx=0x7f8e98017000 comp rx=0 tx=0).stop 2023-10-08T16:15:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8ea9bab700 1 -- 172.21.15.3:0/570985937 reap_dead start 2023-10-08T16:15:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 shutdown_connections 2023-10-08T16:15:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 >> 172.21.15.3:0/570985937 conn(0x7f8ea40cfd50 msgr2=0x7f8ea40cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 shutdown_connections 2023-10-08T16:15:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.481+0000 7f8eaa3ac700 1 -- 172.21.15.3:0/570985937 wait complete. 2023-10-08T16:15:22.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T16:15:22.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 Processor -- start 2023-10-08T16:15:22.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 -- start start 2023-10-08T16:15:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155ae0 0x7fa51c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa51c15a550 0x7fa51c0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c159820 con 0x7fa51c155eb0 2023-10-08T16:15:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c15a0c0 con 0x7fa51c15a550 2023-10-08T16:15:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa521839700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0c7f90 con 0x7fa51c155ae0 2023-10-08T16:15:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa51bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa51c15a550 0x7fa51c0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa51bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa51c15a550 0x7fa51c0c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41208/0 (socket says 172.21.15.3:41208) 2023-10-08T16:15:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa51bfff700 1 -- 172.21.15.3:0/4108995805 learned_addr learned my addr 172.21.15.3:0/4108995805 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.605+0000 7fa520837700 1 --2- 172.21.15.3:0/4108995805 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155ae0 0x7fa51c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51bfff700 1 -- 172.21.15.3:0/4108995805 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155ae0 msgr2=0x7fa51c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51bfff700 1 --2- 172.21.15.3:0/4108995805 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155ae0 0x7fa51c0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51bfff700 1 -- 172.21.15.3:0/4108995805 >> v1:172.21.15.27:6789/0 conn(0x7fa51c155eb0 legacy=0x7fa51c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51b7fe700 1 -- 172.21.15.3:0/4108995805 <== mon.1 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194908686 0 0) 0x7fa51c159820 con 0x7fa51c155eb0 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51bfff700 1 -- 172.21.15.3:0/4108995805 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c159a70 con 0x7fa51c15a550 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51bfff700 1 --2- 172.21.15.3:0/4108995805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c15a550 0x7fa51c0c7910 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa5040099b0 tx=0x7fa504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf2178b200a51e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51b7fe700 1 -- 172.21.15.3:0/4108995805 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504009ea0 con 0x7fa51c15a550 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51b7fe700 1 -- 172.21.15.3:0/4108995805 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400b860 con 0x7fa51c15a550 2023-10-08T16:15:22.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa51b7fe700 1 -- 172.21.15.3:0/4108995805 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bc00 con 0x7fa51c15a550 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 -- 172.21.15.3:0/4108995805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c15a550 msgr2=0x7fa51c0c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 --2- 172.21.15.3:0/4108995805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c15a550 0x7fa51c0c7910 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa5040099b0 tx=0x7fa504009250 comp rx=0 tx=0).stop 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 -- 172.21.15.3:0/4108995805 shutdown_connections 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 --2- 172.21.15.3:0/4108995805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c15a550 0x7fa51c0c7910 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 --2- 172.21.15.3:0/4108995805 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155ae0 0x7fa51c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 -- 172.21.15.3:0/4108995805 >> 172.21.15.3:0/4108995805 conn(0x7fa51c0c8330 msgr2=0x7fa51c0c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 -- 172.21.15.3:0/4108995805 shutdown_connections 2023-10-08T16:15:22.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 -- 172.21.15.3:0/4108995805 wait complete. 2023-10-08T16:15:22.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 Processor -- start 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.609+0000 7fa521839700 1 -- start start 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 0x7fa51c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155eb0 0x7fa51c1471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c15a550 0x7fa51c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b1630 con 0x7fa51c155ae0 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b0c60 con 0x7fa51c15a550 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c147700 con 0x7fa51c155eb0 2023-10-08T16:15:22.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 0x7fa51c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 0x7fa51c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41218/0 (socket says 172.21.15.3:41218) 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 -- 172.21.15.3:0/3867586030 learned_addr learned my addr 172.21.15.3:0/3867586030 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521038700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c15a550 0x7fa51c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa51bfff700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155eb0 0x7fa51c1471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 -- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155eb0 msgr2=0x7fa51c1471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155eb0 0x7fa51c1471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 -- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c15a550 msgr2=0x7fa51c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c15a550 0x7fa51c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 -- 172.21.15.3:0/3867586030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040094f0 con 0x7fa51c155ae0 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa520837700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 0x7fa51c0b10f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa514009ea0 tx=0x7fa51400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400ca40 con 0x7fa51c155ae0 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51400f040 con 0x7fa51c155ae0 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0b0050 con 0x7fa51c155ae0 2023-10-08T16:15:22.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400cdd0 con 0x7fa51c155ae0 2023-10-08T16:15:22.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.613+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c0b0610 con 0x7fa51c155ae0 2023-10-08T16:15:22.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.617+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c04be40 con 0x7fa51c155ae0 2023-10-08T16:15:22.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.617+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa514014690 con 0x7fa51c155ae0 2023-10-08T16:15:22.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.617+0000 7fa518ff9700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa500060550 0x7fa500062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.617+0000 7fa51bfff700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa500060550 0x7fa500062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.617+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fa51407d140 con 0x7fa51c155ae0 2023-10-08T16:15:22.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.617+0000 7fa51bfff700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa500060550 0x7fa500062a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5040099b0 tx=0x7fa504017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.629+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa51404da00 con 0x7fa51c155ae0 2023-10-08T16:15:22.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.789+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa51c0b0da0 con 0x7fa500060550 2023-10-08T16:15:22.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.789+0000 7fa518ff9700 1 -- 172.21.15.3:0/3867586030 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa50400b9d0 con 0x7fa500060550 2023-10-08T16:15:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa500060550 msgr2=0x7fa500062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa500060550 0x7fa500062a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5040099b0 tx=0x7fa504017000 comp rx=0 tx=0).stop 2023-10-08T16:15:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 msgr2=0x7fa51c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 0x7fa51c0b10f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa514009ea0 tx=0x7fa51400b040 comp rx=0 tx=0).stop 2023-10-08T16:15:22.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 shutdown_connections 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fa500060550 0x7fa500062a00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c15a550 0x7fa51c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fa51c155eb0 0x7fa51c1471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 --2- 172.21.15.3:0/3867586030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51c155ae0 0x7fa51c0b10f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 >> 172.21.15.3:0/3867586030 conn(0x7fa51c0c8330 msgr2=0x7fa51c1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 shutdown_connections 2023-10-08T16:15:22.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.793+0000 7fa521839700 1 -- 172.21.15.3:0/3867586030 wait complete. 2023-10-08T16:15:22.803 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T16:15:22.817 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T16:15:22.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.929+0000 7fd63c3dc700 1 Processor -- start 2023-10-08T16:15:22.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.929+0000 7fd63c3dc700 1 -- start start 2023-10-08T16:15:22.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd63406da60 0x7fd63406ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd6340cc8a0 0x7fd6340ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6340b2d20 con 0x7fd63406a730 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63406bc30 con 0x7fd6340cc8a0 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340b3000 con 0x7fd63406da60 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a178700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd63406a730 0x7fd63406d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40512/0 (socket says 172.21.15.3:40512) 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a178700 1 -- 172.21.15.3:0/409998508 learned_addr learned my addr 172.21.15.3:0/409998508 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd639977700 1 --2- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd63406da60 0x7fd63406ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a979700 1 --2- 172.21.15.3:0/409998508 >> v2:172.21.15.27:3300/0 conn(0x7fd6340cc8a0 0x7fd6340ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd639176700 1 -- 172.21.15.3:0/409998508 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330181961 0 0) 0x7fd6340b2d20 con 0x7fd63406a730 2023-10-08T16:15:22.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd639176700 1 -- 172.21.15.3:0/409998508 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd620003570 con 0x7fd63406a730 2023-10-08T16:15:22.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a979700 1 -- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd63406da60 msgr2=0x7fd63406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:22.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a979700 1 --2- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd63406da60 0x7fd63406ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a979700 1 -- 172.21.15.3:0/409998508 >> v1:172.21.15.3:6789/0 conn(0x7fd63406a730 legacy=0x7fd63406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a979700 1 -- 172.21.15.3:0/409998508 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340b32e0 con 0x7fd6340cc8a0 2023-10-08T16:15:22.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63a979700 1 --2- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6340cc8a0 0x7fd6340ccd20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009e60 tx=0x7fd62c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5149936325b19d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd639176700 1 -- 172.21.15.3:0/409998508 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00e070 con 0x7fd6340cc8a0 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd639176700 1 -- 172.21.15.3:0/409998508 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00bab0 con 0x7fd6340cc8a0 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd639176700 1 -- 172.21.15.3:0/409998508 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00be70 con 0x7fd6340cc8a0 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6340cc8a0 msgr2=0x7fd6340ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 --2- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6340cc8a0 0x7fd6340ccd20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009e60 tx=0x7fd62c009780 comp rx=0 tx=0).stop 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- 172.21.15.3:0/409998508 shutdown_connections 2023-10-08T16:15:22.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 --2- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6340cc8a0 0x7fd6340ccd20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 --2- 172.21.15.3:0/409998508 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd63406da60 0x7fd63406ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- 172.21.15.3:0/409998508 >> 172.21.15.3:0/409998508 conn(0x7fd6340d0970 msgr2=0x7fd6340b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- 172.21.15.3:0/409998508 shutdown_connections 2023-10-08T16:15:22.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.933+0000 7fd63c3dc700 1 -- 172.21.15.3:0/409998508 wait complete. 2023-10-08T16:15:22.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 Processor -- start 2023-10-08T16:15:22.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 -- start start 2023-10-08T16:15:22.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd63406a730 0x7fd6341697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd63406da60 0x7fd634151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd6340cc8a0 0x7fd6340c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634169d20 con 0x7fd63406da60 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341520f0 con 0x7fd63406a730 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63c3dc700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340c72f0 con 0x7fd6340cc8a0 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd639977700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd63406da60 0x7fd634151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd639977700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd63406da60 0x7fd634151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41220/0 (socket says 172.21.15.3:41220) 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd639977700 1 -- 172.21.15.3:0/4110184322 learned_addr learned my addr 172.21.15.3:0/4110184322 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:22.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63a979700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd6340cc8a0 0x7fd6340c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.937+0000 7fd63a178700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd63406a730 0x7fd6341697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd639977700 1 -- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd6340cc8a0 msgr2=0x7fd6340c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd639977700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fd6340cc8a0 0x7fd6340c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd639977700 1 -- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd63406a730 msgr2=0x7fd6341697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd639977700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd63406a730 0x7fd6341697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd639977700 1 -- 172.21.15.3:0/4110184322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c009a20 con 0x7fd63406da60 2023-10-08T16:15:22.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd63a178700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd63406a730 0x7fd6341697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:22.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd639977700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd63406da60 0x7fd634151bb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd62400ec80 tx=0x7fd6240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400c850 con 0x7fd63406da60 2023-10-08T16:15:22.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400c9b0 con 0x7fd63406da60 2023-10-08T16:15:22.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6340c75d0 con 0x7fd63406da60 2023-10-08T16:15:22.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400cd50 con 0x7fd63406da60 2023-10-08T16:15:22.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6340c7b90 con 0x7fd63406da60 2023-10-08T16:15:22.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.941+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd634071180 con 0x7fd63406da60 2023-10-08T16:15:22.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd624013680 con 0x7fd63406da60 2023-10-08T16:15:22.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd62a7fc700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd618060550 0x7fd618062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fd62407ca90 con 0x7fd63406da60 2023-10-08T16:15:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd63a178700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd618060550 0x7fd618062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd62a7fc700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fd618066280 0x7fd618068690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 --> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd618068d40 con 0x7fd618066280 2023-10-08T16:15:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd624081240 con 0x7fd63406da60 2023-10-08T16:15:22.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd63a979700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fd618066280 0x7fd618068690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:22.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd63a178700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd618060550 0x7fd618062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6300058d0 tx=0x7fd630009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.945+0000 7fd63a979700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fd618066280 0x7fd618068690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:22.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.949+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== osd.6 v2:172.21.15.27:6808/33606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd618068d40 con 0x7fd618066280 2023-10-08T16:15:22.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 --> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6340c7f30 con 0x7fd618066280 2023-10-08T16:15:22.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd62a7fc700 1 -- 172.21.15.3:0/4110184322 <== osd.6 v2:172.21.15.27:6808/33606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd6340c7f30 con 0x7fd618066280 2023-10-08T16:15:22.973 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:22.974 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:22.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fd618066280 msgr2=0x7fd618068690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.27:6808/33606,v1:172.21.15.27:6809/33606] conn(0x7fd618066280 0x7fd618068690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd618060550 msgr2=0x7fd618062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fd618060550 0x7fd618062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6300058d0 tx=0x7fd630009040 comp rx=0 tx=0).stop 2023-10-08T16:15:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd63406da60 msgr2=0x7fd634151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 --2- 172.21.15.3:0/4110184322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd63406da60 0x7fd634151bb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd62400ec80 tx=0x7fd6240091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63a979700 1 -- 172.21.15.3:0/4110184322 reap_dead start 2023-10-08T16:15:22.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 shutdown_connections 2023-10-08T16:15:22.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 >> 172.21.15.3:0/4110184322 conn(0x7fd6340d0970 msgr2=0x7fd634158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:22.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 shutdown_connections 2023-10-08T16:15:22.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:22.965+0000 7fd63c3dc700 1 -- 172.21.15.3:0/4110184322 wait complete. 2023-10-08T16:15:22.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T16:15:23.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.089+0000 7f19e6b84700 1 Processor -- start 2023-10-08T16:15:23.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.089+0000 7f19e6b84700 1 -- start start 2023-10-08T16:15:23.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e6b84700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f19e015a450 0x7f19e0068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e6b84700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e015d5f0 con 0x7f19e01562c0 2023-10-08T16:15:23.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e6b84700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e015d8d0 con 0x7f19e00684b0 2023-10-08T16:15:23.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e6b84700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e015dbb0 con 0x7f19e015a450 2023-10-08T16:15:23.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e5121700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f19e01562c0 0x7f19e0156760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40524/0 (socket says 172.21.15.3:40524) 2023-10-08T16:15:23.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e5121700 1 -- 172.21.15.3:0/3473130845 learned_addr learned my addr 172.21.15.3:0/3473130845 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:23.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19dffff700 1 --2- 172.21.15.3:0/3473130845 >> v2:172.21.15.27:3300/0 conn(0x7f19e015a450 0x7f19e0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19df7fe700 1 -- 172.21.15.3:0/3473130845 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787744845 0 0) 0x7f19e015d5f0 con 0x7f19e01562c0 2023-10-08T16:15:23.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19df7fe700 1 -- 172.21.15.3:0/3473130845 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0003570 con 0x7f19e01562c0 2023-10-08T16:15:23.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19df7fe700 1 -- 172.21.15.3:0/3473130845 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 93053595 0 0) 0x7f19d0003570 con 0x7f19e01562c0 2023-10-08T16:15:23.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19dffff700 1 -- 172.21.15.3:0/3473130845 >> v1:172.21.15.27:6789/0 conn(0x7f19e00684b0 legacy=0x7f19e015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19dffff700 1 -- 172.21.15.3:0/3473130845 >> v1:172.21.15.3:6789/0 conn(0x7f19e01562c0 legacy=0x7f19e0156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19dffff700 1 -- 172.21.15.3:0/3473130845 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e006d0a0 con 0x7f19e015a450 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19dffff700 1 --2- 172.21.15.3:0/3473130845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e0068880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098e0 tx=0x7f19cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c429cc8917c2944e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19df7fe700 1 -- 172.21.15.3:0/3473130845 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80017f0 con 0x7f19e015a450 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19df7fe700 1 -- 172.21.15.3:0/3473130845 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc011420 con 0x7f19e015a450 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19df7fe700 1 -- 172.21.15.3:0/3473130845 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0117c0 con 0x7f19e015a450 2023-10-08T16:15:23.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e6b84700 1 -- 172.21.15.3:0/3473130845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 msgr2=0x7f19e0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.093+0000 7f19e6b84700 1 --2- 172.21.15.3:0/3473130845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e0068880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098e0 tx=0x7f19cc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- 172.21.15.3:0/3473130845 shutdown_connections 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 --2- 172.21.15.3:0/3473130845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e0068880 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- 172.21.15.3:0/3473130845 >> 172.21.15.3:0/3473130845 conn(0x7f19e00c8da0 msgr2=0x7f19e00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- 172.21.15.3:0/3473130845 shutdown_connections 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- 172.21.15.3:0/3473130845 wait complete. 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 Processor -- start 2023-10-08T16:15:23.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- start start 2023-10-08T16:15:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f19e00684b0 0x7f19e00c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 0x7f19e00c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0169d10 con 0x7f19e01562c0 2023-10-08T16:15:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0169ff0 con 0x7f19e015a450 2023-10-08T16:15:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e6b84700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e016a2d0 con 0x7f19e00684b0 2023-10-08T16:15:23.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 0x7f19e00c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 0x7f19e00c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41236/0 (socket says 172.21.15.3:41236) 2023-10-08T16:15:23.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 -- 172.21.15.3:0/4069303364 learned_addr learned my addr 172.21.15.3:0/4069303364 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e5121700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19e4920700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f19e00684b0 0x7f19e00c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 -- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f19e00684b0 msgr2=0x7f19e00c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f19e00684b0 0x7f19e00c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 -- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 msgr2=0x7f19e006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e006d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.097+0000 7f19dffff700 1 -- 172.21.15.3:0/4069303364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc009420 con 0x7f19e01562c0 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dffff700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 0x7f19e00c2a30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0091e0 tx=0x7f19cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc01cb30 con 0x7f19e01562c0 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc01cc90 con 0x7f19e01562c0 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e016a5b0 con 0x7f19e01562c0 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc01a6a0 con 0x7f19e01562c0 2023-10-08T16:15:23.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e0169a60 con 0x7f19e01562c0 2023-10-08T16:15:23.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e00c1630 con 0x7f19e01562c0 2023-10-08T16:15:23.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f19cc01aa90 con 0x7f19e01562c0 2023-10-08T16:15:23.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dcff9700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f19c4060550 0x7f19c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f19cc07ddf0 con 0x7f19e01562c0 2023-10-08T16:15:23.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.101+0000 7f19e4920700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f19c4060550 0x7f19c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.105+0000 7f19e4920700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f19c4060550 0x7f19c4062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f19e015cd30 tx=0x7f19d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.109+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19e00c1630 con 0x7f19e01562c0 2023-10-08T16:15:23.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.273+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e00c1630 con 0x7f19c4060550 2023-10-08T16:15:23.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19dcff9700 1 -- 172.21.15.3:0/4069303364 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19e00c1630 con 0x7f19c4060550 2023-10-08T16:15:23.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f19c4060550 msgr2=0x7f19c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f19c4060550 0x7f19c4062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f19e015cd30 tx=0x7f19d4009040 comp rx=0 tx=0).stop 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 msgr2=0x7f19e00c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 0x7f19e00c2a30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0091e0 tx=0x7f19cc016000 comp rx=0 tx=0).stop 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 shutdown_connections 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f19c4060550 0x7f19c4062a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19e015a450 0x7f19e006d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e01562c0 0x7f19e00c2a30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 --2- 172.21.15.3:0/4069303364 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f19e00684b0 0x7f19e00c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 >> 172.21.15.3:0/4069303364 conn(0x7f19e00c8da0 msgr2=0x7f19e00c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 shutdown_connections 2023-10-08T16:15:23.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.277+0000 7f19e6b84700 1 -- 172.21.15.3:0/4069303364 wait complete. 2023-10-08T16:15:23.287 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T16:15:23.297 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T16:15:23.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:15:23.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.405+0000 7f6db2674700 1 Processor -- start 2023-10-08T16:15:23.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.405+0000 7f6db2674700 1 -- start start 2023-10-08T16:15:23.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6dac0b2080 0x7f6dac06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac06dab0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac06cea0 con 0x7f6dac0b2080 2023-10-08T16:15:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac06d180 con 0x7f6dac067770 2023-10-08T16:15:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1672700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6dac0b2080 0x7f6dac06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3301/0 says I am v2:172.21.15.3:36144/0 (socket says 172.21.15.3:36144) 2023-10-08T16:15:23.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 -- 172.21.15.3:0/2090892030 learned_addr learned my addr 172.21.15.3:0/2090892030 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 -- 172.21.15.3:0/2090892030 >> v2:172.21.15.3:3300/0 conn(0x7f6dac0b2080 msgr2=0x7f6dac06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:23.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 --2- 172.21.15.3:0/2090892030 >> v2:172.21.15.3:3300/0 conn(0x7f6dac0b2080 0x7f6dac06acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 -- 172.21.15.3:0/2090892030 >> v1:172.21.15.27:6789/0 conn(0x7f6dac06c9a0 legacy=0x7f6dac067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 -- 172.21.15.3:0/2090892030 --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac06d460 con 0x7f6dac067770 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db1e73700 1 --2- 172.21.15.3:0/2090892030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0ca850 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009f20 tx=0x7f6da4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c02ccd247a0b3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6da3fff700 1 -- 172.21.15.3:0/2090892030 <== mon.2 v2:172.21.15.27:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da400e070 con 0x7f6dac067770 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6da3fff700 1 -- 172.21.15.3:0/2090892030 <== mon.2 v2:172.21.15.27:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da400b9d0 con 0x7f6dac067770 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6da3fff700 1 -- 172.21.15.3:0/2090892030 <== mon.2 v2:172.21.15.27:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40092e0 con 0x7f6dac067770 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- 172.21.15.3:0/2090892030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 msgr2=0x7f6dac0ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 --2- 172.21.15.3:0/2090892030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0ca850 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009f20 tx=0x7f6da4009840 comp rx=0 tx=0).stop 2023-10-08T16:15:23.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- 172.21.15.3:0/2090892030 shutdown_connections 2023-10-08T16:15:23.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 --2- 172.21.15.3:0/2090892030 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0ca850 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 --2- 172.21.15.3:0/2090892030 >> v2:172.21.15.3:3300/0 conn(0x7f6dac0b2080 0x7f6dac06acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- 172.21.15.3:0/2090892030 >> 172.21.15.3:0/2090892030 conn(0x7f6dac0cfd50 msgr2=0x7f6dac0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- 172.21.15.3:0/2090892030 shutdown_connections 2023-10-08T16:15:23.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.409+0000 7f6db2674700 1 -- 172.21.15.3:0/2090892030 wait complete. 2023-10-08T16:15:23.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 Processor -- start 2023-10-08T16:15:23.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 -- start start 2023-10-08T16:15:23.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dac06c9a0 0x7f6dac0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dac0b2080 0x7f6dac0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c9d40 con 0x7f6dac06c9a0 2023-10-08T16:15:23.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0b4190 con 0x7f6dac0b2080 2023-10-08T16:15:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db2674700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c70f0 con 0x7f6dac067770 2023-10-08T16:15:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dac06c9a0 0x7f6dac0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dac06c9a0 0x7f6dac0c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41256/0 (socket says 172.21.15.3:41256) 2023-10-08T16:15:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 -- 172.21.15.3:0/1436875403 learned_addr learned my addr 172.21.15.3:0/1436875403 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db1e73700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dac0b2080 0x7f6dac0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db1672700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 -- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 msgr2=0x7f6dac0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f6dac067770 0x7f6dac0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 -- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dac0b2080 msgr2=0x7f6dac0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dac0b2080 0x7f6dac0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 -- 172.21.15.3:0/1436875403 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4009ae0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.413+0000 7f6db0e71700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dac06c9a0 0x7f6dac0c74f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c7c0 tx=0x7f6da8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011590 con 0x7f6dac06c9a0 2023-10-08T16:15:23.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8011710 con 0x7f6dac06c9a0 2023-10-08T16:15:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac0b43e0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011ad0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0b49a0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dac04be40 con 0x7f6dac06c9a0 2023-10-08T16:15:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6da801b3b0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d90060550 0x7f6d90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f6da807b9d0 con 0x7f6dac06c9a0 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6db1672700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d90060550 0x7f6d90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7f6d900663f0 0x7f6d90068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 --> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d90068eb0 con 0x7f6d900663f0 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6da8080220 con 0x7f6dac06c9a0 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6db1e73700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7f6d900663f0 0x7f6d90068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.417+0000 7f6db1672700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d90060550 0x7f6d90062a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009db0 tx=0x7f6d9c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.421+0000 7f6db1e73700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7f6d900663f0 0x7f6d90068800 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.421+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== osd.7 v2:172.21.15.27:6824/33607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6d90068eb0 con 0x7f6d900663f0 2023-10-08T16:15:23.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 --> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6dac0c9a60 con 0x7f6d900663f0 2023-10-08T16:15:23.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6da17fa700 1 -- 172.21.15.3:0/1436875403 <== osd.7 v2:172.21.15.27:6824/33607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6dac0c9a60 con 0x7f6d900663f0 2023-10-08T16:15:23.448 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T16:15:23.448 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:15:23.448 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T16:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7f6d900663f0 msgr2=0x7f6d90068800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.27:6824/33607,v1:172.21.15.27:6825/33607] conn(0x7f6d900663f0 0x7f6d90068800 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d90060550 msgr2=0x7f6d90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f6d90060550 0x7f6d90062a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009db0 tx=0x7f6d9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dac06c9a0 msgr2=0x7f6dac0c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 --2- 172.21.15.3:0/1436875403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6dac06c9a0 0x7f6dac0c74f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c7c0 tx=0x7f6da8007f40 comp rx=0 tx=0).stop 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db1e73700 1 -- 172.21.15.3:0/1436875403 reap_dead start 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 shutdown_connections 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 >> 172.21.15.3:0/1436875403 conn(0x7f6dac0cfd50 msgr2=0x7f6dac0cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 shutdown_connections 2023-10-08T16:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.441+0000 7f6db2674700 1 -- 172.21.15.3:0/1436875403 wait complete. 2023-10-08T16:15:23.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T16:15:23.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 Processor -- start 2023-10-08T16:15:23.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- start start 2023-10-08T16:15:23.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0c406aeb0 0x7fc0c40ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c406d900 0x7fc0c415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c406c3a0 con 0x7fc0c40ca070 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c406c8a0 con 0x7fc0c406aeb0 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c406cb40 con 0x7fc0c406d900 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0c406aeb0 0x7fc0c40ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0c406aeb0 0x7fc0c40ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41264/0 (socket says 172.21.15.3:41264) 2023-10-08T16:15:23.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 -- 172.21.15.3:0/3836912329 learned_addr learned my addr 172.21.15.3:0/3836912329 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c8bea700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c406d900 0x7fc0c415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 -- 172.21.15.3:0/3836912329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c406d900 msgr2=0x7fc0c415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c406d900 0x7fc0c415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 -- 172.21.15.3:0/3836912329 >> v1:172.21.15.27:6789/0 conn(0x7fc0c40ca070 legacy=0x7fc0c406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 -- 172.21.15.3:0/3836912329 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c406ce20 con 0x7fc0c406aeb0 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c8bea700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c406d900 0x7fc0c415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:23.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c37fe700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c406aeb0 0x7fc0c40ca440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009f50 tx=0x7fc0b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b4b7be2a4715b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c2ffd700 1 -- 172.21.15.3:0/3836912329 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b400e070 con 0x7fc0c406aeb0 2023-10-08T16:15:23.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c2ffd700 1 -- 172.21.15.3:0/3836912329 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b400ba30 con 0x7fc0c406aeb0 2023-10-08T16:15:23.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c2ffd700 1 -- 172.21.15.3:0/3836912329 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40092e0 con 0x7fc0c406aeb0 2023-10-08T16:15:23.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- 172.21.15.3:0/3836912329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c406aeb0 msgr2=0x7fc0c40ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c406aeb0 0x7fc0c40ca440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009f50 tx=0x7fc0b4009840 comp rx=0 tx=0).stop 2023-10-08T16:15:23.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- 172.21.15.3:0/3836912329 shutdown_connections 2023-10-08T16:15:23.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c406d900 0x7fc0c415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/3836912329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c406aeb0 0x7fc0c40ca440 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- 172.21.15.3:0/3836912329 >> 172.21.15.3:0/3836912329 conn(0x7fc0c40c83d0 msgr2=0x7fc0c40c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- 172.21.15.3:0/3836912329 shutdown_connections 2023-10-08T16:15:23.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.565+0000 7fc0c93eb700 1 -- 172.21.15.3:0/3836912329 wait complete. 2023-10-08T16:15:23.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 Processor -- start 2023-10-08T16:15:23.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 -- start start 2023-10-08T16:15:23.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c406d900 0x7fc0c414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 0x7fc0c40af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c414f730 0x7fc0c40b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c414e790 con 0x7fc0c40ca070 2023-10-08T16:15:23.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40afb40 con 0x7fc0c406d900 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c93eb700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40afe20 con 0x7fc0c414f730 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 0x7fc0c40af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 0x7fc0c40af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41280/0 (socket says 172.21.15.3:41280) 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 -- 172.21.15.3:0/1873348546 learned_addr learned my addr 172.21.15.3:0/1873348546 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c3fff700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c406d900 0x7fc0c414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c8bea700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c414f730 0x7fc0c40b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 -- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c414f730 msgr2=0x7fc0c40b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c414f730 0x7fc0c40b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 -- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c406d900 msgr2=0x7fc0c414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c406d900 0x7fc0c414e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 -- 172.21.15.3:0/1873348546 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4009ae0 con 0x7fc0c40ca070 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.569+0000 7fc0c37fe700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 0x7fc0c40af230 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009f20 tx=0x7fc0b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40129a0 con 0x7fc0c40ca070 2023-10-08T16:15:23.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4012b60 con 0x7fc0c40ca070 2023-10-08T16:15:23.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c40b0100 con 0x7fc0c40ca070 2023-10-08T16:15:23.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b401d420 con 0x7fc0c40ca070 2023-10-08T16:15:23.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c40b06c0 con 0x7fc0c40ca070 2023-10-08T16:15:23.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc0b401d790 con 0x7fc0c40ca070 2023-10-08T16:15:23.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c40c8d40 con 0x7fc0c40ca070 2023-10-08T16:15:23.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0bbfff700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc0a4060550 0x7fc0a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0c3fff700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc0a4060550 0x7fc0a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7fc0b407df70 con 0x7fc0c40ca070 2023-10-08T16:15:23.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.573+0000 7fc0c3fff700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc0a4060550 0x7fc0a4062a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009af0 tx=0x7fc0ac009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.581+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc0c40c8d40 con 0x7fc0c40ca070 2023-10-08T16:15:23.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.749+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0c40c8d40 con 0x7fc0a4060550 2023-10-08T16:15:23.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.749+0000 7fc0bbfff700 1 -- 172.21.15.3:0/1873348546 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc0c40c8d40 con 0x7fc0a4060550 2023-10-08T16:15:23.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.749+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc0a4060550 msgr2=0x7fc0a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.749+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc0a4060550 0x7fc0a4062a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009af0 tx=0x7fc0ac009060 comp rx=0 tx=0).stop 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.749+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 msgr2=0x7fc0c40af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.749+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 0x7fc0c40af230 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009f20 tx=0x7fc0b4017000 comp rx=0 tx=0).stop 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 shutdown_connections 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7fc0a4060550 0x7fc0a4062a00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7fc0c414f730 0x7fc0c40b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0c40ca070 0x7fc0c40af230 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 --2- 172.21.15.3:0/1873348546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c406d900 0x7fc0c414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 >> 172.21.15.3:0/1873348546 conn(0x7fc0c40c83d0 msgr2=0x7fc0c40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 shutdown_connections 2023-10-08T16:15:23.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.753+0000 7fc0c93eb700 1 -- 172.21.15.3:0/1873348546 wait complete. 2023-10-08T16:15:23.761 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T16:15:23.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:15:23.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 Processor -- start 2023-10-08T16:15:23.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 -- start start 2023-10-08T16:15:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9298068880 0x7f9298158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f92981590e0 0x7f92980c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929806e340 con 0x7f92980684b0 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9298159540 con 0x7f92981590e0 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f929759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929806d730 con 0x7f9298068880 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f9296d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f92981590e0 0x7f92980c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f9296d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f92981590e0 0x7f92980c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41294/0 (socket says 172.21.15.3:41294) 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f9296d9d700 1 -- 172.21.15.3:0/4158429821 learned_addr learned my addr 172.21.15.3:0/4158429821 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.877+0000 7f9295d9b700 1 --2- 172.21.15.3:0/4158429821 >> v2:172.21.15.27:3300/0 conn(0x7f9298068880 0x7f9298158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f9296d9d700 1 -- 172.21.15.3:0/4158429821 >> v2:172.21.15.27:3300/0 conn(0x7f9298068880 msgr2=0x7f9298158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f9296d9d700 1 --2- 172.21.15.3:0/4158429821 >> v2:172.21.15.27:3300/0 conn(0x7f9298068880 0x7f9298158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f9296d9d700 1 -- 172.21.15.3:0/4158429821 >> v1:172.21.15.3:6789/0 conn(0x7f92980684b0 legacy=0x7f929806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f9296d9d700 1 -- 172.21.15.3:0/4158429821 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929806da10 con 0x7f92981590e0 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f9295d9b700 1 --2- 172.21.15.3:0/4158429821 >> v2:172.21.15.27:3300/0 conn(0x7f9298068880 0x7f9298158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f9296d9d700 1 --2- 172.21.15.3:0/4158429821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92981590e0 0x7f92980c0fc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f92980705b0 tx=0x7f9290009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4795898f369f405c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929559a700 1 -- 172.21.15.3:0/4158429821 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000e070 con 0x7f92981590e0 2023-10-08T16:15:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929559a700 1 -- 172.21.15.3:0/4158429821 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000ba50 con 0x7f92981590e0 2023-10-08T16:15:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929559a700 1 -- 172.21.15.3:0/4158429821 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900092e0 con 0x7f92981590e0 2023-10-08T16:15:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 -- 172.21.15.3:0/4158429821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92981590e0 msgr2=0x7f92980c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 --2- 172.21.15.3:0/4158429821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92981590e0 0x7f92980c0fc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f92980705b0 tx=0x7f9290009840 comp rx=0 tx=0).stop 2023-10-08T16:15:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 -- 172.21.15.3:0/4158429821 shutdown_connections 2023-10-08T16:15:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 --2- 172.21.15.3:0/4158429821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92981590e0 0x7f92980c0fc0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 --2- 172.21.15.3:0/4158429821 >> v2:172.21.15.27:3300/0 conn(0x7f9298068880 0x7f9298158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 -- 172.21.15.3:0/4158429821 >> 172.21.15.3:0/4158429821 conn(0x7f92980c8c90 msgr2=0x7f92980c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:23.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 -- 172.21.15.3:0/4158429821 shutdown_connections 2023-10-08T16:15:23.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 -- 172.21.15.3:0/4158429821 wait complete. 2023-10-08T16:15:23.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 Processor -- start 2023-10-08T16:15:23.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.881+0000 7f929759e700 1 -- start start 2023-10-08T16:15:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92980684b0 0x7f929814ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 0x7f92980c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f92981590e0 0x7f92980c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298150440 con 0x7f9298068880 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b1c30 con 0x7f92980684b0 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b0d40 con 0x7f92981590e0 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 0x7f92980c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 0x7f92980c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41298/0 (socket says 172.21.15.3:41298) 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 -- 172.21.15.3:0/929650175 learned_addr learned my addr 172.21.15.3:0/929650175 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929659c700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92980684b0 0x7f929814ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9296d9d700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f92981590e0 0x7f92980c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 -- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f92981590e0 msgr2=0x7f92980c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f92981590e0 0x7f92980c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 -- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92980684b0 msgr2=0x7f929814ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92980684b0 0x7f929814ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 -- 172.21.15.3:0/929650175 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009ae0 con 0x7f9298068880 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929659c700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92980684b0 0x7f929814ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9296d9d700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f92981590e0 0x7f92980c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f9295d9b700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 0x7f92980c3ce0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f928000d860 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800125f0 con 0x7f9298068880 2023-10-08T16:15:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280012750 con 0x7f9298068880 2023-10-08T16:15:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980b1020 con 0x7f9298068880 2023-10-08T16:15:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280012ad0 con 0x7f9298068880 2023-10-08T16:15:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.885+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980b15e0 con 0x7f9298068880 2023-10-08T16:15:23.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.889+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929804be40 con 0x7f9298068880 2023-10-08T16:15:23.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.889+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9280014430 con 0x7f9298068880 2023-10-08T16:15:23.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.889+0000 7f928e7fc700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f927c060550 0x7f927c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:23.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.889+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f928007c960 con 0x7f9298068880 2023-10-08T16:15:23.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.889+0000 7f929659c700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f927c060550 0x7f927c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:23.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.889+0000 7f929659c700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f927c060550 0x7f927c062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9298150ce0 tx=0x7f9288009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:23.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:23.893+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9280050cb0 con 0x7f9298068880 2023-10-08T16:15:24.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.049+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92980697a0 con 0x7f927c060550 2023-10-08T16:15:24.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f928e7fc700 1 -- 172.21.15.3:0/929650175 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48646 (secure 0 0 0) 0x7f92980697a0 con 0x7f927c060550 2023-10-08T16:15:24.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:24.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f927c060550 msgr2=0x7f927c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f927c060550 0x7f927c062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9298150ce0 tx=0x7f9288009040 comp rx=0 tx=0).stop 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 msgr2=0x7f92980c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 0x7f92980c3ce0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f928000d860 tx=0x7f9280008040 comp rx=0 tx=0).stop 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 shutdown_connections 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f927c060550 0x7f927c062a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f92981590e0 0x7f92980c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9298068880 0x7f92980c3ce0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 --2- 172.21.15.3:0/929650175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92980684b0 0x7f929814ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 >> 172.21.15.3:0/929650175 conn(0x7f92980c8c90 msgr2=0x7f92980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 shutdown_connections 2023-10-08T16:15:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:24.053+0000 7f929759e700 1 -- 172.21.15.3:0/929650175 wait complete. 2023-10-08T16:15:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:15:24.074 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2023-10-08T16:15:23.993154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2437384,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752537336,"statfs":{"total":773094113280,"available":770598232064,"internally_reserved":0,"allocated":5971968,"data_stored":3127112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-151275,"num_objects":-34699,"num_object_clones":0,"num_object_copies":-69398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34699,"num_whiteouts":0,"num_read":-394,"num_read_kb":0,"num_write":-38499,"num_write_kb":-34704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-187,"num_bytes_recovered":-707,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002295"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T16:15:14.040989+0000","last_change":"2023-10-08T16:06:29.510198+0000","last_active":"2023-10-08T16:15:14.040989+0000","last_peered":"2023-10-08T16:15:14.040989+0000","last_clean":"2023-10-08T16:15:14.040989+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:15:14.040989+0000","last_undegraded":"2023-10-08T16:15:14.040989+0000","last_fullsized":"2023-10-08T16:15:14.040989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:28.064672+0000","last_clean_scrub_stamp":"2023-10-08T16:06:28.064672+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:35.595645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310740,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061100,"statfs":{"total":96636764160,"available":96318566400,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.92700000000000005},"min":{"1min":0.57399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96199999999999997,"5min":1.268,"15min":1.3460000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77900000000000003,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.42899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1970000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.93400000000000005},"min":{"1min":0.58399999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.085,"5min":1.3600000000000001,"15min":1.429},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91300000000000003,"15min":0.97799999999999998},"min":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":1.0169999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.94899999999999995,"15min":0.99199999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.5920000000000001},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.96999999999999997},"min":{"1min":0.67800000000000005,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.105,"5min":1.099,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.2390000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.0820000000000001},"min":{"1min":0.73499999999999999,"5min":0.67400000000000004,"15min":0.5},"max":{"1min":1.2929999999999999,"5min":1.837,"15min":1.837},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0509999999999999,"15min":1.091},"min":{"1min":0.83999999999999997,"5min":0.63400000000000001,"15min":0.621},"max":{"1min":1.53,"5min":1.53,"15min":1.702},"last":1.0629999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1919999999999999,"15min":1.1830000000000001},"min":{"1min":0.83799999999999997,"5min":0.57499999999999996,"15min":0.51200000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.137},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2,"15min":1.1799999999999999},"min":{"1min":0.96099999999999997,"5min":0.85099999999999998,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":2.081,"15min":2.081},"last":1.095}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":1.0009999999999999,"5min":0.77800000000000002,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":2.456,"15min":2.456},"last":1.278},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.90000000000000002,"5min":0.83099999999999996,"15min":0.72199999999999998},"max":{"1min":1.595,"5min":1.758,"15min":1.758},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.88900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.095,"5min":1.302,"15min":1.548},"last":1.032},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85399999999999998,"15min":0.94999999999999996},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":1.1100000000000001,"5min":1.518,"15min":1.518},"last":0.82299999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.86799999999999999,"15min":0.92800000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.159,"5min":1.27,"15min":1.6739999999999999},"last":1.298},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.96399999999999997},"min":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1180000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.93300000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2689999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.034,"15min":1.1240000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3100000000000001,"5min":1.46,"15min":2.286},"last":1.391}]},{"osd":3,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59299999999999997},"max":{"1min":1.371,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.746,"15min":1.746},"last":0.997}]},{"osd":4,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.5209999999999999},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1479999999999999,"15min":1.21},"min":{"1min":0.78800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4970000000000001,"5min":1.819,"15min":1.819},"last":1.2689999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0860000000000001,"15min":1.113},"min":{"1min":0.68799999999999994,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5129999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.877,"15min":0.877},"max":{"1min":1.48,"5min":1.984,"15min":1.984},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.286,"15min":1.353},"min":{"1min":0.86699999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.587,"5min":2.1360000000000001,"15min":2.4529999999999998},"last":1.204},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.78200000000000003},"max":{"1min":1.5229999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.238}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76700000000000002,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.429},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.84299999999999997,"15min":0.90100000000000002},"min":{"1min":0.66300000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.2230000000000001,"5min":1.76,"15min":1.76},"last":1.0700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.3979999999999999,"5min":1.5129999999999999,"15min":1.8500000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.466,"5min":1.5529999999999999,"15min":1.734},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96199999999999997,"15min":0.96599999999999997},"min":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95599999999999996,"15min":1.004},"min":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3129999999999999,"5min":1.6739999999999999,"15min":2.0609999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.71899999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5840000000000001,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.091,"15min":1.087},"min":{"1min":0.746,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.579,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.96299999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0620000000000001,"15min":1.044},"min":{"1min":0.78900000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.623,"5min":1.823,"15min":1.823},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.1799999999999999,"15min":1.2190000000000001},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6739999999999999,"5min":1.7909999999999999,"15min":2.101},"last":1.2689999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.70299999999999996},"max":{"1min":1.774,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.2050000000000001,"15min":1.226},"min":{"1min":0.94699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.837,"5min":1.95,"15min":2.2559999999999998},"last":1.234}]},{"osd":7,"last update":"Sun Oct 8 16:14:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.284,"15min":1.3240000000000001},"min":{"1min":1.0369999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7709999999999999,"5min":1.9610000000000001,"15min":2.1869999999999998},"last":1.355},{"interface":"front","average":{"1min":1.351,"5min":1.3100000000000001,"15min":1.367},"min":{"1min":1.0840000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.8939999999999999,"5min":2.496,"15min":2.605},"last":1.2110000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.141,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84699999999999998,"15min":0.91200000000000003},"min":{"1min":0.58299999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3520000000000001,"5min":1.554,"15min":1.554},"last":1.282}]},{"osd":1,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.92300000000000004},"min":{"1min":0.63300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.169,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.871,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.7929999999999999},"last":1.0229999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.88500000000000001},"min":{"1min":0.623,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3089999999999999,"5min":1.653,"15min":1.653},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.069},"min":{"1min":0.624,"5min":0.438,"15min":0.438},"max":{"1min":1.385,"5min":2.085,"15min":2.5859999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.1080000000000001},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.052,"15min":1.091},"min":{"1min":0.755,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7729999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0720000000000001,"15min":1.167},"min":{"1min":0.66000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.605,"5min":1.605,"15min":2.7069999999999999},"last":1.123},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.1910000000000001},"min":{"1min":0.89000000000000001,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":1.661,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.2070000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0960000000000001,"15min":1.147},"min":{"1min":0.82499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.657,"5min":1.7789999999999999,"15min":2.0489999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.216,"15min":1.329},"min":{"1min":0.89700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.639,"5min":1.7749999999999999,"15min":2.758},"last":1.181}]},{"osd":7,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.3080000000000001},"min":{"1min":0.95799999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"max":{"1min":1.6399999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.23,"15min":1.302},"min":{"1min":1.0449999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.738,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.163}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63300000000000001,"15min":0.66100000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.94099999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76000000000000001,"15min":0.72499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79700000000000004,"15min":0.79300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89200000000000002,"15min":0.90500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.65500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.0389999999999999,"15min":1.0920000000000001},"min":{"1min":0.70399999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.98499999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0880000000000001,"15min":1.0660000000000001},"min":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.05},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1100000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.0900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1799999999999999,"15min":1.2170000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.2030000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.2050000000000001,"15min":1.234},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":1.115}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60899999999999999,"15min":0.66000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.6559999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.29999999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.556},"last":0.89600000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":1.048,"5min":1.298,"15min":1.4910000000000001},"last":0.755},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.78200000000000003},"min":{"1min":0.44500000000000001,"5min":0.42199999999999999,"15min":0.35699999999999998},"max":{"1min":1.034,"5min":1.284,"15min":1.4119999999999999},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.745,"15min":0.73099999999999998},"min":{"1min":0.58599999999999997,"5min":0.44,"15min":0.35999999999999999},"max":{"1min":1.0880000000000001,"5min":1.3660000000000001,"15min":1.4039999999999999},"last":1.111},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84499999999999997,"15min":0.85199999999999998},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.4410000000000001,"15min":1.4690000000000001},"last":0.85099999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.72899999999999998,"5min":0.59899999999999998,"15min":0.52800000000000002},"max":{"1min":1.4750000000000001,"5min":1.538,"15min":1.583},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0049999999999999,"15min":1.0369999999999999},"min":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.58499999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.81599999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0109999999999999,"15min":1.0469999999999999},"min":{"1min":0.68999999999999995,"5min":0.53900000000000003,"15min":0.51600000000000001},"max":{"1min":1.3149999999999999,"5min":1.742,"15min":1.742},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1479999999999999},"min":{"1min":0.72099999999999997,"5min":0.66400000000000003,"15min":0.63800000000000001},"max":{"1min":1.415,"5min":1.5149999999999999,"15min":1.792},"last":0.93400000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.095,"15min":1.1299999999999999},"min":{"1min":0.79100000000000004,"5min":0.70699999999999996,"15min":0.54200000000000004},"max":{"1min":1.694,"5min":1.694,"15min":2.0070000000000001},"last":1.169},{"interface":"front","average":{"1min":1.077,"5min":1.0640000000000001,"15min":1.115},"min":{"1min":0.77200000000000002,"5min":0.64300000000000002,"15min":0.56899999999999995},"max":{"1min":1.407,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2010000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.139,"15min":1.157},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.853,"5min":1.853,"15min":1.8899999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.103,"15min":1.153},"min":{"1min":0.81200000000000006,"5min":0.79800000000000004,"15min":0.67800000000000005},"max":{"1min":1.335,"5min":1.996,"15min":1.996},"last":1.25}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306064,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065776,"statfs":{"total":96636764160,"available":96323354624,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":1.325,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.36299999999999999},"max":{"1min":1.341,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":1.208,"5min":1.75,"15min":1.75},"last":0.57099999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85899999999999999,"15min":0.81399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.39600000000000002},"max":{"1min":1.1639999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.87,"15min":0.83899999999999997},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42199999999999999},"max":{"1min":1.389,"5min":1.472,"15min":1.472},"last":0.61799999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.61399999999999999,"15min":0.57799999999999996},"max":{"1min":1.417,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.008,"5min":0.98899999999999999,"15min":0.96299999999999997},"min":{"1min":0.753,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5049999999999999,"5min":1.821,"15min":1.821},"last":0.90100000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.04,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.68300000000000005,"15min":0.53700000000000003},"max":{"1min":1.321,"5min":1.891,"15min":1.891},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0960000000000001,"15min":1.1020000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63700000000000001},"max":{"1min":1.6439999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0660000000000001,"15min":1.1040000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.60999999999999999},"max":{"1min":1.478,"5min":1.516,"15min":1.768},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.085,"5min":1.1299999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.748,"15min":0.628},"max":{"1min":1.4350000000000001,"5min":3.665,"15min":3.665},"last":1.0760000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.139,"15min":1.1539999999999999},"min":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7230000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.135,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.345,"5min":1.5880000000000001,"15min":2.0299999999999998},"last":0.95899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.65700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28899999999999998},"max":{"1min":1.109,"5min":1.133,"15min":1.133},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.753},"min":{"1min":0.377,"5min":0.377,"15min":0.36499999999999999},"max":{"1min":1.147,"5min":1.208,"15min":1.3},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.272,"5min":1.423,"15min":1.423},"last":0.34300000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.484,"5min":1.484,"15min":2.0230000000000001},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7490000000000001,"5min":1.954,"15min":2.657},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94999999999999996,"15min":0.96499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.55800000000000005},"max":{"1min":1.2789999999999999,"5min":1.6699999999999999,"15min":2.012},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.115},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.65100000000000002},"max":{"1min":1.8600000000000001,"5min":2.129,"15min":2.7120000000000002},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.145},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.54000000000000004},"max":{"1min":1.619,"5min":2.1259999999999999,"15min":2.2000000000000002},"last":0.91100000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57099999999999995},"max":{"1min":1.3440000000000001,"5min":1.605,"15min":2.2719999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.161,"15min":1.202},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7769999999999999,"5min":1.8100000000000001,"15min":2.9830000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.171,"15min":1.204},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8240000000000001,"5min":2.069,"15min":2.069},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.171},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3759999999999999,"5min":1.8160000000000001,"15min":2.008},"last":0.89800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:15:24.078 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T16:06:28.064672+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=6, tm_sec=28, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=15, tm_sec=18, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:15:24.078 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T16:15:44.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:15:44.554 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:44.557 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:44.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.577+0000 7f16a1150700 1 Processor -- start 2023-10-08T16:15:44.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.577+0000 7f16a1150700 1 -- start start 2023-10-08T16:15:44.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.577+0000 7f16a1150700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f169c0adc80 0x7f169c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.577+0000 7f16a1150700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0c7eb0 con 0x7f169c0aef40 2023-10-08T16:15:44.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.577+0000 7f16a1150700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0ae590 con 0x7f169c155fd0 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.577+0000 7f16a1150700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0c72a0 con 0x7f169c0adc80 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f169c0adc80 0x7f169c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169b59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f169c0aef40 0x7f169c0c8340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35662/0 (socket says 172.21.15.3:35662) 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f169c0adc80 0x7f169c0ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59652/0 (socket says 172.21.15.3:59652) 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169b59e700 1 -- 172.21.15.3:0/709865843 learned_addr learned my addr 172.21.15.3:0/709865843 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169ad9d700 1 -- 172.21.15.3:0/709865843 >> v1:172.21.15.27:6789/0 conn(0x7f169c155fd0 legacy=0x7f169c0ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169ad9d700 1 -- 172.21.15.3:0/709865843 >> v1:172.21.15.3:6789/0 conn(0x7f169c0aef40 legacy=0x7f169c0c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169ad9d700 1 -- 172.21.15.3:0/709865843 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0c7580 con 0x7f169c0adc80 2023-10-08T16:15:44.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f169ad9d700 1 --2- 172.21.15.3:0/709865843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0ae050 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e90 tx=0x7f168c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cf2783671a6ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f1699d9b700 1 -- 172.21.15.3:0/709865843 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00e070 con 0x7f169c0adc80 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f1699d9b700 1 -- 172.21.15.3:0/709865843 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c00bbf0 con 0x7f169c0adc80 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f1699d9b700 1 -- 172.21.15.3:0/709865843 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c012430 con 0x7f169c0adc80 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 -- 172.21.15.3:0/709865843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 msgr2=0x7f169c0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 --2- 172.21.15.3:0/709865843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0ae050 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e90 tx=0x7f168c009780 comp rx=0 tx=0).stop 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 -- 172.21.15.3:0/709865843 shutdown_connections 2023-10-08T16:15:44.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 --2- 172.21.15.3:0/709865843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0ae050 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 -- 172.21.15.3:0/709865843 >> 172.21.15.3:0/709865843 conn(0x7f169c0ccbd0 msgr2=0x7f169c0ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:44.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 -- 172.21.15.3:0/709865843 shutdown_connections 2023-10-08T16:15:44.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 -- 172.21.15.3:0/709865843 wait complete. 2023-10-08T16:15:44.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 Processor -- start 2023-10-08T16:15:44.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.581+0000 7f16a1150700 1 -- start start 2023-10-08T16:15:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f169c0aef40 0x7f169c0c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f169c155fd0 0x7f169c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0ca210 con 0x7f169c0adc80 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c169a80 con 0x7f169c155fd0 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c169d60 con 0x7f169c0aef40 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59666/0 (socket says 172.21.15.3:59666) 2023-10-08T16:15:44.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 -- 172.21.15.3:0/1559130293 learned_addr learned my addr 172.21.15.3:0/1559130293 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169a59c700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f169c0aef40 0x7f169c0c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169b59e700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f169c155fd0 0x7f169c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 -- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f169c0aef40 msgr2=0x7f169c0c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f169c0aef40 0x7f169c0c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 -- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f169c155fd0 msgr2=0x7f169c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f169c155fd0 0x7f169c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 -- 172.21.15.3:0/1559130293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c009a20 con 0x7f169c0adc80 2023-10-08T16:15:44.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169b59e700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f169c155fd0 0x7f169c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f169ad9d700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0c17f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f168c013000 tx=0x7f168c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00beb0 con 0x7f169c0adc80 2023-10-08T16:15:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c021070 con 0x7f169c0adc80 2023-10-08T16:15:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c16a040 con 0x7f169c0adc80 2023-10-08T16:15:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c026430 con 0x7f169c0adc80 2023-10-08T16:15:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.585+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c16a600 con 0x7f169c0adc80 2023-10-08T16:15:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.589+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c04be40 con 0x7f169c0adc80 2023-10-08T16:15:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.589+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f168c023030 con 0x7f169c0adc80 2023-10-08T16:15:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.589+0000 7f1682ffd700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1688060550 0x7f1688062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.589+0000 7f169a59c700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1688060550 0x7f1688062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.589+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f168c07e5d0 con 0x7f169c0adc80 2023-10-08T16:15:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.589+0000 7f169a59c700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1688060550 0x7f1688062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f169c152e80 tx=0x7f1690007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:44.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.597+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f168c04edf0 con 0x7f169c0adc80 2023-10-08T16:15:44.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.753+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 --> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f169c0c7860 con 0x7f1688060550 2023-10-08T16:15:44.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.757+0000 7f1682ffd700 1 -- 172.21.15.3:0/1559130293 <== mgr.4101 v2:172.21.15.3:6832/33399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48325 (secure 0 0 0) 0x7f169c0c7860 con 0x7f1688060550 2023-10-08T16:15:44.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:44.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1688060550 msgr2=0x7f1688062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1688060550 0x7f1688062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f169c152e80 tx=0x7f1690007ec0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 msgr2=0x7f169c0c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0c17f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f168c013000 tx=0x7f168c019000 comp rx=0 tx=0).stop 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 shutdown_connections 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f1688060550 0x7f1688062a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f169c155fd0 0x7f169c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f169c0aef40 0x7f169c0c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 --2- 172.21.15.3:0/1559130293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f169c0adc80 0x7f169c0c17f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 >> 172.21.15.3:0/1559130293 conn(0x7f169c0ccbd0 msgr2=0x7f169c0c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:44.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 shutdown_connections 2023-10-08T16:15:44.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.761+0000 7f16a1150700 1 -- 172.21.15.3:0/1559130293 wait complete. 2023-10-08T16:15:44.770 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T16:15:44.782 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2023-10-08T16:15:43.998747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2437384,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752537336,"statfs":{"total":773094113280,"available":770598232064,"internally_reserved":0,"allocated":5971968,"data_stored":3127112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003504"},"pg_stats":[{"pgid":"1.0","version":"50'119","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T16:15:25.399448+0000","last_change":"2023-10-08T16:15:25.399357+0000","last_active":"2023-10-08T16:15:25.399448+0000","last_peered":"2023-10-08T16:15:25.399448+0000","last_clean":"2023-10-08T16:15:25.399448+0000","last_became_active":"2023-10-08T16:06:29.508281+0000","last_became_peered":"2023-10-08T16:06:29.508281+0000","last_unstale":"2023-10-08T16:15:25.399448+0000","last_undegraded":"2023-10-08T16:15:25.399448+0000","last_fullsized":"2023-10-08T16:15:25.399448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'119","last_scrub_stamp":"2023-10-08T16:15:25.399177+0000","last_deep_scrub":"50'119","last_deep_scrub_stamp":"2023-10-08T16:15:25.399177+0000","last_clean_scrub_stamp":"2023-10-08T16:15:25.399177+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:33.106257+0000","scrub_duration":0.048691559000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310740,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061100,"statfs":{"total":96636764160,"available":96318566400,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.92700000000000005},"min":{"1min":0.57399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96199999999999997,"5min":1.268,"15min":1.3460000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77900000000000003,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.42899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.93400000000000005},"min":{"1min":0.58399999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.085,"5min":1.3600000000000001,"15min":1.429},"last":1.052},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91300000000000003,"15min":0.97799999999999998},"min":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.208,"5min":1.464,"15min":1.464},"last":0.70399999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.94899999999999995,"15min":0.99199999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.5920000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.96999999999999997},"min":{"1min":0.67800000000000005,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.337},{"interface":"front","average":{"1min":1.105,"5min":1.099,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.1040000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.0820000000000001},"min":{"1min":0.73499999999999999,"5min":0.67400000000000004,"15min":0.5},"max":{"1min":1.2929999999999999,"5min":1.837,"15min":1.837},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0509999999999999,"15min":1.091},"min":{"1min":0.83999999999999997,"5min":0.63400000000000001,"15min":0.621},"max":{"1min":1.53,"5min":1.53,"15min":1.702},"last":1.196}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1919999999999999,"15min":1.1830000000000001},"min":{"1min":0.83799999999999997,"5min":0.57499999999999996,"15min":0.51200000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.244},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2,"15min":1.1799999999999999},"min":{"1min":0.96099999999999997,"5min":0.85099999999999998,"15min":0.66400000000000003},"max":{"1min":1.4990000000000001,"5min":2.081,"15min":2.081},"last":1.151}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":1.0009999999999999,"5min":0.77800000000000002,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":2.456,"15min":2.456},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.90000000000000002,"5min":0.83099999999999996,"15min":0.72199999999999998},"max":{"1min":1.595,"5min":1.758,"15min":1.758},"last":1.413}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.88900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.095,"5min":1.302,"15min":1.548},"last":1.25},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85399999999999998,"15min":0.94999999999999996},"min":{"1min":0.501,"5min":0.498,"15min":0.498},"max":{"1min":1.1100000000000001,"5min":1.518,"15min":1.518},"last":0.77600000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.86799999999999999,"15min":0.92800000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.159,"5min":1.27,"15min":1.6739999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.96399999999999997},"min":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.877}]},{"osd":2,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.93300000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2689999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.034,"15min":1.1240000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3100000000000001,"5min":1.46,"15min":2.286},"last":1.0129999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59299999999999997},"max":{"1min":1.371,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.095},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.746,"15min":1.746},"last":1.071}]},{"osd":4,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.5209999999999999},"last":1.137},{"interface":"front","average":{"1min":1.069,"5min":1.1479999999999999,"15min":1.21},"min":{"1min":0.78800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4970000000000001,"5min":1.819,"15min":1.819},"last":1.173}]},{"osd":5,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0860000000000001,"15min":1.113},"min":{"1min":0.68799999999999994,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5129999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.877,"15min":0.877},"max":{"1min":1.48,"5min":1.984,"15min":1.984},"last":1.375}]},{"osd":7,"last update":"Sun Oct 8 16:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.286,"15min":1.353},"min":{"1min":0.86699999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.587,"5min":2.1360000000000001,"15min":2.4529999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.78200000000000003},"max":{"1min":1.5229999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3360000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78000000000000003,"15min":0.84299999999999997},"min":{"1min":0.57799999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.87,"15min":0.90300000000000002},"min":{"1min":0.622,"5min":0.504,"15min":0.504},"max":{"1min":1.417,"5min":1.76,"15min":1.76},"last":1.3220000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.81699999999999995,"15min":0.87},"min":{"1min":0.62,"5min":0.437,"15min":0.437},"max":{"1min":1.2889999999999999,"5min":1.3979999999999999,"15min":1.8500000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.93100000000000005,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1830000000000001,"5min":1.466,"15min":1.734},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.351,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.96099999999999997,"15min":1.0009999999999999},"min":{"1min":0.67500000000000004,"5min":0.60199999999999998,"15min":0.59799999999999998},"max":{"1min":1.337,"5min":1.474,"15min":2.0609999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0900000000000001,"15min":1.077},"min":{"1min":0.73899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2829999999999999,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.097,"15min":1.0880000000000001},"min":{"1min":0.69399999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5429999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.208}]},{"osd":4,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0529999999999999,"15min":1.046},"min":{"1min":0.70399999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.639,"5min":1.823,"15min":1.823},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.181,"15min":1.2150000000000001},"min":{"1min":0.83899999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6830000000000001,"5min":1.7709999999999999,"15min":2.101},"last":1.1399999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.93600000000000005,"5min":0.79100000000000004,"15min":0.70299999999999996},"max":{"1min":1.7130000000000001,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2010000000000001,"15min":1.224},"min":{"1min":0.89200000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.577,"5min":1.95,"15min":2.2559999999999998},"last":1.004}]},{"osd":7,"last update":"Sun Oct 8 16:15:42 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2709999999999999,"15min":1.3160000000000001},"min":{"1min":0.99399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5900000000000001,"5min":1.9610000000000001,"15min":2.1869999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3180000000000001,"15min":1.361},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.778,"5min":2.496,"15min":2.605},"last":1.3680000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.141,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.876},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84699999999999998,"15min":0.91200000000000003},"min":{"1min":0.58299999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3520000000000001,"5min":1.554,"15min":1.554},"last":0.95399999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.92300000000000004},"min":{"1min":0.63300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.169,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.871,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.7929999999999999},"last":1.0069999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.88500000000000001},"min":{"1min":0.623,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3089999999999999,"5min":1.653,"15min":1.653},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.069},"min":{"1min":0.624,"5min":0.438,"15min":0.438},"max":{"1min":1.385,"5min":2.085,"15min":2.5859999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0589999999999999,"15min":1.1080000000000001},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.052,"15min":1.091},"min":{"1min":0.755,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7729999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0720000000000001,"15min":1.167},"min":{"1min":0.66000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.605,"5min":1.605,"15min":2.7069999999999999},"last":1.169},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.1910000000000001},"min":{"1min":0.89000000000000001,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":1.661,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.387}]},{"osd":6,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0960000000000001,"15min":1.147},"min":{"1min":0.82499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.657,"5min":1.7789999999999999,"15min":2.0489999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.216,"15min":1.329},"min":{"1min":0.89700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.639,"5min":1.7749999999999999,"15min":2.758},"last":1.276}]},{"osd":7,"last update":"Sun Oct 8 16:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.3080000000000001},"min":{"1min":0.95799999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"max":{"1min":1.6399999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.23,"15min":1.302},"min":{"1min":1.0449999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.738,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.147}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.97899999999999998,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.399,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.66800000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76900000000000002,"15min":0.72899999999999998},"min":{"1min":0.43099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.282,"5min":2.218,"15min":2.218},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.3879999999999999,"5min":2.323,"15min":2.323},"last":0.85199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.497,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":1.1399999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"min":{"1min":0.53500000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5209999999999999,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.99199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0109999999999999,"15min":1.01},"min":{"1min":0.59999999999999998,"5min":0.57899999999999996,"15min":0.53800000000000003},"max":{"1min":1.603,"5min":2.677,"15min":2.677},"last":1.05},{"interface":"front","average":{"1min":1.103,"5min":1.056,"15min":1.0900000000000001},"min":{"1min":0.68500000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6459999999999999,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.1990000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1020000000000001,"15min":1.075},"min":{"1min":0.83699999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7,"5min":2.774,"15min":2.774},"last":1.389},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1419999999999999,"15min":1.1220000000000001},"min":{"1min":0.92500000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5549999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.46}]},{"osd":6,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1819999999999999,"15min":1.1930000000000001},"min":{"1min":0.77000000000000002,"5min":0.752,"15min":0.68999999999999995},"max":{"1min":1.7330000000000001,"5min":2.754,"15min":2.754},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79200000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.887,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.3220000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2050000000000001,"15min":1.214},"min":{"1min":0.85399999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.603,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.016,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":1.4139999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310160,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061680,"statfs":{"total":96636764160,"available":96319160320,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.34999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.02,"5min":1.294,"15min":1.6559999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.29999999999999999},"max":{"1min":0.93000000000000005,"5min":1.242,"15min":1.556},"last":0.75600000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":1.248,"5min":1.298,"15min":1.4910000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.751,"15min":0.77800000000000002},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.35699999999999998},"max":{"1min":1.2490000000000001,"5min":1.284,"15min":1.4119999999999999},"last":0.66100000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.755,"15min":0.73499999999999999},"min":{"1min":0.45300000000000001,"5min":0.44,"15min":0.35999999999999999},"max":{"1min":1.1739999999999999,"5min":1.3660000000000001,"15min":1.4039999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.875,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.46600000000000003,"15min":0.378},"max":{"1min":1.3540000000000001,"5min":1.4410000000000001,"15min":1.4690000000000001},"last":0.79300000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.99399999999999999,"15min":1.0029999999999999},"min":{"1min":0.80400000000000005,"5min":0.624,"15min":0.52800000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.583},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0129999999999999,"15min":1.032},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.58499999999999996},"max":{"1min":1.3180000000000001,"5min":1.78,"15min":1.78},"last":0.96199999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.016,"15min":1.04},"min":{"1min":0.78600000000000003,"5min":0.53900000000000003,"15min":0.51600000000000001},"max":{"1min":1.2350000000000001,"5min":1.742,"15min":1.742},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.083,"5min":1.097,"15min":1.1399999999999999},"min":{"1min":0.71599999999999997,"5min":0.66400000000000003,"15min":0.63800000000000001},"max":{"1min":1.5069999999999999,"5min":1.5149999999999999,"15min":1.792},"last":0.98499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.101,"15min":1.127},"min":{"1min":0.86699999999999999,"5min":0.70699999999999996,"15min":0.54200000000000004},"max":{"1min":1.3149999999999999,"5min":1.694,"15min":2.0070000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.073,"15min":1.107},"min":{"1min":0.82399999999999995,"5min":0.64300000000000002,"15min":0.56899999999999995},"max":{"1min":1.24,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.034}]},{"osd":7,"last update":"Sun Oct 8 16:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.133,"15min":1.155},"min":{"1min":0.70599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4319999999999999,"5min":1.853,"15min":1.8899999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1100000000000001,"15min":1.1479999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.67800000000000005},"max":{"1min":1.363,"5min":1.996,"15min":1.996},"last":1.103}]}]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306064,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065776,"statfs":{"total":96636764160,"available":96323354624,"internally_reserved":0,"allocated":598016,"data_stored":243297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":1.325,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.36299999999999999},"max":{"1min":1.341,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":1.208,"5min":1.75,"15min":1.75},"last":1.141}]},{"osd":3,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85899999999999999,"15min":0.81399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.39600000000000002},"max":{"1min":1.1639999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.079},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.87,"15min":0.83899999999999997},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42199999999999999},"max":{"1min":1.389,"5min":1.472,"15min":1.472},"last":0.997}]},{"osd":4,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.94699999999999995,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.61399999999999999,"15min":0.57799999999999996},"max":{"1min":1.417,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.008,"5min":0.98899999999999999,"15min":0.96299999999999997},"min":{"1min":0.753,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5049999999999999,"5min":1.821,"15min":1.821},"last":0.91500000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.04,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.68300000000000005,"15min":0.53700000000000003},"max":{"1min":1.321,"5min":1.891,"15min":1.891},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0960000000000001,"15min":1.1020000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63700000000000001},"max":{"1min":1.6439999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.331}]},{"osd":6,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0660000000000001,"15min":1.1040000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.60999999999999999},"max":{"1min":1.478,"5min":1.516,"15min":1.768},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1299999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.748,"15min":0.628},"max":{"1min":1.4350000000000001,"5min":3.665,"15min":3.665},"last":1.107}]},{"osd":7,"last update":"Sun Oct 8 16:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.139,"15min":1.1539999999999999},"min":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7230000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.135,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.345,"5min":1.5880000000000001,"15min":2.0299999999999998},"last":1.3160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":833665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.65700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28899999999999998},"max":{"1min":1.109,"5min":1.133,"15min":1.133},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.753},"min":{"1min":0.377,"5min":0.377,"15min":0.36499999999999999},"max":{"1min":1.147,"5min":1.208,"15min":1.3},"last":0.89900000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.272,"5min":1.423,"15min":1.423},"last":0.82599999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.754},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.484,"5min":1.484,"15min":2.0230000000000001},"last":1.04}]},{"osd":4,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7490000000000001,"5min":1.954,"15min":2.657},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94999999999999996,"15min":0.96499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.55800000000000005},"max":{"1min":1.2789999999999999,"5min":1.6699999999999999,"15min":2.012},"last":0.97199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.097,"15min":1.115},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.65100000000000002},"max":{"1min":1.8600000000000001,"5min":2.129,"15min":2.7120000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.145},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.54000000000000004},"max":{"1min":1.619,"5min":2.1259999999999999,"15min":2.2000000000000002},"last":1.4419999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57099999999999995},"max":{"1min":1.3440000000000001,"5min":1.605,"15min":2.2719999999999998},"last":1.119},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.161,"15min":1.202},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.7769999999999999,"5min":1.8100000000000001,"15min":2.9830000000000001},"last":1.355}]},{"osd":7,"last update":"Sun Oct 8 16:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.171,"15min":1.204},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8240000000000001,"5min":2.069,"15min":2.069},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.171},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3759999999999999,"5min":1.8160000000000001,"15min":2.008},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:15:44.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T16:15:44.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 Processor -- start 2023-10-08T16:15:44.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 -- start start 2023-10-08T16:15:44.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0010159040 0x7f00100b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0010159410 0x7f00100ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00100cb380 con 0x7f00100cd420 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00100b3150 con 0x7f0010159410 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f0017b81700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001006b5e0 con 0x7f0010159040 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001611e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0010159410 0x7f00100ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001511c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f00100cd420 0x7f001006aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35666/0 (socket says 172.21.15.3:35666) 2023-10-08T16:15:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001511c700 1 -- 172.21.15.3:0/4146379981 learned_addr learned my addr 172.21.15.3:0/4146379981 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:44.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001591d700 1 --2- 172.21.15.3:0/4146379981 >> v2:172.21.15.27:3300/0 conn(0x7f0010159040 0x7f00100b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001491b700 1 -- 172.21.15.3:0/4146379981 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077406100 0 0) 0x7f00100cb380 con 0x7f00100cd420 2023-10-08T16:15:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001491b700 1 -- 172.21.15.3:0/4146379981 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efffc003570 con 0x7f00100cd420 2023-10-08T16:15:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001591d700 1 -- 172.21.15.3:0/4146379981 >> v2:172.21.15.3:3300/0 conn(0x7f0010159410 msgr2=0x7f00100ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001591d700 1 --2- 172.21.15.3:0/4146379981 >> v2:172.21.15.3:3300/0 conn(0x7f0010159410 0x7f00100ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001491b700 1 -- 172.21.15.3:0/4146379981 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56610178 0 0) 0x7efffc003570 con 0x7f00100cd420 2023-10-08T16:15:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001591d700 1 -- 172.21.15.3:0/4146379981 >> v1:172.21.15.3:6789/0 conn(0x7f00100cd420 legacy=0x7f001006aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001591d700 1 -- 172.21.15.3:0/4146379981 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100caa90 con 0x7f0010159040 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001611e700 1 --2- 172.21.15.3:0/4146379981 >> v2:172.21.15.3:3300/0 conn(0x7f0010159410 0x7f00100ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.885+0000 7f001591d700 1 --2- 172.21.15.3:0/4146379981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0010159040 0x7f00100b2c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0010069f70 tx=0x7f000c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418b783dd0d9841b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f001491b700 1 -- 172.21.15.3:0/4146379981 <== mon.1 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000001470 con 0x7f0010159040 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f001491b700 1 -- 172.21.15.3:0/4146379981 <== mon.1 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c011420 con 0x7f0010159040 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f001491b700 1 -- 172.21.15.3:0/4146379981 <== mon.1 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0117c0 con 0x7f0010159040 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 -- 172.21.15.3:0/4146379981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0010159040 msgr2=0x7f00100b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 --2- 172.21.15.3:0/4146379981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0010159040 0x7f00100b2c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0010069f70 tx=0x7f000c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 -- 172.21.15.3:0/4146379981 shutdown_connections 2023-10-08T16:15:44.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 --2- 172.21.15.3:0/4146379981 >> v2:172.21.15.3:3300/0 conn(0x7f0010159410 0x7f00100ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 --2- 172.21.15.3:0/4146379981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0010159040 0x7f00100b2c10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 -- 172.21.15.3:0/4146379981 >> 172.21.15.3:0/4146379981 conn(0x7f00100d0920 msgr2=0x7f00100cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:44.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 -- 172.21.15.3:0/4146379981 shutdown_connections 2023-10-08T16:15:44.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 -- 172.21.15.3:0/4146379981 wait complete. 2023-10-08T16:15:44.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 Processor -- start 2023-10-08T16:15:44.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.889+0000 7f0017b81700 1 -- start start 2023-10-08T16:15:44.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00100cd420 0x7f001014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 0x7f0010155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0010155640 0x7f00101578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010155ae0 con 0x7f0010159040 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001015ca30 con 0x7f00100cd420 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001015d890 con 0x7f0010155640 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 0x7f0010155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 0x7f0010155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59678/0 (socket says 172.21.15.3:59678) 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 -- 172.21.15.3:0/471855382 learned_addr learned my addr 172.21.15.3:0/471855382 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001611e700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0010155640 0x7f00101578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001591d700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00100cd420 0x7f001014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 -- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0010155640 msgr2=0x7f00101578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0010155640 0x7f00101578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 -- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00100cd420 msgr2=0x7f001014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00100cd420 0x7f001014adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:44.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 -- 172.21.15.3:0/471855382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009a20 con 0x7f0010159040 2023-10-08T16:15:44.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f001511c700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 0x7f0010155100 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f000000c990 tx=0x7f0000001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:44.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000ce20 con 0x7f0010159040 2023-10-08T16:15:44.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000005b30 con 0x7f0010159040 2023-10-08T16:15:44.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c009420 con 0x7f0010159040 2023-10-08T16:15:44.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000070f0 con 0x7f0010159040 2023-10-08T16:15:44.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001015cf60 con 0x7f0010159040 2023-10-08T16:15:44.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.893+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001015da20 con 0x7f0010159040 2023-10-08T16:15:44.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.897+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f00000074e0 con 0x7f0010159040 2023-10-08T16:15:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.897+0000 7f0005ffb700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efff4060550 0x7efff4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.897+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f000007c100 con 0x7f0010159040 2023-10-08T16:15:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.897+0000 7f001591d700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efff4060550 0x7efff4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.897+0000 7f001591d700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efff4060550 0x7efff4062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0010069f70 tx=0x7f000c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:44.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:44.901+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f000004ca80 con 0x7f0010159040 2023-10-08T16:15:45.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.065+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0010071180 con 0x7f0010159040 2023-10-08T16:15:45.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.073+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f000004ca80 con 0x7f0010159040 2023-10-08T16:15:45.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0005ffb700 1 -- 172.21.15.3:0/471855382 <== mon.0 v2:172.21.15.3:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f00000500a0 con 0x7f0010159040 2023-10-08T16:15:45.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efff4060550 msgr2=0x7efff4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efff4060550 0x7efff4062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0010069f70 tx=0x7f000c016000 comp rx=0 tx=0).stop 2023-10-08T16:15:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 msgr2=0x7f0010155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 0x7f0010155100 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f000000c990 tx=0x7f0000001a00 comp rx=0 tx=0).stop 2023-10-08T16:15:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 shutdown_connections 2023-10-08T16:15:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7efff4060550 0x7efff4062a00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f0010155640 0x7f00101578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0010159040 0x7f0010155100 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.077+0000 7f0017b81700 1 --2- 172.21.15.3:0/471855382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00100cd420 0x7f001014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.081+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 >> 172.21.15.3:0/471855382 conn(0x7f00100d0920 msgr2=0x7f001006a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.081+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 shutdown_connections 2023-10-08T16:15:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.081+0000 7f0017b81700 1 -- 172.21.15.3:0/471855382 wait complete. 2023-10-08T16:15:45.101 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:15:45.101 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:45.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.201+0000 7f9cfffff700 1 Processor -- start 2023-10-08T16:15:45.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.201+0000 7f9cfffff700 1 -- start start 2023-10-08T16:15:45.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9d000684b0 0x7f9d00068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:45.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9d001592b0 0x7f9d0006d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:45.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0006e340 con 0x7f9d0006ccc0 2023-10-08T16:15:45.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0006d730 con 0x7f9d000684b0 2023-10-08T16:15:45.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0006da10 con 0x7f9d001592b0 2023-10-08T16:15:45.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfeffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9d000684b0 0x7f9d00068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:45.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfe7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9d0006ccc0 0x7f9d00158ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35668/0 (socket says 172.21.15.3:35668) 2023-10-08T16:15:45.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfe7fc700 1 -- 172.21.15.3:0/3139310572 learned_addr learned my addr 172.21.15.3:0/3139310572 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T16:15:45.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cff7fe700 1 --2- 172.21.15.3:0/3139310572 >> v2:172.21.15.27:3300/0 conn(0x7f9d001592b0 0x7f9d0006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:45.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfeffd700 1 -- 172.21.15.3:0/3139310572 >> v2:172.21.15.27:3300/0 conn(0x7f9d001592b0 msgr2=0x7f9d0006d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfeffd700 1 --2- 172.21.15.3:0/3139310572 >> v2:172.21.15.27:3300/0 conn(0x7f9d001592b0 0x7f9d0006d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfeffd700 1 -- 172.21.15.3:0/3139310572 >> v1:172.21.15.3:6789/0 conn(0x7f9d0006ccc0 legacy=0x7f9d00158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfdffb700 1 -- 172.21.15.3:0/3139310572 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048345543 0 0) 0x7f9d0006e340 con 0x7f9d0006ccc0 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfeffd700 1 -- 172.21.15.3:0/3139310572 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0006dcf0 con 0x7f9d000684b0 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfeffd700 1 --2- 172.21.15.3:0/3139310572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d000684b0 0x7f9d00068880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9d000c6c20 tx=0x7f9cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cca413931ec19d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfdffb700 1 -- 172.21.15.3:0/3139310572 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0011630 con 0x7f9d000684b0 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfdffb700 1 -- 172.21.15.3:0/3139310572 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9cf0011790 con 0x7f9d000684b0 2023-10-08T16:15:45.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.205+0000 7f9cfdffb700 1 -- 172.21.15.3:0/3139310572 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0011b50 con 0x7f9d000684b0 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 -- 172.21.15.3:0/3139310572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d000684b0 msgr2=0x7f9d00068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 --2- 172.21.15.3:0/3139310572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d000684b0 0x7f9d00068880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9d000c6c20 tx=0x7f9cf00091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 -- 172.21.15.3:0/3139310572 shutdown_connections 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 --2- 172.21.15.3:0/3139310572 >> v2:172.21.15.27:3300/0 conn(0x7f9d001592b0 0x7f9d0006d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 --2- 172.21.15.3:0/3139310572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d000684b0 0x7f9d00068880 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 -- 172.21.15.3:0/3139310572 >> 172.21.15.3:0/3139310572 conn(0x7f9d000c8c90 msgr2=0x7f9d000c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 -- 172.21.15.3:0/3139310572 shutdown_connections 2023-10-08T16:15:45.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 -- 172.21.15.3:0/3139310572 wait complete. 2023-10-08T16:15:45.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 Processor -- start 2023-10-08T16:15:45.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 -- start start 2023-10-08T16:15:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.209+0000 7f9cfffff700 1 --2- >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9d000684b0 0x7f9d0015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 0x7f9d000c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d001592b0 0x7f9d0015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c4d50 con 0x7f9d0006ccc0 2023-10-08T16:15:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c3cb0 con 0x7f9d001592b0 2023-10-08T16:15:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 -- --> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c3f90 con 0x7f9d000684b0 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 0x7f9d000c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 0x7f9d000c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59700/0 (socket says 172.21.15.3:59700) 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 -- 172.21.15.3:0/4063585011 learned_addr learned my addr 172.21.15.3:0/4063585011 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfeffd700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9d000684b0 0x7f9d0015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cff7fe700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d001592b0 0x7f9d0015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 -- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9d000684b0 msgr2=0x7f9d0015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9d000684b0 0x7f9d0015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 -- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d001592b0 msgr2=0x7f9d0015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d001592b0 0x7f9d0015ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 -- 172.21.15.3:0/4063585011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009420 con 0x7f9d0006ccc0 2023-10-08T16:15:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfe7fc700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 0x7f9d000c32d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c5b0 tx=0x7f9cf4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4005b30 con 0x7f9d0006ccc0 2023-10-08T16:15:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9cf4005c90 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d000c4270 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4007320 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d000c48b0 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000c4a40 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.213+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9cf401b3b0 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.217+0000 7f9ce6ffd700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9cec060550 0x7f9cec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.217+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4982+0+0 (secure 0 0 0) 0x7f9cf407b970 con 0x7f9d0006ccc0 2023-10-08T16:15:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.217+0000 7f9cfeffd700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9cec060550 0x7f9cec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:45.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.217+0000 7f9cfeffd700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9cec060550 0x7f9cec062a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00093f0 tx=0x7f9cf00091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:45.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.221+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9cf404c2b0 con 0x7f9d0006ccc0 2023-10-08T16:15:45.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.417+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d0004be40 con 0x7f9d0006ccc0 2023-10-08T16:15:45.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9ce6ffd700 1 -- 172.21.15.3:0/4063585011 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f9cf4017de0 con 0x7f9d0006ccc0 2023-10-08T16:15:45.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T16:15:45.428 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3611892424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3611892424},{"type":"v1","addr":"172.21.15.27:6833","nonce":3611892424}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2015668192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2015668192},{"type":"v1","addr":"172.21.15.27:6835","nonce":2015668192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/4279449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":4279449423},{"type":"v1","addr":"172.21.15.3:6835","nonce":4279449423}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/2391757817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":2391757817},{"type":"v1","addr":"172.21.15.3:6837","nonce":2391757817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-10-08T16:15:45.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9cec060550 msgr2=0x7f9cec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9cec060550 0x7f9cec062a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00093f0 tx=0x7f9cf00091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 msgr2=0x7f9d000c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 0x7f9d000c32d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c5b0 tx=0x7f9cf4001070 comp rx=0 tx=0).stop 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 shutdown_connections 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:6832/33399,v1:172.21.15.3:6833/33399] conn(0x7f9cec060550 0x7f9cec062a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d001592b0 0x7f9d0015ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d0006ccc0 0x7f9d000c32d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 --2- 172.21.15.3:0/4063585011 >> [v2:172.21.15.27:3301/0,v1:172.21.15.27:6790/0] conn(0x7f9d000684b0 0x7f9d0015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:45.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 >> 172.21.15.3:0/4063585011 conn(0x7f9d000c8c90 msgr2=0x7f9d000b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:45.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 shutdown_connections 2023-10-08T16:15:45.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T16:15:45.421+0000 7f9cfffff700 1 -- 172.21.15.3:0/4063585011 wait complete. 2023-10-08T16:15:45.432 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 21 2023-10-08T16:15:45.443 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-08T16:15:45.443 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T16:15:45.444 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:15:45.444 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.457 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:15:45.457 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:15:45.457 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.471 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:15:45.471 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:15:45.471 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.486 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:15:45.486 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:15:45.487 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.499 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:15:45.499 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T16:15:45.499 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T16:15:45.499 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.577 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T16:15:45.578 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T16:15:45.578 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.655 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T16:15:45.655 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T16:15:45.655 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.732 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T16:15:45.733 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T16:15:45.733 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.828 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T16:15:45.828 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T16:15:45.828 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.909 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T16:15:45.910 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T16:15:45.910 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:45.990 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T16:15:45.990 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T16:15:45.990 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.066 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T16:15:46.066 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T16:15:46.066 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.143 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T16:15:46.144 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T16:15:46.144 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T16:15:46.144 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.172 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T16:15:46.173 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T16:15:46.173 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-08T16:15:46.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-08T16:15:46.199 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T16:15:46.200 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T16:15:46.200 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T16:15:46.200 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.220 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T16:15:46.221 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T16:15:46.221 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.262 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T16:15:46.262 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T16:15:46.262 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:15:46.278 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T16:15:46.278 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T16:15:46.278 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'responding to mclientcaps\(revoke\)' | egrep -v 'not advance its oldest_client_tid' | egrep -v 'failing to advance its oldest client/flush tid' | egrep -v 'Too many inodes in cache' | egrep -v 'failing to respond to cache pressure' | egrep -v 'slow requests are blocked' | egrep -v 'failing to respond to capability release' | egrep -v 'MDS cache is too large' | egrep -v '\(MDS_CLIENT_OLDEST_TID\)' | egrep -v '\(MDS_CACHE_OVERSIZED\)' | head -n 1 2023-10-08T16:15:46.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:15:46.301 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T16:15:46.650 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:15:46.651 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T16:15:46.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:15:46.970 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T16:15:47.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:15:47.181 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T16:15:47.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:15:47.351 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T16:15:47.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:15:47.562 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T16:15:47.788 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:15:47.789 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T16:15:47.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:15:47.971 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T16:15:48.105 INFO:tasks.ceph:Archiving mon data... 2023-10-08T16:15:48.106 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/data/mon.a.tgz 2023-10-08T16:15:48.107 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-10-08T16:15:48.113 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.ILApPrBPZC 2023-10-08T16:15:48.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ILApPrBPZC 2023-10-08T16:15:48.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.ILApPrBPZC 2023-10-08T16:15:48.246 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.ILApPrBPZC is 249KB 2023-10-08T16:15:48.265 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.ILApPrBPZC 2023-10-08T16:15:48.270 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/data/mon.b.tgz 2023-10-08T16:15:48.270 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-10-08T16:15:48.277 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.aRmy9hyXxF 2023-10-08T16:15:48.277 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aRmy9hyXxF 2023-10-08T16:15:48.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.aRmy9hyXxF 2023-10-08T16:15:48.417 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.aRmy9hyXxF is 253KB 2023-10-08T16:15:48.477 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.aRmy9hyXxF 2023-10-08T16:15:48.484 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/data/mon.c.tgz 2023-10-08T16:15:48.484 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-10-08T16:15:48.490 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.sOmpvsQZJh 2023-10-08T16:15:48.491 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sOmpvsQZJh 2023-10-08T16:15:48.565 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.sOmpvsQZJh 2023-10-08T16:15:48.633 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.sOmpvsQZJh is 253KB 2023-10-08T16:15:48.693 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.sOmpvsQZJh 2023-10-08T16:15:48.700 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T16:15:48.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T16:15:48.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T16:15:48.717 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T16:15:48.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T16:15:48.719 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T16:15:48.740 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T16:15:48.742 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T16:15:48.750 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T16:15:48.752 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/remote/smithi003/crash 2023-10-08T16:15:48.753 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T16:15:48.770 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/remote/smithi027/crash 2023-10-08T16:15:48.771 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T16:15:48.805 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T16:15:48.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:48.816 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:48.859 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:48.877 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:48.918 INFO:tasks.ceph:Compressing logs... 2023-10-08T16:15:48.918 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T16:15:48.921 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T16:15:48.945 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-08T16:15:48.945 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33433.log 2023-10-08T16:15:48.946 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T16:15:48.946 INFO:teuthology.orchestra.run.smithi027.stderr:gzip /var/log/ceph/ceph-client.admin.33433.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33539.log 2023-10-08T16:15:48.947 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39478.log 2023-10-08T16:15:48.947 INFO:teuthology.orchestra.run.smithi027.stderr: 87.5%/var/log/ceph/ceph-mon.b.log: -- replaced with /var/log/ceph/ceph-client.admin.33433.log.gz 2023-10-08T16:15:48.948 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.33539.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T16:15:48.948 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.1.39478.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33539.log.gz 2023-10-08T16:15:48.948 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33487.log 2023-10-08T16:15:48.949 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.39591.log 2023-10-08T16:15:48.949 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.5.log: 88.8% -- replaced with /var/log/ceph/ceph-client.1.39478.log.gz 2023-10-08T16:15:48.950 INFO:teuthology.orchestra.run.smithi027.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-08T16:15:48.950 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39889.log 2023-10-08T16:15:48.950 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.33487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2023-10-08T16:15:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.1.39889.log: gzip /var/log/ceph/ceph-client.3.39591.log: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T16:15:48.952 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33487.log.gz 2023-10-08T16:15:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T16:15:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.33514.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T16:15:48.953 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mgr.x.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2023-10-08T16:15:48.953 INFO:teuthology.orchestra.run.smithi027.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.3.39591.log.gz 2023-10-08T16:15:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2023-10-08T16:15:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42255.log 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44381.log 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42255.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42255.log.gz 2023-10-08T16:15:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:gzip /var/log/ceph/ceph-client.admin.44381.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2023-10-08T16:15:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2023-10-08T16:15:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44080.log: /var/log/ceph/ceph-client.admin.45670.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44381.log.gz 2023-10-08T16:15:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45221.log 2023-10-08T16:15:48.956 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2023-10-08T16:15:48.956 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-10-08T16:15:48.956 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39039.log 2023-10-08T16:15:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46239.log: /var/log/ceph/ceph-client.admin.45221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40353.log 2023-10-08T16:15:48.959 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2023-10-08T16:15:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43215.log 2023-10-08T16:15:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39039.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45221.log.gz 2023-10-08T16:15:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39516.log 2023-10-08T16:15:48.959 INFO:teuthology.orchestra.run.smithi003.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40353.log.gz 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40731.log 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39039.log.gz 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43215.log: /var/log/ceph/ceph-client.admin.39516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43458.log 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39516.log.gz 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40731.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.43215.log.gz 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.44595.log 2023-10-08T16:15:48.960 INFO:teuthology.orchestra.run.smithi003.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40731.log.gz 2023-10-08T16:15:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T16:15:48.961 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2023-10-08T16:15:48.966 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mon.c.log: 96.6% -- replaced with /var/log/ceph/ceph-client.1.39889.log.gz 2023-10-08T16:15:48.966 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T16:15:48.966 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33378.log 2023-10-08T16:15:48.966 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33460.log 2023-10-08T16:15:48.966 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.33378.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2023-10-08T16:15:48.966 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.33460.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33460.log.gz 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33405.log 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.33405.log: /var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33405.log.gz 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T16:15:48.967 INFO:teuthology.orchestra.run.smithi027.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T16:15:48.968 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39739.log 2023-10-08T16:15:48.968 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.4.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T16:15:48.968 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2023-10-08T16:15:48.971 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.1.39739.log: 92.8% -- replaced with /var/log/ceph/ceph-client.1.39739.log.gz 2023-10-08T16:15:48.971 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T16:15:48.971 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.33568.log: /var/log/ceph/ceph-osd.7.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2023-10-08T16:15:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44595.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2023-10-08T16:15:48.978 INFO:teuthology.orchestra.run.smithi003.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43458.log.gz 2023-10-08T16:15:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42565.log 88.4% 2023-10-08T16:15:48.978 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44595.log.gz 2023-10-08T16:15:48.978 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40923.log 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6%/var/log/ceph/ceph-client.admin.43612.log: -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45140.log 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42565.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.40923.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42565.log.gz 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45140.log.gz 2023-10-08T16:15:48.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39948.log 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45167.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43666.log 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39094.log 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.40923.log.gz 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39948.log: /var/log/ceph/ceph-client.admin.43666.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-08T16:15:48.980 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43666.log.gz 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39094.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39948.log.gz 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45458.log 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39094.log.gz 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43377.log 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.45458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42310.log 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42729.log /var/log/ceph/ceph-client.admin.43377.log: 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45458.log.gz 2023-10-08T16:15:48.981 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42310.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43377.log.gz 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42310.log.gz 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39175.log 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40814.log 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42511.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42729.log.gz 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42201.log 2023-10-08T16:15:48.982 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39175.log.gz 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44541.log 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.41066.log 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42201.log: /var/log/ceph/ceph-client.0.44541.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40814.log.gz 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42201.log.gz 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44217.log 2023-10-08T16:15:48.983 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.2.41066.log: /var/log/ceph/ceph-mds.a.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.0.44541.log.gz-5 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45275.log 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44217.log: 89.7% -- replaced with /var/log/ceph/ceph-client.2.41066.log.gz 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44217.log.gz 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44988.log 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43785.log 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41677.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45275.log.gz 2023-10-08T16:15:48.984 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39939.log 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44988.log.gz 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39261.log 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39939.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43785.log.gz 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44018.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39939.log.gz 2023-10-08T16:15:48.985 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39727.log 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39261.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44654.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39261.log.gz 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41758.log 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41141.log 2023-10-08T16:15:48.986 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41580.log 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr: 89.1%/var/log/ceph/ceph-client.admin.41758.log: -- replaced with /var/log/ceph/ceph-client.admin.39727.log.gz 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41141.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41758.log.gz 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44814.log 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41580.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41141.log.gz 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41499.log 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46075.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41580.log.gz 2023-10-08T16:15:48.987 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44814.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gz 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39949.log 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44814.log.gz 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1%/var/log/ceph/ceph-client.admin.33632.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41499.log.gz 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39624.log 2023-10-08T16:15:48.988 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mgr.y.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39949.log.gz 2023-10-08T16:15:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2023-10-08T16:15:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2023-10-08T16:15:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2023-10-08T16:15:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39624.log.gz 2023-10-08T16:15:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33487.log 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45587.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gz 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33487.log: /var/log/ceph/ceph-client.admin.45751.log 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:gzip /var/log/ceph/ceph-client.admin.40596.log: -5 87.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33487.log.gz 2023-10-08T16:15:48.995 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41202.log 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45751.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45751.log.gz 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43431.log 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41202.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28498.log 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45724.log 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43431.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41202.log.gz 2023-10-08T16:15:48.996 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.tmp-client.admin.28498.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43431.log.gz 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28498.log.gz 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41553.log 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40650.log 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41229.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45724.log.gz 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41553.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39731.log 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2023-10-08T16:15:48.997 INFO:teuthology.orchestra.run.smithi003.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41553.log.gz 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45032.log 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41526.log 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39731.log: -- replaced with /var/log/ceph/ceph-client.admin.40650.log.gz 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45032.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39731.log.gz 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2023-10-08T16:15:48.998 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45032.log.gz 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41526.log: /var/log/ceph/ceph-client.admin.44841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41526.log.gz 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45778.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2023-10-08T16:15:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43531.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2023-10-08T16:15:49.000 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44762.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2023-10-08T16:15:49.000 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2023-10-08T16:15:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39732.log 2023-10-08T16:15:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44271.log 2023-10-08T16:15:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.39732.log: -- /var/log/ceph/ceph-client.admin.40141.log 2023-10-08T16:15:49.005 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2023-10-08T16:15:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44271.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.39732.log.gz-5 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45375.log 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44271.log.gz 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40141.log.gz 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log /var/log/ceph/ceph-client.admin.45375.log: 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.44107.log: -- /var/log/ceph/ceph.audit.log 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2023-10-08T16:15:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45485.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39678.log 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45967.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gz 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42047.log 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39678.log: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T16:15:49.007 INFO:teuthology.orchestra.run.smithi003.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39678.log.gz 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:gzip /var/log/ceph/ceph-client.admin.42047.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45512.log 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40973.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42047.log.gz 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2023-10-08T16:15:49.008 INFO:teuthology.orchestra.run.smithi003.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43752.log 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45512.log: /var/log/ceph/ceph-client.admin.41445.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45512.log.gz 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42648.log 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 /var/log/ceph/ceph-client.admin.43752.log: --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44053.log 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42648.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43752.log.gz 2023-10-08T16:15:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41114.log 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42648.log.gz 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44053.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40704.log 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:gzip /var/log/ceph/ceph-client.admin.41114.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45402.log 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40704.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41114.log.gz 2023-10-08T16:15:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45402.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40704.log.gz 2023-10-08T16:15:49.011 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45402.log.gz 2023-10-08T16:15:49.011 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39350.log 2023-10-08T16:15:49.012 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39408.log 2023-10-08T16:15:49.014 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40165.log 2023-10-08T16:15:49.014 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39350.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39350.log.gz 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39943.log 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39408.log.gz 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40165.log: /var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40165.log.gz 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2023-10-08T16:15:49.015 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41283.log 2023-10-08T16:15:49.016 INFO:teuthology.orchestra.run.smithi003.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39943.log.gz 2023-10-08T16:15:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42943.log 2023-10-08T16:15:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2023-10-08T16:15:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41283.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2023-10-08T16:15:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42943.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41283.log.gz 2023-10-08T16:15:49.016 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2023-10-08T16:15:49.021 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42943.log.gz 2023-10-08T16:15:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40162.log 2023-10-08T16:15:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44298.log 2023-10-08T16:15:49.021 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39728.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40162.log: gzip 87.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz--verbose 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:-- /var/log/ceph/ceph-client.admin.40515.log 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44298.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40162.log.gz 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44298.log.gz 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39945.log 2023-10-08T16:15:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45643.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40515.log.gz 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39945.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40380.log 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39945.log.gz 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42447.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2023-10-08T16:15:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39202.log 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45113.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40380.log.gz 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41893.log 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41418.log 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0%/var/log/ceph/ceph-client.admin.40758.log: -- replaced with /var/log/ceph/ceph-client.admin.39202.log.gz 2023-10-08T16:15:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41418.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41893.log.gz 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44190.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41418.log.gz 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38973.log 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2023-10-08T16:15:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:gzip /var/log/ceph/ceph-client.admin.42282.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42364.log 2023-10-08T16:15:49.029 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45832.log 2023-10-08T16:15:49.029 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38973.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2023-10-08T16:15:49.029 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41731.log 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38973.log.gz 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42364.log.gz 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45832.log: /var/log/ceph/ceph-client.admin.41731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43879.log 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45832.log.gz 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39597.log 2023-10-08T16:15:49.030 INFO:teuthology.orchestra.run.smithi003.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41731.log.gz/var/log/ceph/ceph-osd.1.log: 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43879.log: /var/log/ceph/ceph-client.admin.39597.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43879.log.gz 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39597.log.gz 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42228.log 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40137.log 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43933.log: /var/log/ceph/ceph-client.admin.42228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2023-10-08T16:15:49.031 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6%/var/log/ceph/ceph-client.admin.40137.log: -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2023-10-08T16:15:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43585.log 2023-10-08T16:15:49.032 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40137.log.gz 2023-10-08T16:15:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2023-10-08T16:15:49.032 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2023-10-08T16:15:49.039 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43585.log.gz 2023-10-08T16:15:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39489.log 2023-10-08T16:15:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46212.log 2023-10-08T16:15:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42834.log: /var/log/ceph/ceph-client.admin.39489.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2023-10-08T16:15:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:gzip 87.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.39489.log.gz--verbose 2023-10-08T16:15:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:-- /var/log/ceph/ceph-client.admin.39435.log 2023-10-08T16:15:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39942.log 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39435.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46212.log.gz 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1%/var/log/ceph/ceph-client.admin.45886.log: -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40677.log 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39462.log 2023-10-08T16:15:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40677.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39942.log.gz 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46102.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40677.log.gz 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39462.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39462.log.gz 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40569.log 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45859.log 2023-10-08T16:15:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45913.log 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40569.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr: 88.7%/var/log/ceph/ceph-client.admin.45859.log: -- replaced with /var/log/ceph/ceph-client.admin.40569.log.gz 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42174.log 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45859.log.gz 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45913.log: /var/log/ceph/ceph-client.admin.42174.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45913.log.gz 2023-10-08T16:15:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38871.log 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42174.log.gz 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42997.log 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39231.log 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38871.log: 88.7%/var/log/ceph/ceph-client.admin.42997.log: -- replaced with /var/log/ceph/ceph-client.admin.38871.log.gz 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42997.log.gz 2023-10-08T16:15:49.044 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39121.log 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42538.log 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39231.log: /var/log/ceph/ceph-client.admin.39121.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39231.log.gz 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39121.log.gz 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39730.log 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45194.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42538.log.gz 2023-10-08T16:15:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39730.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2023-10-08T16:15:49.051 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43323.log 2023-10-08T16:15:49.051 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39730.log.gz 2023-10-08T16:15:49.051 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43639.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2023-10-08T16:15:49.051 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46021.log 2023-10-08T16:15:49.051 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40159.log 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43323.log: /var/log/ceph/ceph-client.admin.46021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41812.log 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43323.log.gz 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40159.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46021.log.gz 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40159.log.gz 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39729.log 2023-10-08T16:15:49.052 INFO:teuthology.orchestra.run.smithi003.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41812.log.gz 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41636.log 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41391.log 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39729.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41636.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39729.log.gz 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41636.log.gz 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43188.log 2023-10-08T16:15:49.053 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42476.log 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41391.log: /var/log/ceph/ceph-client.admin.43188.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41391.log.gz 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43188.log.gz 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46156.log 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43404.log 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42476.log: /var/log/ceph/ceph-client.admin.46156.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45940.log 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46156.log.gz 2023-10-08T16:15:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41310.log 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45940.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43404.log.gz 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41472.log 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42675.log 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41310.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45940.log.gz 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41472.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41310.log.gz 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41472.log.gz 2023-10-08T16:15:49.055 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43296.log 2023-10-08T16:15:49.060 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41785.log 2023-10-08T16:15:49.061 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42675.log: /var/log/ceph/ceph-client.admin.43296.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42675.log.gz 2023-10-08T16:15:49.061 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2023-10-08T16:15:49.061 INFO:teuthology.orchestra.run.smithi003.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43296.log.gz 2023-10-08T16:15:49.061 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2023-10-08T16:15:49.061 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39323.log 2023-10-08T16:15:49.061 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41785.log.gz 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41839.log 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr: 87.5%/var/log/ceph/ceph-client.admin.44622.log: -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39323.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39323.log.gz 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42391.log 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40488.log 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41839.log.gz 2023-10-08T16:15:49.062 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42391.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42391.log.gz 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41607.log 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40488.log: /var/log/ceph/ceph-client.admin.41607.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40488.log.gz 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45248.log 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41607.log.gz 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39651.log 2023-10-08T16:15:49.063 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45248.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41256.log 2023-10-08T16:15:49.064 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2023-10-08T16:15:49.064 INFO:teuthology.orchestra.run.smithi003.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45248.log.gz 2023-10-08T16:15:49.065 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2023-10-08T16:15:49.065 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39651.log.gz 2023-10-08T16:15:49.065 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44712.log 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45697.log 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41256.log.gz 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44868.log: /var/log/ceph/ceph-client.0.44712.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3%/var/log/ceph/ceph-client.admin.43852.log: -- replaced with /var/log/ceph/ceph-client.admin.45697.log.gz 2023-10-08T16:15:49.066 INFO:teuthology.orchestra.run.smithi003.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42418.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39296.log 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43269.log 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39296.log.gz 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T16:15:49.070 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43093.log 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43269.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43269.log.gz 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40407.log 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr:gzip /var/log/ceph/ceph-client.admin.43093.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46185.log 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43093.log.gz 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40407.log.gz 2023-10-08T16:15:49.071 INFO:teuthology.orchestra.run.smithi003.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T16:15:49.072 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46185.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46185.log.gz 2023-10-08T16:15:49.072 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T16:15:49.072 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45539.log 2023-10-08T16:15:49.072 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39066.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40164.log 2023-10-08T16:15:49.072 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2023-10-08T16:15:49.073 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45539.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45539.log.gz 2023-10-08T16:15:49.074 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44895.log 2023-10-08T16:15:49.074 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40164.log.gz 2023-10-08T16:15:49.074 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2023-10-08T16:15:49.074 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2023-10-08T16:15:49.074 INFO:teuthology.orchestra.run.smithi003.stderr: 87.5%/var/log/ceph/ceph-client.admin.44435.log: -- replaced with /var/log/ceph/ceph-client.admin.44895.log.gz 2023-10-08T16:15:49.074 INFO:teuthology.orchestra.run.smithi003.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2023-10-08T16:15:49.075 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39148.log 2023-10-08T16:15:49.075 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45086.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2023-10-08T16:15:49.076 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44354.log 2023-10-08T16:15:49.076 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42337.log 2023-10-08T16:15:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44354.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39148.log.gz 2023-10-08T16:15:49.077 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44163.log 2023-10-08T16:15:49.078 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44354.log.gz 2023-10-08T16:15:49.078 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42337.log.gz 2023-10-08T16:15:49.079 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39726.log 2023-10-08T16:15:49.079 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43906.log 2023-10-08T16:15:49.080 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39726.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44163.log.gz 2023-10-08T16:15:49.080 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40461.log 2023-10-08T16:15:49.080 INFO:teuthology.orchestra.run.smithi003.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39726.log.gz 2023-10-08T16:15:49.080 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40163.log 2023-10-08T16:15:49.081 INFO:teuthology.orchestra.run.smithi003.stderr: 89.4%/var/log/ceph/ceph-client.admin.40461.log: -- replaced with /var/log/ceph/ceph-client.admin.43906.log.gz 2023-10-08T16:15:49.081 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42783.log 2023-10-08T16:15:49.082 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40461.log.gz 2023-10-08T16:15:49.082 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40163.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40163.log.gz 2023-10-08T16:15:49.082 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40434.log 2023-10-08T16:15:49.082 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42783.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42783.log.gz 2023-10-08T16:15:49.083 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39940.log 2023-10-08T16:15:49.083 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40434.log.gz 2023-10-08T16:15:49.084 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2023-10-08T16:15:49.084 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44136.log 2023-10-08T16:15:49.085 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44961.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39940.log.gz 2023-10-08T16:15:49.086 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39543.log 2023-10-08T16:15:49.086 INFO:teuthology.orchestra.run.smithi003.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2023-10-08T16:15:49.086 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44408.log 2023-10-08T16:15:49.086 INFO:teuthology.orchestra.run.smithi003.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44136.log.gz/var/log/ceph/ceph-client.admin.39543.log: 2023-10-08T16:15:49.086 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39543.log.gz 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43485.log 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40161.log 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44408.log: /var/log/ceph/ceph-client.admin.43485.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44408.log.gz 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43485.log.gz 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40161.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40161.log.gz 2023-10-08T16:15:49.088 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2023-10-08T16:15:49.090 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2023-10-08T16:15:49.090 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2%/var/log/ceph/ceph-client.admin.43242.log: -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2023-10-08T16:15:49.090 INFO:teuthology.orchestra.run.smithi003.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2023-10-08T16:15:49.090 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2023-10-08T16:15:49.091 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43720.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2023-10-08T16:15:49.091 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2023-10-08T16:15:49.092 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45994.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2023-10-08T16:15:49.092 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44325.log 2023-10-08T16:15:49.092 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42594.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T16:15:49.092 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44325.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz 2023-10-08T16:15:49.092 INFO:teuthology.orchestra.run.smithi003.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44325.log.gz 2023-10-08T16:15:49.095 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2023-10-08T16:15:49.099 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42020.log 2023-10-08T16:15:49.100 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43989.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2023-10-08T16:15:49.103 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39570.log 2023-10-08T16:15:49.104 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42020.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42020.log.gz 2023-10-08T16:15:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2023-10-08T16:15:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2023-10-08T16:15:49.112 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43693.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39570.log.gz 2023-10-08T16:15:49.112 INFO:teuthology.orchestra.run.smithi003.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2023-10-08T16:15:49.114 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40542.log 2023-10-08T16:15:49.114 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43061.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2023-10-08T16:15:49.115 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41866.log 2023-10-08T16:15:49.116 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40542.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40542.log.gz 2023-10-08T16:15:49.116 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42892.log 2023-10-08T16:15:49.117 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41866.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41866.log.gz 2023-10-08T16:15:49.119 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41984.log 2023-10-08T16:15:49.135 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.42892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43960.log 2023-10-08T16:15:49.136 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41984.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41984.log.gz 2023-10-08T16:15:49.151 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46129.log 2023-10-08T16:15:49.152 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43960.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43960.log.gz 2023-10-08T16:15:49.156 INFO:teuthology.orchestra.run.smithi027.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T16:15:49.167 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42756.log 2023-10-08T16:15:49.168 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46129.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46129.log.gz 2023-10-08T16:15:49.183 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41364.log 2023-10-08T16:15:49.184 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42756.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42756.log.gz 2023-10-08T16:15:49.184 INFO:teuthology.orchestra.run.smithi027.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T16:15:49.199 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39733.log 2023-10-08T16:15:49.200 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41364.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41364.log.gz 2023-10-08T16:15:49.208 INFO:teuthology.orchestra.run.smithi003.stderr: 92.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38939.log 2023-10-08T16:15:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39733.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39733.log.gz 2023-10-08T16:15:49.213 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.0.42892.log.gz 2023-10-08T16:15:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41175.log 2023-10-08T16:15:49.213 INFO:teuthology.orchestra.run.smithi003.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T16:15:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2023-10-08T16:15:49.214 INFO:teuthology.orchestra.run.smithi003.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38939.log.gz 2023-10-08T16:15:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39944.log 2023-10-08T16:15:49.215 INFO:teuthology.orchestra.run.smithi003.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41175.log.gz 2023-10-08T16:15:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41947.log 2023-10-08T16:15:49.215 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2023-10-08T16:15:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39944.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T16:15:49.216 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39944.log.gz 2023-10-08T16:15:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41947.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41947.log.gz 2023-10-08T16:15:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2023-10-08T16:15:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.39379.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 2023-10-08T16:15:49.391 INFO:teuthology.orchestra.run.smithi003.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T16:15:50.929 INFO:teuthology.orchestra.run.smithi027.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T16:15:51.015 INFO:teuthology.orchestra.run.smithi027.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T16:15:51.042 INFO:teuthology.orchestra.run.smithi027.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T16:15:51.186 INFO:teuthology.orchestra.run.smithi027.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T16:15:51.186 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-10-08T16:15:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m2.262s 2023-10-08T16:15:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m8.540s 2023-10-08T16:15:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m0.323s 2023-10-08T16:15:51.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-10-08T16:15:51.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-10-08T16:15:51.274 INFO:teuthology.orchestra.run.smithi003.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T16:15:51.694 INFO:teuthology.orchestra.run.smithi003.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T16:15:51.699 INFO:teuthology.orchestra.run.smithi003.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T16:15:52.396 INFO:teuthology.orchestra.run.smithi003.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T16:16:05.785 INFO:teuthology.orchestra.run.smithi003.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.44712.log.gz 2023-10-08T16:16:29.939 INFO:teuthology.orchestra.run.smithi003.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-08T16:16:29.942 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-10-08T16:16:29.942 INFO:teuthology.orchestra.run.smithi003.stderr:real 0m41.008s 2023-10-08T16:16:29.942 INFO:teuthology.orchestra.run.smithi003.stderr:user 1m7.430s 2023-10-08T16:16:29.942 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m2.072s 2023-10-08T16:16:29.943 INFO:tasks.ceph:Archiving logs... 2023-10-08T16:16:29.946 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/remote/smithi003/log 2023-10-08T16:16:29.948 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T16:16:38.806 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/remote/smithi027/log 2023-10-08T16:16:38.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T16:16:39.978 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T16:16:39.989 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T16:16:39.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T16:16:39.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T16:16:40.084 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T16:16:40.094 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T16:16:40.094 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:16:40.096 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:16:40.119 INFO:teuthology.orchestra.run.smithi003.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:16:40.119 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================== 2023-10-08T16:16:40.119 INFO:teuthology.orchestra.run.smithi003.stdout:*hv01.front.sepi 44.4.53.2 2 u 7 64 377 0.083 2.791 1.552 2023-10-08T16:16:40.119 INFO:teuthology.orchestra.run.smithi003.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.080 1.154 1.565 2023-10-08T16:16:40.119 INFO:teuthology.orchestra.run.smithi003.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 377 0.080 0.986 1.092 2023-10-08T16:16:40.119 INFO:teuthology.orchestra.run.smithi003.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-08T16:16:40.121 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:16:40.122 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2023-10-08T16:16:40.122 INFO:teuthology.orchestra.run.smithi027.stdout:*hv01.front.sepi 44.4.53.2 2 u 15 64 377 0.065 -1.086 0.598 2023-10-08T16:16:40.122 INFO:teuthology.orchestra.run.smithi027.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.074 -1.460 0.741 2023-10-08T16:16:40.122 INFO:teuthology.orchestra.run.smithi027.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 64 377 0.090 -1.152 0.741 2023-10-08T16:16:40.122 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-08T16:16:40.123 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T16:16:40.132 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T16:16:40.132 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T16:16:40.142 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T16:16:40.150 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T16:16:40.159 INFO:teuthology.task.internal:Duration was 1230.491409 seconds 2023-10-08T16:16:40.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T16:16:40.168 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T16:16:40.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T16:16:40.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T16:16:40.222 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T16:16:40.222 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T16:16:40.222 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T16:16:40.234 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2023-10-08T16:16:40.234 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T16:16:40.247 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T16:16:40.247 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T16:16:40.249 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T16:16:40.285 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T16:16:40.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T16:16:40.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T16:16:40.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T16:16:40.418 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T16:16:40.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T16:16:40.435 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T16:16:40.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T16:16:40.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:16:40.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:16:40.477 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2023-10-08T16:16:40.478 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2023-10-08T16:16:40.493 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:16:40.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:16:40.540 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:16:40.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:16:40.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T16:16:40.557 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T16:16:40.558 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/remote/smithi003 2023-10-08T16:16:40.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T16:16:40.580 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289/remote/smithi027 2023-10-08T16:16:40.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T16:16:40.603 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T16:16:40.603 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T16:16:40.605 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T16:16:40.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T16:16:40.660 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T16:16:40.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T16:16:40.669 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T16:16:40.669 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T16:16:40.674 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 16:16 /home/ubuntu/cephtest 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi027.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 16:16 /home/ubuntu/cephtest 2023-10-08T16:16:40.685 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T16:16:40.695 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T16:16:40.716 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T16:16:40.744 DEBUG:teuthology.nuke:shortname: smithi003 2023-10-08T16:16:40.745 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T16:16:40.768 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:36.233793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-08T16:16:40.772 DEBUG:teuthology.nuke:shortname: smithi027 2023-10-08T16:16:40.772 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T16:16:40.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:36.235069', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-08T16:16:40.827 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-08T16:16:40.827 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T16:16:40.851 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-08T16:16:40.852 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:40.869 INFO:teuthology.orchestra.console.smithi027:Power off 2023-10-08T16:16:40.869 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T16:16:40.878 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-08T16:16:40.891 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-10-08T16:16:40.891 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:40.914 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-08T16:16:44.879 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:44.915 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:44.990 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-08T16:16:45.025 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-08T16:16:48.994 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:49.026 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:49.105 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-08T16:16:49.136 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-08T16:16:53.108 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:53.137 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:16:53.218 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-08T16:16:53.249 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-08T16:16:53.319 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-08T16:16:53.350 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-10-08T16:16:53.456 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} duration: 1230.4914088249207 failure_reason: 'Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c5afd8b3b3af4104b832a1f3b18ddf59 status: fail success: false 2023-10-08T16:16:53.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T16:16:53.533 INFO:teuthology.run:FAIL